Data Engineer

Peraton is seeking a Data Engineer who can leverage experience and expertise in data exploration, engineering, and ETL to explore, architect, develop, and deploy scripts for processing structured and unstructured data into usable data formats for long term storage, search, and analysis.   

• Creating a custom ingest pipeline to a Big Data platform with consistent performance and scalability 
• Understanding of programming and data engineering concepts and best practice. 
• Experience working with both structured, semi-structured, and unstructured data to include data parsing, transformation, schema definition, and query/analysis. 
• Ability to manage and organize data while identifying trends and inconsistencies that will impact downstream analytics 
• Ability to work both independently and collaboratively. 
• High levels of curiosity, creativity, and problem-solving capabilities. 
• Strong written and verbal communication skills. 
• Experience with data pipelines or be willing to learn a pipeline from bottom to top 
• Be able to trouble shoot files against an architecture to see where the upload process is failing. 
• Be able to understand unit tests and add to them to increase stability to the entire pipeline. 
• Be prepared to use, GIT, JIRA, Confluence, Anaconda, Spyder, and Microsoft tools. 
• Be prepared to express ideas and solutions and walk together with teammates through coding challenges 

Required Qualifications: 

• Six years experience with ETL with experience in following:

• •  Oracle 11g/12c, Sun Solaris OS, Linux (CentOS, Red Hat), and Windows environments
  • Performing software and scripting engineering for data ingest with Java or Python for ETL
  • Web services and/or microservices
  • ETL tools such as NiFi or Informatica
  • Using software repository tools such as GIT or SVN
• A current Top Secret security clearance with SCI eligibility and the ability to obtain a polygraph.

Desired Qualifications: 

• Have knowledge of Databricks, Scala, Python, and PySpark
• Have experience tuning complex SQL queries
• Experience with the AWS and Data Ingest/Transformation processes 
• Have worked in an Agile environment.  
• You have worked on teams that practice Agile methodologies. 

Peraton drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world’s leading mission capability integrator and transformative enterprise IT provider, we deliver trusted and highly differentiated national security solutions and technologies that keep people safe and secure. Peraton serves as a valued partner to essential government agencies across the intelligence, space, cyber, defense, civilian, health, and state and local markets. Every day, our employees do the can’t be done, solving the most daunting challenges facing our customers.