Sr Data Engineer - ETL

Technology is constantly changing and our adversaries are digitally exceeding law enforcement’s ability to keep pace. Those charged with protecting the United States are not always able to access the evidence needed to prosecute crime and prevent terrorism. The Government has trusted in Peraton to provide the technical ability, tools, and resources to bring criminals to justice. In response to this challenge, Peraton is seeking a Senior Data Engineer with ETL expertise to provide proven, industry leading capabilities to our customer.

• Design, develop, and maintain the ETL (Extract, Transform, Load) processes for master data management (MDM) system.
• Build and optimize data pipelines to extract data from various sources, transform it into the required format, and load using Databricks and AWS services.
• Collaborate with stakeholders to gather data requirements, understand data sources, and ensure data quality and integrity throughout the ETL process.
•  Implement data validation, cleansing, and enrichment techniques to improve the accuracy and completeness of data.
  
• Monitor and troubleshoot ETL processes to identify and resolve issues in a timely manner.
• Work in a team environment to design, develop, and support a software system which is undergoing a modernization.
• Participate in developing new functionality and migrating the application into the cloud and introducing new technologies into the tech stack.
• Participate in Agile Scrum SDLC activities.
• Support developing Agile SDLC phase documentation.
• Perform unit and integration testing of software/systems prior to release to the users for user acceptance testing.

Required Qualifications

• BS degree and six (6) years of experience with programming and software development including analysis, design, development, implementation, testing, maintenance, quality assurance, troubleshooting and/or upgrading of software systems.
• Strong proficiency in programming languages such as Scala or Java.
• Experience in designing and developing ETL workflows using tools like Apache Spark or AWS Glue.
• In-depth knowledge of ETL best practices, data integration techniques, and data quality management.
• Familiarity with different data storage technologies and databases, such as Amazon S3 or Amazon Redshift.
• Understanding of concepts of Data Lakehouse architecture as well as OpenSearch is a plus.
• A current Top Secret security clearance with SCI eligibility and the ability to obtain a polygraph.

Desired Qualifications

• Knowledge of Tika.
• Experience with AWS cloud services.
• Knowledge of data acquisition and ingestion of structured and unstructured data sources ensuring quality and data integrity.
• Experience with open source technologies like Docker, ElasticSearch, and NoSQL Databases.
• Experience with AWS Lamda, SQS, or NiFi.

Peraton drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world’s leading mission capability integrator and transformative enterprise IT provider, we deliver trusted and highly differentiated national security solutions and technologies that keep people safe and secure. Peraton serves as a valued partner to essential government agencies across the intelligence, space, cyber, defense, civilian, health, and state and local markets. Every day, our employees do the can’t be done, solving the most daunting challenges facing our customers.