Data Engineer

Job Description

Job Description

Role Summary
The Data Engineer leads all data architecture, migration, and management activities for the BATS modernization. This role is responsible for designing and implementing robust, scalable data solutions that support the transition from legacy Microsoft SQL structures to the modernized microservices architecture while ensuring full compliance with ATF Data Governance Manual v4.2 and the IED Reporting Guide.

• Design, build, and optimize ETL/ELT pipelines (SSIS and modern equivalents) for incremental data migration from legacy BATS to the new system.
• Develop and maintain data mappings, transformations, and data quality rules to preserve semantic meaning of arson/explosives incident data.
• Create and optimize data architecture for high-volume transactional and analytical workloads (Incident, Activity, Tracing, Canine modules).
• Ensure data integrity, relationships, and performance across microservices, APIs, and reporting layers.
• Support data ingestion from interfaces (Spartan, EODIMS, BATS API) and third-party sources.
• Collaborate with development and testing teams to validate migrated data in all environments.
• Produce and maintain Data Dictionary, Entity Relationship Diagrams, and migration validation reports.
• Troubleshoot and resolve complex data issues during transition and post-production.

Minimum Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or related field (preferred).
• Minimum 4 years of data engineering experience, with at least 2 years in federal or law enforcement systems.
• Strong expertise in SQL Server, SSIS, data modeling, and ETL processes.
• Experience with GovCloud environments and large-scale data migration.

Preferred Qualifications

• Microsoft Certified: Azure Data Engineer Associate or equivalent.
• Experience modernizing legacy .NET/SQL case management systems.
• Knowledge of ATF/DOJ data governance and security standards.

Clearance/Suitability
Must successfully complete ATF personnel security process (ATF-04) and maintain access to sensitive but unclassified law enforcement data.