Data Ecosystem Data Engineer SME - Hybrid
Job Locations
US-VA-Crystal City
Job ID |
2025-2646
|
Clearance Level |
Top Secret SCI
|
Overview
Iron EagleX (IEX), a wholly owned subsidiary of General Dynamics Information Technology, delivers agile IT and Intelligence solutions. Combining small-team flexibility with global scale, IEX leverages emerging technologies to provide innovative, user-focused solutions that empower organizations and end users to operate smarter, faster, and more securely in dynamic environments
Responsibilities
Job Description: We are seeking a Data Ecosystem Data Engineer SME - Hybrid to design, build, and maintain data collection, processing, and integration pipelines that centralize and structure data from various web-based applications. You will work closely with software developers, data analysts, and product teams to ensure seamless data flow, high-quality data storage, and efficient retrieval methods. This role is ideal for someone passionate about data-driven decision-making and optimizing data aggregation processes while exploring and identifying right-sized technologies and computing resources. This is not a Data Science, Big Data, ML-Ops, or AI-related role. Instead, this position focuses on wrangling disparate data sources into unified, consumable data APIs for internal and external stakeholders. This is a Hybrid position in Crystal City, VA (3 days onsite, 2 remote). Job Duties Include (but not limited to):
Design, develop, and maintain data ingestion pipelines to collect structured and unstructured data from user applications and bulk data sources.
- Implement efficient data transformation and storage strategies to facilitate easy retrieval and analysis.
- Collaborate with software development teams to optimize application-generated data for streamlined aggregation.
- Ensure data integrity, security, and compliance with industry regulations and company policies.
- Optimize query performance and improve data access patterns to support analytical and operational use cases.
- Work with business stakeholders to define data requirements and improve data accessibility for decision-making.
- Design and build APIs to support data ingestion, retrieval, and integration with external systems.
- Develop and maintain event-driven architectures, utilizing event storage for real-time data processing.
Qualifications
Required Skills & Experience:
- 10+ years of experience in data engineering, software development, or a related role.
- Proficiency in database technologies, including SQL, NoSQL, and event-based databases (e.g., PostgreSQL, MySQL, MongoDB, EventStoreDB).
- Strong programming skills in Golang, Python, and JavaScript/TypeScript.
- Experience with cloud-based data solutions (AWS, GCP, or Azure) and data warehousing.
- Experience working with AWS S3 for scalable storage solutions and OpenSearch for search functionality.
- Proficiency in developing and managing APIs using FastAPI.
- Experience using Trino for query optimization and distributed SQL processing.
- Proficiency in working with Parquet Files for efficient data storage and retrieval.
- Hands-on experience with Airflow for orchestrating complex data workflows.
- Familiarity with Databricks Medallion model.
- Familiarity with OpenMetaData for metadata management and data governance.
- Experience working with streaming and batch data processing frameworks is a plus.
- Due to US Government Contract Requirements, only US Citizens are eligible for this role.
Security Clearance:
- An active TS/SCI security clearance is REQUIRED
Benefits:
- National Health, vision and dental plans
- 20 days of PTO and 11 paid holidays
- Life Insurance
- Short - and long-term disability plans
- 401(K) retirement plans
- Incentive and recognition programs
- Relocation opportunities
Equal Opportunity Employer / Individuals with Disabilities / Protected Veterans
|