Sr. Data Engineer

Genesis10
life insurance, 401(k)
United States, California, San Francisco
Dec 13, 2024
Genesis10 is seeking a Sr. Data Engineer for a 12 month contract position with our client. This position can be remote or hybrid with 2 days per week in the San Francisco, CA office location. Summary: Looking for an experienced Data Engineer to support the execution of complex data development and database efficiency, with a deep focus on improving the data quality, accuracy and timeliness for marketing related products. This role will interact directly with Engineering teams to optimize data operations for product metrics to surface insights at terabyte scale, globally. As our data and business needs increase, we continue to iterate and evolve our processes, best-practice documentation, and deep-dive retrospectives to inform our go/no go decision making. Ultimately to be successful, the individual should feel comfortable advising a team of data professionals, navigating our tech stack, and recommending solutions to complex data problems. Our team is highly collaborative, open and honest, and brings a low-ego, high impact mindset to work! Responsibilities: Design, develop, and manage data pipelines and workflows to enable efficient and accurate data processing using Trino SQL/Spark SQL warehoused in HDFS datasets. Effectively performs code designs and reviews/approves test cases. Implement data quality checks and audits to maintain high data accuracy and integrity. Produces elegant and efficient designs, high performance, and scalable code that allows for easy extension to future needs. Collaborate with cross-functional teams, especially data engineering, to understand data requirements and implement robust data solutions. Work closely with data domain experts to gather data requirements, translate business needs into technical specifications, and communicate data insights effectively for sales representative workflow efficiency. Optimize data storage for performance and scalability, ensuring efficient data Extraction, Transformation and Load (ETL). Develop and maintain documentation related to data pipelines, QA, metrics, and data policy as it relates to best practice, compliance and GDPR. Stay up to date with industry best practices and emerging trends in data engineering and analytics, including Generative AI as it impacts our data operations. Qualifications: 2+ years in using SQL and experience optimizing SQL databases for performance (Trino SQL, or Spark). Demonstrated experience in managing data pipelines (like HDFS), data repository (like GitHub), workflows (like Apache Airflow), and ETL (best practice coding). Ability to communicate complex technical concepts to both technical and non-technical individuals. Experience working with multiple stakeholders, setting project priorities and delivering on Objectives and Key Results (OKRs). Experience automating script changes in Python Only candidates available and ready to work directly as Genesis10 employees will be considered for this position. Preferred Qualifications: BA/BS in engineering, computer science, or related technical field (such as statistics, or data science). Excellent analytical skills, designing data workflows and analyzing data for anomalies, or setting data quality thresholds via automated solutions. Familiarity with data governance principles Program Manager experience Demonstrated experience in managing data pipelines in HDFS Experience running a scrum team and using Jira. Spark SQL Suggested Skills: Data Analysis Project Management Data Engineering The hourly pay rate range for this position is $82.50 - $115.38 depending on experience If you have the described qualifications and are interested in this exciting opportunity, apply today! Genesis10 Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals. For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10: Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years. The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years. Access to an experienced, caring recruiting team (more than 7 years of experience, on average.) Behavioral Health Platform Medical, Dental, Vision Health Savings Account Voluntary Hospital Indemnity (Critical Illness & Accident) Voluntary Term Life Insurance 401K Sick Pay (for applicable states/municipalities) Commuter Benefits (Dallas, NYC, SF) Remote opportunities available For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all our available career opportunities, please visit us at our website. Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.