Data Engineer
TITLE: Data Engineer
LOCATION: Atlanta, GA or Birmingham, AL (hybrid, on-site 4 days/week)
Responsibilities:
- Design, build, and maintain data pipelines to collect, clean, and process data from various sources using Microsoft Analytics Tool stack on-prem and Azure Cloud.
- Ensure data is stored efficiently in data lakes and warehouses for easy access and retrieval.
- Integrate data from multiple systems, applications, and external sources, harmonizing data formats for analysis.
- Create and manage databases, optimizing them for performance, security, and scalability, handling structured and unstructured data.
- Monitor and ensure the accuracy, consistency, and reliability of data, implementing processes for validation, cleansing, and enrichment.
- Optimize queries and databases for faster performance and troubleshoot database performance issues.
- Collaborate with data scientists, analysts, and stakeholders to understand data needs and prepare data for analysis, machine learning, and reporting.
- Implement ETL/ELT processes for data extraction, transformation, and loading, understanding when to apply each approach.
- Automate repetitive data processing and integration tasks, setting up monitoring for data quality, pipeline performance, and system health.
- Ensure data security measures are in place to protect sensitive information and adhere to relevant data privacy regulations and compliance standards.
- Evaluate and implement new tools, frameworks, and technologies to improve data infrastructure, keeping up with industry trends.
Requirements:
- Experience designing, developing, and maintaining data infrastructure within a data analytics team.
- Familiarity with Microsoft Azure cloud services such as Data Lake, Lake House, and Azure Fabric.
- Proficiency in programming languages like SQL, Python, or Java.
- Experience working with both batch and real-time data processing frameworks like Apache Spark, Databricks, Kafka, or Flink.
- Knowledge of data warehousing platforms such as MS SQL Server, Oracle, Redshift, or BigQuery.
- Understanding of data security, privacy regulations, and implementing access controls.
- Experience with data orchestration tools like Apache Airflow.
- Skills in optimizing query and database performance as well as troubleshooting system issues.
- Knowledge of big data technologies, data lakes, and data pipeline construction.
- Strong collaboration and communication skills, capable of working with cross-functional teams.
- Continuous learning mindset to stay current with emerging data engineering tools and technologies.
- Experience with automation tools such as Jenkins, Docker, Kubernetes, and infrastructure as code tools like Terraform or ARM.
The compensation range for this position is $105,000.00 to $126,000.00 (dependent on factors including but not limited to client requirements, experience, statutory considerations, and location). Benefits available to full-time employees: medical, dental, vision, disability, life insurance, 401k and commuter benefits.
Synergis is proud to be an Equal Opportunity Employer. We value diversity and do not discriminate on the basis of race, color, ethnicity, national origin, religion, age, gender, gender identity, political affiliation, sexual orientation, marital status, disability, military/veteran status, or any other status protected by applicable law.
Qualified applicants with arrest or conviction records will be considered for employment in accordance with the requirements of applicable state and local laws, including but not limited to, the San Francisco Fair Chance Ordinance, the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act.
For immediate consideration, please forward your resume to Applications@Synergishr.com.
If you require assistance or an accommodation in the application or employment process, please contact us at Applications@Synergishr.com.
Synergis is a workforce solutions partner serving thousands of businesses and job seekers nationwide. Our digital world has accelerated the need for businesses to build IT ecosystems that enable growth and innovation along with enhancing the Total Experience (TX). Synergis partners with our clients at the intersection of talent and transformation to scale their balanced teams of tech, digital and creative professionals. Learn more about Synergis at www.synergishr.com.