Sr Data Engineer
Full Time • Hybrid - US
Replies within 24 hours
Benefits:
- Hybrid
- Long Term
- Opportunity for advancement
Data Engineer
Location: Dallas, TX (Hybrid—3 days onsite)
Duration: Long-term Project | Interview: In-person
Location: Dallas, TX (Hybrid—3 days onsite)
Duration: Long-term Project | Interview: In-person
Join our growing data team working on exciting cloud migration and real-time data solutions. We’re looking for a hands-on Data Engineer who can build strong pipelines, work with cloud tools, and help us manage and process data at scale.
Roles and Responsibilities:
Migrate data from on-prem Teradata to AWS Redshift with zero data loss.
Build batch and real-time data pipelines using Python .
Set up and manage Kafka on AWS for streaming data.
Automate ETL workflows using AWS Glue and store data in S3.
Design data solutions in Redshift for fast querying.
Create reusable frameworks to reduce development time and improve code.
Build dashboards and reports for client data insights.
Use GitLab CI/CD for testing and deployments.
Work with AWS tools like Lambda, SQS, SNS, Glue, DynamoDB, OpenSearch, and more.
Develop tools to generate mock data (JSON, CSV, XML).
Deploy containerized apps using Kubernetes.
Follow best practices to ensure data security and compliance.
Build batch and real-time data pipelines using Python .
Set up and manage Kafka on AWS for streaming data.
Automate ETL workflows using AWS Glue and store data in S3.
Design data solutions in Redshift for fast querying.
Create reusable frameworks to reduce development time and improve code.
Build dashboards and reports for client data insights.
Use GitLab CI/CD for testing and deployments.
Work with AWS tools like Lambda, SQS, SNS, Glue, DynamoDB, OpenSearch, and more.
Develop tools to generate mock data (JSON, CSV, XML).
Deploy containerized apps using Kubernetes.
Follow best practices to ensure data security and compliance.
Qualifications:
Strong experience in Python and cloud technologies - AWS.
Good understanding of Kafka, ETL, and data warehouses.
Familiarity with CI/CD, boto3, and Kubernetes is a big plus.
Good understanding of Kafka, ETL, and data warehouses.
Familiarity with CI/CD, boto3, and Kubernetes is a big plus.
Flexible work from home options available.
Compensation: $55.00 - $60.00 per hour
About Us
We work to deliver profitability in your business – with effective communication, consulting, and interactive solutions. Following an Agile Work Approach, we make sure you get the ideal solutions at minimum expenses.
Work Approach
Our Philosophy
Our Philosophy starts-and-ends at the Client-first approach. Be it understanding your business requirements to choosing the right technologies, we work as a collective team that takes all the possible steps to grow continuously towards our common goal.
Our Philosophy starts-and-ends at the Client-first approach. Be it understanding your business requirements to choosing the right technologies, we work as a collective team that takes all the possible steps to grow continuously towards our common goal.
Work Policy
We promote a collaborative work environment. We involve everyone working in the organization in community decisions and encourage them to think from a broader perspective. Our work process promotes flexibility and we maintain a high level of discipline at different levels of execution.
The Future
SelectMinds have years of experience in the domain helps us understand the need-of-the-hour better. This understanding drives us to a better future with every minute ticking. We believe we will be taking off major businesses from their flagship positions, with the products we are eyeing today.
(if you already have a resume on Indeed)