Data Engineer
Mindtech is your gateway to exciting and impactful tech projects. We specialize in end-to-end software outsourcing, linking Latin American talent with global opportunities. Our fast, cost-effective approach ensures that our clients receive exceptional service and innovative solutions. With a diverse team of over 70 skilled professionals across Latin America and the US, we are committed to delivering software that drives success.
Position Overview:
As a Data Engineer, your role is crucial in shaping our data infrastructure and analytics capabilities.
Key Responsibilities:
● Design and develop scalable data pipelines, ensuring they support the processing of large datasets efficiently.
● Integrate advanced analytics and machine learning models into our systems, leveraging your experience with Apache Spark for big data processing and analytics to derive insights and improve decision-making processes.
● Enhance our data governance and security measures, applying best practices to ensure compliance and protect sensitive information.
● Work closely with cross-functional teams, including data scientists and business stakeholders, to understand requirements and deliver high-impact data solutions.
● Deploy and manage robust data infrastructure, utilizing technologies like Kubernetes for orchestration, and ensuring high availability and performance of our data systems
Desired Skills & Qualifications:
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
● At least 2 years of relevant experience in data engineering, with a strong portfolio of designing and implementing data solutions.
● Deep expertise in big data technologies (Apache Spark, DBT), cloud platforms (AWS, Azure, GCP), and data development in data lake/delta lake architectures.
● Proficiency in programming languages (Python, Java, Scala), SQL, and infrastructure as code technologies (Terraform, Helm charts for Kubernetes).
● Expert knowledge of Kubernetes, object storages (S3, Azure Data Lake Store, MinIO), and data modelling (dimensional model - OLAP, data semantic layers).
● Strong problem-solving skills, excellent communication abilities, and the capacity to thrive in a fast-paced environment.