We are an IT consulting firm with experts in various areas of technology.
At BC Tecnología, we manage portfolios, develop projects, and offer outsourcing and recruitment services to clients in sectors such as financial services, insurance, retail, and government. You will participate in strategic digital transformation initiatives for LATAM Airlines, a leading organization in the aviation industry, in an environment that combines remote work with occasional in-office presence. You will be part of the Architecture Management team, collaborating on defining the enterprise architecture and its evolution in response to technological and business changes, ensuring alignment with corporate strategy and governance standards.
- At least 4 years of professional experience.
- Experience as a Data Engineer or Big Data Engineer.
- Proficiency in Python and advanced SQL.
- Experience with Apache Spark / PySpark.
- Experience building ETL/ELT pipelines.
- Experience with Data Lake / Lakehouse architectures.
- Experience working with AWS and/or Azure.
Technologies
AWS: S3, Glue, Athena, Redshift, Lambda, Step Functions, Kinesis/MSK, CloudWatch, IAM.
Azure: ADLS, Data Factory, Synapse Analytics, Databricks, Azure Functions, Event Hub, Azure Monitor.
Data Engineering: Spark, PySpark, Kafka, Kinesis, Event Hub, Parquet, JSON, Avro.
DataOps / DevOps: Git, CI/CD, Azure DevOps, GitHub Actions, Terraform, Docker, and Kubernetes.
Data Governance: Data Catalog, Data Lineage, Data Quality, Glue Catalog, and Microsoft Purview.
We are looking for a Data Engineer | Big Data & Cloud. Are you passionate about data engineering, Big Data, and cloud architectures? We’re looking for a Data Engineer to join a 100% remote technology project, participating in the design, development, and improvement of data solutions on AWS and Azure environments.
What will your challenge be?
You’ll participate in the design and development of Big Data solutions, the building of ETL/ELT pipelines, and the evolution of Data Lake/Lakehouse architectures, ensuring data availability, quality, security, and governance.
Key Responsibilities
- Design, develop, and maintain ETL/ELT pipelines.
- Process large volumes of data using Apache Spark / PySpark.
- Design and maintain Data Lake / Lakehouse architectures.
- Perform data modeling and transformation.
- Participate in initiatives related to data governance, quality, cataloging, and lineage.
- Analyze and propose improvements to processes, systems, and technologies.
- Perform testing, troubleshooting, and apply fixes.
- Participate in DataOps/DevOps initiatives.
- Work with AWS and Azure cloud services.
Get notified when I release new stuff! ->
Follow @branzel