Data Engineer, Ot Dmz IT
Worldwide | Sept. 1, 2026
Report as Closed
Company: 2BRAINS
Country: Worldwide
Type: Remote
Employment: Full-time
Description: We integrate strategy, design, and technology to empower companies and tech disruptors. With a team of more than 250 professionals, we stand out as leaders in digital innovation, creating adaptable technology platforms and digital products
2Brains is a technology consulting firm that drives the growth and evolution of leading organizations in Latin America. We design and build our clients’ digital future through a deep and strategic integration of business, experience, and technology, turning complex challenges into real impact.
Today, 2Brains is part of Acid Labs, one of the region’s leading tech and innovation consulting groups. This acquisition strengthens our value proposition by expanding our scale, technological capabilities, and regional presence, and enables us to support our clients with more robust, agile, and high-impact solutions throughout their transformation journey.
Programming Languages and Data Processing
Advanced Python and SQL
Large-scale distributed processing with Apache Spark and PySpark
Databricks & Lakehouse Architecture
Medallion Pattern (Bronze / Silver / Gold)
Workflows, Delta Lake, Databricks Asset Bundles (DABs), Unity Catalog Autoloader (data governance), and Delta Live Tables (DLT)
Azure Ecosystem
Azure Data Factory (ADF) — ETL/ELT pipeline orchestration
Azure Data Lake Storage Gen2 (ADLS Gen2)
Azure Key Vault — secret management
Azure DevOps / Git — CI/CD and version control
Networking and integration skills
Secure connectivity between network domains (OT, DMZ, IT)
Basic understanding of industrial cybersecurity, permissions, and access
🎓 Academic Background
Professional degree: Civil Engineer with a specialization in Computer Science, Information Technology, or a related field.
🎯 The Challenge
This role is essential to ensuring the success of OT-DMZ-IT systems integration projects. The successful candidate will be responsible for designing, optimizing, and scaling the extraction, flow, and routing of data from industrial environments (OT/FMS). Their primary objective will be to securely and efficiently connect the plant layer to the corporate Data Lake, leveraging the capabilities of the Azure- and Databricks-based technology stack to ensure the availability, quality, and governance of real-time and historical data.
🛠️ Day-to-Day Responsibilities
Data pipelines: Design, build, and optimize ingestion and orchestration flows in the cloud (ADF / Databricks) from industrial systems to the Data Lake. Integration of new sources: Incorporate new data sources into the corporate Lakehouse, evaluating connectivity and cybersecurity constraints between OT, DMZ, and IT. Data transformation: Build data cleansing and bulk processing logic using PySpark, Spark SQL, Delta Lake, and DLT. Data quality: Audit, monitor, and ensure data consistency throughout the entire solution. Governance and security: Apply access control policies (Unity Catalog) and manage credentials (Azure Key Vault). Optimization: Fine-tune queries and resource consumption in clusters and relational/non-relational databases. CI/CD: Version control (Git/GitHub) and implement continuous deployment with Azure DevOps and DABs. Risk management: Identify and mitigate risks that affect ingestion continuity, documenting the handoff to Business Continuity.
🎓 Academic Background
Desirable (but not required) Certifications
- Microsoft Certified: Azure Data Engineer Associate (or equivalent in the Azure ecosystem)
- Databricks Certified Data Engineer (Associate or Professional)
- Courses or certificate programs in Big Data, Distributed Computing, Data Architecture, or Cloud Governance
Apply here:
Web:
Apply here
Emails: