Lead Data Engineer
3Pillar Global
Job Description
<div>3Pillar is an AI transformation partner on a mission to help enterprises build the AI-native products and intelligent agents that will define the next era of business. With teams across North America, Europe, Latin America, and Asia, we work with the most ambitious companies in financial services, healthcare, media, and technology — helping them move faster, modernize boldly, and compete on their own terms. Our HelixAI platform and Helix Pods delivery model put our engineers at the center of real agentic transformation — doing work that is open, portable, and built to last. We are building the future of enterprise AI.</div><h3>Key Responsibilities:</h3><ul><div><li><h3>Understanding the business requirements</h3></li><li><p>Writing code and implementing the proposed solutions</p></li><li><p>Creating data pipelines, versioning and change management</p></li><li><p>Manage the complexity inherent in versioned data pipelines</p></li><li><p>Develop ETL/ELT processes to help extract and manipulate data from multiple sources.</p></li><li><p>Design, build and maintain batch or real-time data pipelines in production.</p></li><li><p>Automate data workflows such as data ingestion, aggregation, and ETL processing.</p></li><li><p>Logging and instrumentation of pipelines and services.</p></li><li><p>Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.</p></li><li><h3>Train and mentor junior engineers.</h3></li></div></ul><h3>Job Description: Data Engineer </h3><ul><div><li><strong>NoSQL-to-RDBMS Mapping:</strong> Flatten and normalize complex, nested JSON data from MongoDB into structured relational tables.</li><li><strong>Pipeline Development:</strong> Build and manage reliable ETL pipelines to ingest data from MongoDB, process it via Snowflake, and load it into MySQL.</li><li><strong>Database Optimization:</strong> Design, index, and tune target MySQL databases to ensure high performance and strict data integrity.</li><li><strong>Snowflake Utilization:</strong> Leverage Snowflake's variant handling capabilities to efficiently stage, parse, and transform semi-structured data.</li><li><strong>Technical Stack:</strong> Proficiency in MongoDB, MySQL, Snowflake SQL, good to have Python (including ETL frameworks like rivery or informatica).</li></div></ul><h3>What is it like working for <a href="https://himalayas.app/companies/3pillar-global">3Pillar Global</a>?</h3><ul><div><p style="margin-top: 0pt; margin-bottom: 10pt;">At 3Pillar, we offer a world of opportunity:</p><ul style="margin-top: 0px; margin-bottom: 0px; padding-inline-start: 48px;"><li style="font-size: 12pt; font-family: Roboto, sans-serif;"><p style="margin-top: 0pt; margin-bottom: 5pt;">Imagine a <em>flexible work environment </em>– whether it's the office, your home, or a blend of both. From interviews to onboarding, we embody a remote-first approach. </p></li><li style="font-size: 12pt; font-family: Roboto, sans-serif;"><p style="margin-top:
Language Requirements