Senior Data Integration Engineer

Senior Data Integration Engineer
Company:

Ibm Careers


Details of the offer

Who We Are:We're looking for software development candidates that want to turn ideas into reality, with a focus on innovation and development of new technology. Our strategic Product Development team creates and delivers exciting database features that impact the business. You'll work alongside global and local multidisciplinary teams of Developers, Architects, Engineers and Analysts focused on the next generation of solutions.Do you enjoy working and thrive in a challenging yet collaborative team environment? If so, you'll fit right in with our team. You employ creative thinking and collaboration as the foundation of your daily approach. Ideally, you'll possess relational database knowledge (including SQL) and experience across multiple operating systems (Linux, Unix, and Windows). Passionate about technology and software, you have extremely strong analytical, problem-solving and troubleshooting skills.Responsibilities:Lead the development of advanced tools for casting and converting data from Delta Lake to Apache Iceberg manifests, ensuring robust data integrity throughout the transformation process.Drive metadata migration, copy, or synchronization strategies across diverse platforms, orchestrating seamless schema transitions to support comprehensive data interoperability.Architect and develop migration tools to facilitate efficient data movement into Iceberg buckets, enabling flexible integration with multiple platforms and systems.Engineer solutions to optimize data handling and storage methodologies, addressing performance gaps, and improving overall system efficiency.Spearhead the implementation and support of Python-based User-Defined Functions (UDFs) within a micro-service architecture, ensuring versatility and scalability across environments.Design and implement client interfaces, leveraging technologies like Arrow Flight, to cater to varied BI use cases and tools, ensuring optimal performance and features.Provide expert guidance on data integration and ETL methodologies, overseeing and contributing to complex data transformation processes.Establish and enforce warehouse and lakehouse operational best practices, ensuring adherence to industry standards and compliance requirements.Act as a subject matter expert, advising on diverse BI use cases and providing strategic guidance for project requirements.We strive to continue to make IBM Data & AI a place where you want to be – Inclusive. Creative. Collaborative. This fosters a culture where you are motivated to produce the best results possible...We're hiring…..JOIN US.


Source: Brassring

Requirements

Senior Data Integration Engineer
Company:

Ibm Careers


Bpo Team Lead

Roles & Responsibilities of this position are:•Supervises team ensuring highest quality of service is provided to clients.•Monitors performance of team and r...


From Nttdata - Tamil Nadu

Published a month ago

Package Consultant: Sap Fin Co

As a developer at IBM, you'll work with clients to co-create solutions to major real-world challenges by using best practice technologies, tools, techniques,...


From Ibm Careers - Tamil Nadu

Published a month ago

Technical Consultant: Risk & Compliance

Experience in Internal Control, General Computer and Application Control Audit background.Knowledge and experience in various Information security standards ...


From Ibm Careers - Tamil Nadu

Published a month ago

Java Developer

Responsible for designing and developing Java components using Spring framework to implement transaction managementManage Java objects and enterprise integra...


From Ibm Careers - Tamil Nadu

Published a month ago

Built at: 2024-05-21T00:32:02.092Z