Morgan StanleyVice President_ Senior Data Engineer_TechnologyCompany ProfileMorgan Stanley is a leading global financial services firm providing a wide range of investment banking, securities, wealth management and investment management services. With offices in more than 41 countries, the Firm's employees serve clients worldwide including corporations, governments, institutions and individuals. For further information about Morgan Stanley, please visit www.morganstanley.com.TechnologyTechnology's mission is to ensure the Firm manages its global businesses and serves clients on a market-leading technology platform that is resilient, safe, efficient, smart, fast and flexible. We attract and nurture diverse talent to engineer innovative solutions in a complex and rapidly evolving world.Job ProfileCounterparty Data and Regulatory Technology (CDRT) team has commenced on several strategic initiatives to better our technology and data platform. As a senior data engineer in CDRT, you'll be part of an agile team dedicated to breaking the norm and pushing the limits of innovation. You will be involved in detailed technical design, development and implementation of applications using emerging technology platforms.Who You Are• Want to be part of cutting edge, high visibility projects and are motivated by delivering world-class solutions on an aggressive schedule• Someone who is not intimidated by challenges; thrives under pressure; is passionate about their craft and focused on delivering exceptional results• Enjoy learning new technologies and raise the bar on your team• Enjoy working with technical and non-technical stakeholders for delivery of software systems• Enjoy working with and managing junior developersWhat's the Role• Collaborating and leading part of a cross-functional Agile team to create and enhance software for data ingestion and entity resolution platform• Expertise in application, data and infrastructure architecture disciplines• Working with large, complex data sets from a variety of sources• Participate in the rapid development of user-driven prototypes to identify technical options and inform multiple architectural approaches• Building efficient storage and search functions over structured and unstructured data• Utilizing programming languages Python, Java, Scala, Relational and NoSQL databases• Learning newer technologies for entity resolution such as Quantexa platformPrimary Skills• Total 10 years and a minimum of 3 years in management, in a space with strong focus on large scale data processing and instrumentation.• Strong coding background, ideally in Java/ Python / Scala• Strong working knowledge of engineering best practices & big data ecosystem..• Experience in at least one big data product: Databricks, Elasticsearch, Snowflake• Experience building batch / real time data pipelines for production systems.• Experience with Relational and Non-Relational DBs like DB2, MongoDB• Experience with various data formats: Parquet, CSV, JSON, XML, Relational Data• Strong familiarity with Kafka, Spark, Hadoop, Iceberg, Airflow, Data Modeling, relational databases, columnar databases• Previous working experience in large scale distributed systems.• Strong familiarity with software engineering principles, including object-oriented and functional programming paradigms, design patterns, and code quality practices.• Excellent communication skills, with the ability to effectively collaborate with cross-functional teams and explain technical concepts to non-technical stakeholders.Good To haveSkillsDesired Qualifications• Experience with Rest based applications• Experience with Databricks/ Delta Lake• Experience with client reference data sourcing from vendorsMorgan Stanley is an equal opportunities employer. We work to provide a supportive and inclusive environment where all individuals can maximise their full potential. Our skilled and creative workforce is comprised of individuals drawn from a broad cross section of the global communities in which we operate and who reflect a variety of backgrounds, talents, perspectives and experiences. Our strong commitment to a culture of inclusion is evident through our constant focus on recruiting, developing and advancing individuals based on their skills and talents.
