SD

Shwetang Dhingra

Lead Big Data Engineer at TMX Group

Shwetang Dhingra has a diverse work experience in the field of data engineering. Shwetang began their career as an ETL Developer at Capital One from 2013 to 2015, where they extensively worked on Facts and Slowly Changing Dimension (SCD) tables.

Afterwards, they joined NTT DATA as a Hadoop Developer from 2016 to 2018. In this role, they developed Spark applications using Scala/Python and implemented Apache Spark data processing projects. Shwetang also worked with Hive and performed data analysis, cleansing, and query optimization.

From 2018 to 2019, Shwetang worked as a Big Data Engineer at Tech Mahindra, focused on projects related to ad clicks analysis, customer reporting tools, and media consumer analysis. Shwetang utilized the Hortonworks based Hadoop platform, Spark-Scala, Pyspark, and Hive for data processing.

In 2019, Shwetang worked at Rogers Communications as a Big Data/Cloud Engineer. Their responsibilities included designing and implementing end-to-end data solutions in Azure, architecting ETL and data movement solutions using Azure Data Factory, and building data processing pipelines for large-scale data ingestion and transformation.

Shwetang then joined Manulife Investment Management in 2020 as a Data Engineer.

Currently, Shwetang is working as a Lead Big Data Engineer at TMX Group, starting in 2023. Their previous role at TMX Group was as a Big Data Engineer, where they worked from 2020 to 2023.

Overall, Shwetang has gained experience in various aspects of data engineering, including ETL development, Hadoop, Spark, Hive, and cloud technologies like Azure.

Shwetang Dhingra obtained a Bachelor's degree in Mechanical Engineering from Gujarat University, which they attended from 2006 to 2010.

Links

Previous companies

Rogers Communications logo
Tech Mahindra logo
Capital One logo

Timeline

  • Lead Big Data Engineer

    February, 2023 - present

  • Big Data Engineer

    June, 2020