Shivam P.

Data Engineer at BackboneAI

Shivam P. has worked in various positions in the field of data engineering and development. In 2020, they began working as a Data Engineer for Xogito Group, Inc., where they ingested unstructured data from disparate data sources using a combination of SQL, raw file formats, websites, and Python to create transformed data for further analysis. Shivam also created a generic Python script that reduced men hours by 40%. From 2019-2020, Shivam was self-employed as a Data Engineer, where they developed automation bots to fetch and download data from different sources, used Python, SQL, Spark, Sqoop, S3 Bucket and Redshift to create a cloud-first data ingestion that improved processing speed of data by 60%, and ingested unstructured data from disparate data sources. In 2020, Shivam also worked as a Data Engineer for BackboneAI, where they transformed semi-structured and unstructured data coming from different sources and made it useful for analysis, research, and business. From 2018-2019, Shivam worked as a Python Developer for Head Field Solutions Pvt. Ltd., where they developed a web parsing tool to find affiliated links on any social media, search engines, and developed API on top of it to run different crawlers concurrently. Shivam also designed an architecture for a scrapping engine to extract data from multiple websites for an in-house project and developed a keyword-specific model to fetch information from different social media platforms. Additionally, Shivam worked as a Data Analyst for Aam Admi Party in 2018, where they developed election and political campaign strategies, worked on electors data to create insight and develop refined strategies, and used Python along with web scraping techniques to extract data from websites and PDF files. Lastly, in 2016, Shivam worked as a Management Trainee for OgreLogic, where they built websites with different platforms, used HTML and CSS to design the layouts of websites and applications, and co-ordinated with system partners to finalize design and customer requirements.

Shivam P. completed a Bachelor of Technology in Electrical, Electronics and Communications Engineering from Manav Rachna International Institute of Research & Studies in 2016. Shivam also obtained a Post Graduate Diploma in Industrial Automation from Prolific Systems & Technologies Pvt Ltd in 2016. In 2018, they obtained a Post Graduate Program in Data Analysis from Imarticus Learning, an Intermediate Python for Data Science Course from DataCamp, a Deep Learning in Python course from DataCamp, and IBM SPSS MODELER PROFESSIONAL V3 from IBM. In 2021, Shivam P. started a Master of Science in Data Science (Data Engineering) at Liverpool John Moores University. In 2022, they obtained a SQL for Data Science course from Udemy.

Links


Org chart

No direct reports

Timeline

  • Data Engineer

    March, 2020 - present