Experience
The purpose of life is to live it, to taste experience to the utmost, to reach out eagerly and without fear for newer and richer experience.
Data Engineering – Data engineering solution designing in Big data ecosystem & product development for global businesses while delivering tangible business results reflecting multiple data auditability, controls in data management lifecycle
Building a Databricks cloud optimized solution for providing enterprise data solution via implementing data management Strategy. Shell Scripting, Python, Databricks.
- Developing an end-to-end solution utilizing scalable and high-performance predictive analytics/machine learning algorithms to build models for tracking fraudulent accounts and transactions in financial institutions.
- Part of the fincrime (Fraud and Surveillance) data science team team to develop solutions for Anti-money laundering and financial crimes.
- Cloud migration is required from existing on-premise big data platform: Shell Scripting, Python, AWS EMR, Hadoop, Hive, AWS Glue, Apache Spark, Spark SQL, RDD’s, Hadoop, Sqoop, Map Reduce.
Provided Free lancing and trainings in Big data -Hadoop, Hive and also delivered product using Databricks,PySpark,Azure and AWS
Octopus -Task Orchestration and ETL tool- Build an in-house tool as part of replacement of Informatica in order to save the cost of Informatica. Myself alone build the entire tool for ETL processing and also providing the task orchestration feature. The tool was build using python - pandas framework and Oracle/PLSQL. Similar to Airflow, Luigi..
