Shanthi is available for hire
Hire ShanthiShanthi Viswanathan
Verified Expert in Engineering
Data Engineering Developer
Location
East Brunswick, NJ, United States
Toptal Member Since
June 24, 2020
Shanthi has over 20 years of experience developing applications using various technologies. As an architect, she has executed several web-based applications, integrations, data migrations, data conversions, and data warehousing projects with significant hands-on as well as leadership responsibilities. She keeps up-to-date with the latest technologies and can effectively match the business needs with those technologies.
Portfolio
Pfizer
Python, R, SQL, Redshift, Laboratory Information Management System (LIMS)...
World Health Partners
MySQL, MongoDB, Django, Python
Exelon
Apache Kafka, Hadoop, Python, Oracle Database, Informatica ETL...
Experience
Availability
Part-time
Preferred Environment
Node.js, React, R, Python, SQL, Linux, Neo4j, Oracle
The most amazing...
...project I've designed and coded determined the price of products based on sales promotions, order quantity, location, and customer status.
Work Experience
Data Engineer
2020 - PRESENT
Pfizer
- Technical architect in the development of ETLs to bring data from the Redshift data lake to project-specific Postgres and neo4j databases to represent complex relationships across different objects used for quality control.
- Built logic to provide for restart capability in case of failures during the load. Produced several data pipelines and improved the performance of these ETLs.
- Developed a data model to support the UI for capacity planning and schedule optimization in labs.
- Developed ETLs to forecast demand and inspection analysis from historical data.
Technologies: Python, R, SQL, Redshift, Laboratory Information Management System (LIMS), DataGrip, Oracle SQL Developer, Atom, Neo4j, Data Architecture, Data Modeling, Kubernetes, Splunk, Apache Airflow, Tableau, PostgreSQL, Amazon Web Services (AWS)
Technical Manager
2019 - 2019
World Health Partners
- Designed and developed a web application to be used in rural schools for capturing student performance using Python, Django, MySQL.
- Designed the data architecture to capture schools, courses, offerings, teachers and teacher/student evaluations.
- Planned the future phases and provided a road map for cloud deployments.
Technologies: MySQL, MongoDB, Django, Python
Data Integration Architect
2017 - 2019
Exelon
- Delivered integrations across several systems with the enterprise asset suite management system.
- Led a 15-member team of offshore and onsite developers in the delivery of all integrations, data migrations, and decommissioning of old systems.
- Migrated customers, products, and associated objects for over five million clients and 200,000 products using Informatica and Oracle Fusion middleware technologies.
- Used GitHub as a source repository and Maven and Jenkins for continuous deployment.
- Designed the data architecture for data migration and data cleansing of the home grown asset management systems.
- Designed data pipelines to move data from asset management system into data lake.
Technologies: Apache Kafka, Hadoop, Python, Oracle Database, Informatica ETL, Oracle Fusion Middleware
Enterprise Architect
2015 - 2017
Biogen
- Managed product and vendor selection, technical architecture, data conversion and migration, proof-of-concept, and design standards.
- Managed the LMS related data migration from SumTotal to SAP Success Factors. Delivered all integrations between the LMS and other systems.
- Managed the reporting framework to produce dashboards and customized reports by integrating data from several of Biogen's core systems. The architect for reporting solutions using Informatica, Spark, and Tableau.
- Loaded 23AndMe data into an inhouse MongoDB database and built data pipelines to map clinical results.
Technologies: Oracle Fusion Middleware, Tableau, MongoDB, R, Python
Architect
2014 - 2015
GE, Celgene, DirecTV
- Acted as the release captain responsible for the implementation of a heavily customized web-based Java application built on Oracle HR.
- Acted as the enterprise architect responsible for defining the roadmap for the integration of LifeShield operations with DirecTV using Oracle Fusion Middleware technologies.
- Defined the roadmap, implemented MDM, and consolidated integrations. Planned the roadmap for customer MDM at Celgene.
Technologies: Oracle Fusion Middleware, Master Data Management (MDM)
Architect
2011 - 2014
SelectComfort, CanonEurope, Panduit
- Acted as the solution architect responsible for delivering an integrated web experience to distributors and partners using Webcenter Suite, UCM, Oracle EBusiness modules (OM, AR), Heiler, and other client applications.
- Spearheaded the project as the enterprise architect to bridge the business needs with the technology necessary to meet the business goals for eCommerce, master data management, document management, and product pricing.
- Integrated the new eCommerce platform Hybris with existing back-end systems like Siebel, Oracle EBS, and SQL Server.
- Responsible for the design, development of data marts, data warehouse, and OBIEE reports at Canon Europe, as a BI architect.
Technologies: Oracle Fusion Middleware, eCommerce, ATG, SAP Hybris
Technical Manager
2007 - 2010
Accenture
- Contributed to the “SOA Go-to-Market” strategy team and worked closely with client partners, senior executives, and Oracle Sales to close-out deals.
- Executed several projects to Accenture clients using Oracle technologies.
- Developed the canonical model based on OAGIS standards by closely working with business architects and leads.
Technologies: Oracle Data Integrator (ODI), Service-oriented Architecture (SOA), Oracle Fusion Middleware, XQuery, Python
Technical Manager
1997 - 2007
Oracle
- Led the BI portal group by managing a team of ten consultants while being billable 100%. The team’s utilization was more than 90%. Actively involved in recruiting, training, resourcing, mentoring, and growing the team. Organized portal night classes and training and invited several key senior members to give talks.
- Implemented customer relationship modules (CRM) modules like iStore, iPayment, sales online, service contracts, XML gateway, and install base for clients like Canon, BMG, GE, and UBS.
- Managed onsite and offshore resources of up to 50 consultants on projects.
Technologies: Oracle Fusion Middleware, Oracle EBS, Java, Business Portals
Experience
Web Application to Capture Students' Performance
Architected a web-based application for World Health Partners (India chapter) to be used by rural schools to enter students’ performance on quizzes. I designed the database objects and APIs from scratch to be used in the web application built with Python and Django and deployed in AWS. I also developed core APIs using Python, MySQL, and MongoDB databases.
Asset Data Migration
The client had over six million customers in their CRM system and half a million assets in the GIS system. I was responsible for migrating these customers and assets one time into the new Asset Management System and plan for the syncing of updates between the two systems.
*Oversaw and ensured delivery of all aspects of data analysis, mapping, and transfer.
*Worked with program managers and business users to capture and analyze business requirements.
*Conducted Gap analysis and developed data migration and integration plans.
*Oversaw and ensured delivery of all aspects of data analysis, mapping, and transfer.
*Worked with program managers and business users to capture and analyze business requirements.
*Conducted Gap analysis and developed data migration and integration plans.
Error Reporting of Failed Integrations
The client had several integrations - real-time, batch, and near real-time. Integrations fail either due to hardware issues or software glitches. Many times it is hard for the source system to resend the data for failures. I built a semi-automated error handling framework to reprocess failed transactions wherever possible—built reports with a drill-down feature to get to the bottom of the erroneous transaction for root-cause analysis. I developed a web application using Python, XML, and PL/SQL.
Skills
Languages
SQL, Python, Python 3, JavaScript, XQuery, R, Java, Snowflake
Tools
Oracle JDeveloper 12c, Oracle ERP, Tableau, JDeveloper, SAP Hybris, Informatica ETL, DataGrip, Atom, Splunk, Apache Airflow
Platforms
Linux, Oracle, Unix, Windows, Oracle Database, Apache Kafka, Oracle Data Integrator (ODI), Kubernetes, Amazon Web Services (AWS)
Storage
PostgreSQL, MySQL, Neo4j, NoSQL, MongoDB, Master Data Management (MDM), Redshift, Oracle SQL Developer
Other
Data Architecture, Oracle Fusion Middleware, Data Modeling, ATG, eCommerce, Business Portals, Oracle EBS, Laboratory Information Management System (LIMS), Data Engineering
Frameworks
Express.js, Hadoop, Django, Ruby on Rails (RoR)
Libraries/APIs
React, Node.js, jQuery
Paradigms
Service-oriented Architecture (SOA)
Education
1987 - 1989
ICWA (Master’s Degree Equivalent) in Cost Accounting
Institute of Cost and Works Accountants of India - Kolkata, India
1982 - 1984
Master of Science Degree in Applied Math
Anna University - Chennai, India
1978 - 1982
Bachelor of Science Degree in Mathematics
Madras University - Chennai, India
Certifications
MAY 2020 - PRESENT
Google Cloud Platform Fundamentals: Core Infrastructure
Coursera
MAY 2020 - PRESENT
Google Cloud Platform Big Data and Machine Learning Fundamentals
Coursera
OCTOBER 2005 - PRESENT
Oracle Database Administrator
Oracle Corporation
Collaboration That Works
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
1
Share your needs
Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2
Choose your talent
Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3
Start your risk-free talent trial
Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.
Top talent is in high demand.
Start hiring