ETL Developer
Job Description
Job Description:
Responsibilities:
• Support the branch in developing and implementing the technical solutions needed as well as providing operational support ensuring that any technical glitch can be quickly addressed
• Support the branch in data migration and data integration
• Design technical solutions for data collecting and storing into our centralized data repository
• Develop detailed application programming specifications, Extract, Transform and Load (ETL) scripts, design data-driven logic and conducting unit tests
• Develop, test and implement the required technical solutions as well as ensure that the requirements in terms of data accuracy, quality are met
• Produce design artifacts and documentation which will allow future support of the implemented solutions
• Support the enhancement to extend the current automatic ETL process for other data source from Contact+ (online tool for citizens to provide contact details), the Ontario Laboratory Information System (OLIS), Integrated Public Health Information System (iPHIS), iPHIS Cognos Reporting Network (CRN), the Provincial Client Registry (PCR) and Enterprise Master Patient Index (EMPI) service
• Develop coding, testing, and debugging to support centralization and standardization of data entry to achieve expediated public health case and contact initiation along with reporting and timely analytics
• Provide subject matter expertise to develop, test, support and maintain reports and transform and present data to support analytics
• Provide and support Case and Contact Management (CCM) solution to enable self-service reports which is a critical functionality for PHUs and other stakeholders
• Provide Business intelligence and data analytics, data warehouse design, dimensional data modeling, relational data modeling development and support
• Work to improve data transformation and reporting from the provincial CCM system
• Support Cognos administration and package creation
• Conduct research and assessment of options for technical design issues
• Contribute to design/development project plans, including work breakdown and resources estimates
• Provide Cognos report design, development and testing, Framework manager, Query Studio, Reports Studio, creation of dashboards, etc.
• Conduct technical analysis, preparation of detailed programming specifications, program design, writing and/or generating code, and conduct unit tests
• Translate technical specifications for integration/sustainment and upgrade into working, tested application code
• Undertake proof of technology with test data to simulate application load and performance tuning related applications
• Provide software expertise in various computing platforms, operating systems, database technology, communication protocols, middleware and gateways
• Provide impact analysis, effort estimate and solution design/development for the centralization and standardization of data entry across systems
• Provide technical expertise and advice for the integration of the provincial Immunization Repository and the CCM solution
• Participate in the planning, technical analysis and design of solutions in support of infectious disease public health activities, including infectious disease case, contact, and outbreak investigation and management, immunization administration, and vaccine distribution and delivery (inventory)
• Conduct technical analysis, troubleshooting, and issue resolutions for production operational support of CCM reports and business models and other components and utilities
• Provide end users support for their user-defined reports if required
• Resolving and implementing critical fixes and changes in CCM tools and utilities as per defects found by business and as per critical changes
• Provide application programming support for incident management, application functionality sustainment, performance tuning and technical documentation
• Work with Quality Assurance (QA) to code, test, and debug extensions/tools integration services
• Perform performance tuning as well as audit and ad hoc reporting per business requests
• Call Provide software expertise in various computing platforms, operating systems, database technology, communication protocols, middleware and gateways
• Maintain Development environments and continue continuous Integration (CI) practice
• Improve the quality and accuracy of the data collected for the approximately 34 PHUs and 2282 PHU users
• Ensure availability of the Covid-19 tools and CCM solution for use by all Ontarians.
Experience and Skill Set Requirements
Public Sector Experience – 5 points
• Experience working with federal/provincial/broader public-sector healthcare providers
• Knowledge of the provincial immunization system and OPS large complex IT Health related projects or equivalent
• Experience with integration of Clinical IT Systems such as Client and Provider Registries
• Knowledge of OPS Enterprise Architecture artifacts (or similar), processes and practices, and ability to produce technical documentation that comply with industry standard practices
• Knowledge of industry standard such as Project Management Institute (PMI)
• Experience adopting and adhering to OPS Unified I&IT Project Methodology, OPS Enterprise Architecture and OPS Gating process, and OPS Standard Systems Development Methodologies.
Technical Skills – 50 points
• 10+ years of experience with:
• Data warehousing design and development with focus on extracting, transforming data coming from various data sources and loading into star/snowflake schemas
• Design, build, automate and optimize complex data ETL/ELT processes using Informatica and equivalent
• Experience with data migration and data integration
• Experience with Mulesoft, Salesforce bulk load API is an asset
• Informatica transformations, mappings and workflows (experience with other ETL tools such as DataStage, ODI or Microsoft SSIS could also be considered)
• Relational databases (Oracle, MS-SQL), data modelling (relational & dimensional), advanced SQL, query optimization, data replication, administration
• Scripting languages (Python, Unix shell)
• Cloud technologies (Azure, Google, AWS)
• Big data (Hadoop, Spark, Hive)
• Data analytics/machine learning (integrate AI algorithms in data processing pipelines for detecting anomalies, fraud or any other kind of outliers)
• BI/Reporting (Cognos, SSRS) and Data Visualization tools (Power BI, Tableau)
• Knowledge and experience with NODE.JS and Python
• Knowledge and experience with the following Amazon Web Services (AWS) technologies – Amazon Connect, Amazon Pinpoint, Amazon DynamoDB, Amazon Kenisis Datastreams, Amazon S3, Amazon Polly, AWS Lamda and Amazon Cloudwatch
• Cognos 11.x report design, development and testing, Framework manager, Query Studio, Reports Studio, creation of dashboards, map/location etc.
• Cognos AODA compliance
• Cognos administration and package creation
• Other Reporting tools, particularly Crystal Reports and Business Objects and PowerBI would be an asset
• Business intelligence and data analytics, data warehouse design, modeling, development and support
• Informatica for data extraction, transformation, and loading, initial setup and other ETL experience management and support, such as troubleshooting, performance tuning, failover and recovery
• Oracle RDBMs(19c), SQL, PL/SQL, JSON, XML, Unix/Linux shell scripting, optimized database queries, data architecture, data design, modeling and mapping
• Database and Cognos performance turning, Automation
• Experience with version control system SVN or GitLab
• Working knowledge of issue tracking sysem Jira
• Enhanced CI/CD experience and DevOps methodologies and technologies an asset
• Develop and support application monitoring using Elastic/Logstash/Kibana or Sematext
• Knowledge of Java, JSON, XML, API calls, HL7/FHIR, Node JS,Python, Restful web services.
Core Skills and Experience – 35 points
10+ years of experience with:
• Technical analysis, program code, detailed programming and reports specifications, program design, writing and /or generating code, and conducting unit tests
• Software in various computing platforms, operating systems, database technology, communication protocols, middleware and gateways
• Developing and maintaining system design models, technical documentation and specifications
• Conducting technical evaluation and assessment of options for technical design issues, application figuration aspects and integration capabilities, related tools and utilities, gap analysis of integration components to technical requirements / specifications / documentation
• Provide Business intelligence and data analytics, data warehouse design, dimensional data modeling, relational data modeling development and support
• Support Cognos administration and package creation
• Conduct research and assessment of options for technical design issues
• Contributing to design/development project plans, including work breakdown and resources estimates
• Maintaining development environments and continue continuous Integration (CI) practice
• Working with business analysts to translate the business requirements and functional specifications into an application design appropriate to meet the business and operational/IT needs
• Working with technical systems specifications and translating them into working, tested applications for large, complex, mission critical applications
• Work with Quality Assurance (QA) to code, test, and debug extensions/tools integration services
• Analysis, design and development work on complex, multi-tier web-based applications, micro-services architecture, mobile, and off-the-shelf solutions
• Proven technical leadership skills with ability to identify areas for improvement, and recommend solutions
• Designing, developing and implementing applications that work across modern browsers and various platforms, and mobile devices
• Maintaining development environments and adopt continuous Integration (CI) practice
• Providing impact analysis, effort estimate and solution design/development for solution/software upgrades or based on any new business requirements
• Undertaking proof of technology with test data to simulate application load and performance tuning related applications
• Providing software expertise in various computing platforms, operating systems, database technology, communication protocols, middleware and gateways
• Providing application programming support for incident management, application functionality sustainment, performance tuning and technical documentation
• Developing and maintaining system design models, technical documentation and specifications
• Developing medical and clinical based systems
• Web performance optimization
• Various computing platforms, operating systems, database technology, communication protocols, middleware and gateways
• Conducting technical analysis, trouble-shooting, and issue resolutions for production operational support of reports, and other components and utilities
• Knowledge of recognized accessibility laws, regulations, and standards (e.g., W3C, WCAG) or other specific accessibility standards, and experience in usability, accessibility and compliance testing
• Ensuring compliance with architecture framework and system standards, and Agile Development Methodology
• Project management practices, and ability to contribute to design/development project plans, including work breakdown, resource estimates, and status reports
• Software Development Lifecycle (SDLC) end-to-end Agile/scrum and Waterfall methodologies
• Continuous Integration (CI) practice and enhanced Ci/CD experience and DevOps methodologies and technologies an asset
• Knowledge and experience with leading-edge technologies, design criteria including usability, security, and privacy for web and mobile applications.
General Skills – 10 points
• Demonstrated strong leadership and people management skills
• Exceptional analytical, problem solving and decision-making skills
• Demonstrated strong interpersonal, verbal and written communication, and presentation skills
• Proven troubleshooting and critical thinking experience
• Demonstrated ability to apply strong listening skills to facilitate issue resolution
• Effective consulting skills to engage with all stakeholders with proven track record for building strong working relationships
• Excellent customer service skills, including tact and diplomacy to ensure client needs are managed effectively
• A motivated, flexible, detail-oriented and creative team player with perseverance, excellent organization and multi-tasking abilities, and a proven track record for meeting strict deadlines.
MUST HAVES:
10+ years of experience with:
• Data warehousing design and development with focus on extracting, transforming data coming from various data sources and loading into star/snowflake schemas
• Design, build, automate and optimize complex data ETL/ELT processes using Informatica and equivalent
• Experience with data migration and data integration
• Experience with Mulesoft, Salesforce bulk load API is an asset
• Informatica transformations, mappings and workflows (experience with other ETL tools such as DataStage, ODI or Microsoft SSIS could also be considered)
• Relational databases (Oracle, MS-SQL), data modelling (relational & dimensional), advanced SQL, query optimization, data replication, administration
