Note: Not all unique aspects of the job are covered by this job description
**This is a two year fixed term assignment**
The Data Engineer is a key member of the Operational Intelligence (OI) team within the Financial Management Services (FMS) group. The OI team is responsible for assisting numerous FMS departments develop key business insight through the analysis of structured and unstructured data. Under minimal supervision, this role will be tasked with utilizing a wide variety of data extraction and preparation techniques in order to create and manage data sets to be analyzed or reported on for business decision making. The data engineer must creatively apply diverse data cleansing and transformation techniques as well as set up flexible data repositories that keep up-to-date data and allow for easy querying by other members of the team.
Responsible for development of complex technical analysis and design, new programming, modifications, scheduling, tuning, testing and maintenance of systems in support of new and existing data-centric projects.
Specific responsibilities of this position include:
Extract, transform, and load data to and from various data sources including relational databases, NoSQL databases, web services, and flat files
Design and implement scalable and high performance data repositories
Develop, optimize, and manage code used in ETL and data mining
Implement NLP techniques to parse text data for the purpose of topic modeling and document clustering
Setup and maintain scheduled data loads to ensure up-to-date information and data consistency
Profile and validate sources of data where very little metadata is provided
Produce various technical documents such as ER diagrams, table schemas, data lineage, API docs, etc.
Provide complex analysis, conceptualize, design, implement and develop solutions for critical data-centric projects.
Perform dataflow, system and data analysis and develop meaningful and useful presentation of data in downstream applications.
Plan and implement standards, define/code conformed global and reusable objects, perform complex database design, data repository modelling
Consult with client groups to assess user needs and understand the business processes; convert user requirements into technical solutions.
Contribute to data analysis, design and development of new and ongoing data-centric projects involving complex data repository or transactional source systems.
Collaborate closely with internal and external teams to understand and apply changes/modifications impacting data repositories.
Conduct and participate in code walkthroughs and document technical design. Assist in quality control testing. Meticulously follow software methodologies defined.
Monitor ETL processes, system audits, dashboard reporting and presentation layer functioning and performance. Pro-actively resolve issues as found. Support the performance of systems.
Follow the release cycles and implement on-time delivery of bug fixes, change requests and enhancements. Troubleshoot and solve technical problems.
* - Other duties may also be assigned
Education & Experience:
Bachelors degree and seven years of relevant experience in computer science, or engineering or a combination of education and relevant experience.
Knowledge, Skills and Abilities:
Strong programming skills including the ability to create highly flexible and performance-tuned user defined functions
Extensive knowledge in Python or equivalent scripting language.
Extensive knowledge of querying languages for both SQL and NoSQL databases
Expertise in managing and administering MongoDb, Oracle, MySQL, and MS Access databases
Experience extracting data from web services and working with JSON and XML output
Experience with programmatic ETL platforms such as Airflow
Prior experience working directly with data scientists and report developers
Strong analytical capabilities, strategic thinking skills, and problem-solving abilities Strong listening, verbal and written communication skills
Experience eliciting, interpreting, and documenting user requirements in the context of data analysis
Ability to manage multiple activities in a deadline-oriented environment; highly organized, flexible and rigorous attention to detail.
Preferred experience with data visualization tools such as Tableau, D3
Understanding of software engineering principles and skills working on Unix/Linux/Windows Operating systems, Version Control and Office software.
Strong programming skills, relational database skills with expertise in Advanced Sql and PL/Sql. Skills in Shell Programming and any Object Oriented Programming language.
Ability to design Physical and Reporting Data models for seamless cross-functional and cross-systems data reporting.
Able to design complex ETLs extracting data through XML files, RDBMS and Flat file sources.
Should be able to write custom ETL programming from complex data processing and transformations using any programming language, such as PL/Sql, Python, Java, etc.
Extensive experience in data analysis and root cause analysis and proven problem solving and analytical thinking capabilities.
Ability to prioritize workload and work with minimal supervision.
Certifications and Licenses:
Constantly perform desk-based computer tasks.
Rarely writing by hand; lift/carry/push/pull objects that weigh up to 10 pounds.
* - Consistent with its obligations under the law, the University will provide reasonable accommodation to any employee with a disability who requires accommodation to perform the essential functions of his or her job.
Interpersonal Skills: Demonstrates the ability to work well with Stanford colleagues and clients and with external organizations.
Promote Culture of Safety: Demonstrates commitment to personal responsibility and value for safety; communicates safety concerns; uses and promotes safe behaviors based on training and lessons learned.
Subject to and expected to comply with all applicable University policies and procedures, including but not limited to the personnel policies and other policies found in the Universitys Administrative Guide, http://adminguide.stanford.edu/.
Stanford is an equal opportunity employer and all qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other characteristic protected by law.
Located between San Francisco and San Jose in the heart of Silicon Valley, Stanford University is recognized as one of the world's leading research and teaching institutions. Leland and Jane Stanford founded the University to "promote the public welfare by exercising an influence on behalf of humanity and civilization." Stanford opened its doors in 1891, and more than a century later, it remains d...edicated to finding solutions to the great challenges of the day and to preparing students for leadership in a complex world. The University's thriving diverse community is comprised of nearly 7000 undergraduate students, 9000 graduate students, 2000 faculty members, 1900 postdoctoral scholars, and over 11,000 academic and administrative staff in seven schools including several interdisciplinary research centers and institutes. The campus spreads over 8000 contiguous acres and nearly all undergraduates live on campus. Stanford offers bachelor's and master's degrees in addition to doctoral degrees (PhD, MD, DMA and JD) plus a number of professional and continuing education programs and certifications. More at http://facts.stanford.edu and http://www.stanford.edu.
Stanford University is an equal opportunity employer and is committed to increasing the diversity of its faculty. It welcomes nominations of and applications from women, members of minority groups, protected veterans and individuals with disabilities, as well as from others who would bring additional dimensions to the university’s research, teaching and clinical missions.