Big Data Architect for Three-Month Assignment in Germany

Project Description

We are one of the leading energy companies in Europe.  We have developed Virtual Power Plant (VPP) capabilities to manage electricity supply and demand to e.g. avoid frequency drops in the grid (fast frequency response) and automatically and flexibly manage generation assets like CHPs (read and write on generation assets).

In this process, a lot of data is collected: Operational data (real-time) as well as historical data. We currently do not exploit the value of the data collected (especially the historical one) and would like to explore patterns from the data, which will help us to further optimize our VPP offering.

Also, we developed an energy efficiency platform and analyze consumption records to offer alternatives and hence reduce energy costs. We would further like to help our B2B customers to optimize onsite electricity generation vs. grid.

In order to create more value from our data we are looking for data architectural skills. The person will have the following responsibilities:

• Working development team focused on developing Energy Solutions based on the command and control of thousands of remote machines
• Responsible for envisioning and executing on design & implementation of a variety of use cases based on the real-time data streams from live equipment
• Work closely with development teams
• Responsible for all deliverables associated with end to end data architecture, model, including source to target mappings and data dictionary
• Ensuring quality, performance, and security of database design and implementation
• Providing advice and support for projects regarding all aspects of database development including relational, NoSQL, and time series technologies
• Assisting with the set-up of frameworks for the ECT database service to fit our micro services architecture
• Supporting with the design and implementation of real-time data ingestion and processing using the Kafka, Spark, and Casandra technology stack
• Setting up quality assurance processes for database development

We are looking for an experienced Big Data expert with the following qualifications:

• University degree in Information Technology, Software Development, Engineering or related fields
• Proficiency in database design, implementation, administration, and performance optimization
• Experience with Non-Relational databases (such as like Hadoop, Casandra, Mongo, Cloudera)
• Strategic and detail understanding of major database products (e.g. Oracle technology, MS SQL Server technology or open source systems such as Postgres and MySQL)
• Knowledge in logical and physical database design and data modeling
• Experience in developing systems from scratch - Experience of data warehouse design principles
• Familiarity with configuration management and software release procedures
• Appreciation of general technical concepts (e.g. Networking protocols, Windows and Linux server products, Back-up and recovery, Storage, IT Security)
• Experience of and like working in distributed teams with various nationalities; Comfortable working in a fast-paced, dynamic, agile environment
• Business fluent in English Ideally, we are looking for a long time engagement.

More info on our business:

http://www.eon-connecting-energies.com/en.html