Data Engineer

Education

Graduate of any bachelor’s degree in Computer Science, Information Systems / Technology, Engineering or a related study (or equivalent project-related experience).

Qualifications

• Experience in software development.

• Working knowledge in Phyton, Perl, C/C++, PL/SQL,NoSQL and Java

• Linux and Unix is required

• Knowledge and experience in Big Data technologies like HDFS, Hadoop, Apache Spark is a plus

• End to End software development lifecycle

Duties and Responsibilities

• Develop, test, monitor and optimize of end-to-end data processing jobs and workflows from data acquisition, transformation to data exposure / publishing.

• Develop and enhance applications / solutions / software consuming data from the data lake / data warehouse for the purpose of data visualization or advanced data analytics (i.e. reports and dashboards)

• Develop, test and maintain big data architecture, open source databases (e.g., HADOOP, HIVE, HBASE, PRESTO etc.), including duties to support development and deployment of innovative big data platforms

• Establish controls on the data being collected, processed and/or transformed and presented. Perform regular Audit on Data Quality (Accuracy, Completeness and Timeliness) and Ensure Completeness, Accuracy and Timeliness of Data; Ensure compliance to PLDT Group standards.

• Regularly communicate and engage with business users, data owners and stewards, IT hardware support and infrastructure teams, IT data source teams, database administrators and other stakeholders for the purpose of clarifying requirements, communicating status, issues or presenting solutions.

• Manage the day-to-day running of scheduled jobs or program, including enforcing policies, maintaining systems and responding to user requests and ensure that the system delivers consistently on the operational-level agreement (OLA). In case of issues, will also be responsible for the prompt resolution of issues in relation to the end to end data platform components.

• Ensure delivery commitment of 3rd party vendor partners within service-level agreement SLA on the required support from troubleshooting, applying patches, dealing with exceptions and escalating problems.

• Ensure compliance to PLDT Group standards

• Perform other related duties of similar nature or level that may be assigned from time to time

• Support the execution of upgrades or migrations in keeping the technology up to date

• Perform diagnosis of issues as required and synthesize the conclusions into recommendations that drive improvements to the overall delivery

• Create Solutions Design and Technical Architecture documentation