Discover jobs
Job Search
data analyst - informatics and systems
Title posted on ZipRecruiter - Data Engineer
Posted on November 15, 2024 by Employer details I-cube Software Llc
Job details
<h3>Job Description</h3><div>Job Description<div><p>Hybrid Hadoop Engineer and Hadoop Infrastructure Administrator to build and maintain a scalable and resilient Big Data framework to support Data Scientists. As an administrator, your responsibility will be to deploy and maintain Hadoop clusters, add and remove nodes using cluster management and monitoring tools like Cloudera Manager, and support performance and scalability requirements, in support of our Data scientist's needs. Some Relational Database administrator experience will also be desirable to support the general administration of Relational Databases.</p><p>Design, build, and maintain Big Data <span class="long-word">workflows/pipelines</span> to process a continuous stream of data with experience in end-to-end design and build process of Near-Real-Time and Batch Data Pipelines.</p><p><br />Demonstrated work experience in the following with Big Data and distributed programming models and technologies<br />Knowledge of database structures, theories, principles, and practices (both SQL and NoSQL).<br />Active development of ETL processes using Spark or other highly parallel technologies, and implementing ETL/data pipelines<br />Experience with Data technologies and Big Data tools, like Spark, Kafka, Hive<br />Understanding of Map Reduce and other Data Query and Processing and aggregation models<br />Understanding of challenges of transforming data across distributed clustered environment<br />Experience with techniques for consuming, holding, and aging out continuous data streams<br />Ability to provide quick ingestion tools and corresponding access APIs for continuously changing data schema, working closely with Data Engineers around specific transformation and access needs</p><p>Preferred:</p><p>Experience as a Database administrator (DBA) will be responsible for keeping critical tools database up and running<br />Building and managing high-availability environments for databases and HDFS systems<br />Familiarity with transaction recovery techniques and DB Backup</p><p>Skills and Attributes:</p><p>Ability to have effective working relationships with all functional units of the organization<br />Excellent written, verbal, and presentation skills<br />Excellent interpersonal skills<br />Ability to work as part of a cross-cultural team<br />Self-starter and Self-motivated<br />Ability to work without lots of supervision<br />Works under pressure and is able to manage competing priorities.</p><p>Hide</p></div></div>- LocationToronto, ON
- Workplace information On site
- Salary$49.19HOUR hourly
- Terms of employment Part time
- Starts as soon as possible
- vacancies 1 vacancy
- Source ZipRecruiter #9b41a61a25
Important notice: This job posting has been provided by a partner site. Job Bank is not responsible for this content.
Report a problem with this job posting
- Date modified: