data engineer
Posted on
October 04, 2024
by
Employer details
VIREC Holdings Inc.
Job details
*About the Role:*
We are seeking a skilled *Data Engineer* to manage the structure, organization, and extraction of real estate big data from various sources. You will be responsible for building and maintaining efficient data pipelines, ensuring data quality, and developing secure data lakes to handle large volumes of structured, semi-structured, and unstructured data. This role requires a strong sense of responsibility, decision-making abilities, and the capacity to work long hours to meet project deadlines.
*Key Responsibilities:*
* *Data Pipeline Development:* Design, build, and maintain efficient ETL processes for data extraction, transformation, and loading from diverse real estate data sources.
* *Data Quality Assurance:* Implement data validation and cleansing techniques to ensure accuracy, consistency, and normalization of data across all datasets.
* *Data Storage Management:* Develop and manage scalable data storage solutions, including data lakes, to support comprehensive data analysis and reporting.
* *API Integration:* Collaborate with the Full-Stack Developer to design and implement robust APIs for seamless data integration into web applications.
* *Security Management:* Ensure the secure handling and storage of large volumes of structured, semi-structured, and unstructured data.
* *Performance Optimization:* Monitor and optimize data systems for performance, scalability, and reliability.
*Qualifications:*
* *Experience:* Minimum of 3 years in data engineering or related roles with a focus on data operations.
* *Technical Skills:*
* Proficiency in *Python*, *Java*, or *Scala*.
* Experience with ETL processes and data pipeline tools such as *Apache Airflow* or *AWS Glue*.
* Strong knowledge of *SQL* and experience with both relational and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra).
* Familiarity with big data technologies like *Hadoop*, *Spark*, or *Kafka*.
* Experience with cloud platforms (*AWS*, *Azure*, *Google Cloud*) and their data services.
* Knowledge of *data warehousing* and *data modeling* techniques.
* Understanding of *data security* best practices.
* *Soft Skills:*
* Excellent problem-solving abilities and attention to detail.
* Strong communication and teamwork skills.
* Ability to work in a fast-paced, agile environment.
* Good sense of responsibility and decision-making capabilities.
* Willingness to work long hours when necessary.
*Preferred Qualifications:*
* *Knowledge in Real Estate* data and analytics is highly desirable.
* Experience with *data lake architectures* and *real-time data processing*.
* Familiarity with *containerization* and *orchestration tools* (Docker, Kubernetes).
*Benefits:*
* Competitive salary with productivity bonuses.
Professional development opportunities in a collaborative environment.
Job Types: Full-time, Permanent
Pay: $100,000.00-$140,000.00 per year
Benefits:
* Dental care
* Extended health care
* Paid time off
Work Location: In person
-
LocationMontréal, QC
-
Workplace information
On site
-
Salary$100,000 to $140,000YEAR annually
-
Terms of employment
Permanent employmentFull time
-
Starts as soon as possible
- vacancies
1 vacancy
- Source
indeed.com
#9474732418
Important notice: This job posting has been provided by a partner site. Job Bank is not responsible for this content.
Report a problem with this job posting
Thank you for your help!
You will not receive a reply. For enquiries, please contact us.