Data Engineer & Software Developer

John Chernoff, P.Eng.

Professional Engineer turned Data Engineer, specializing in building robust data pipelines, advanced analytics, and cloud solutions within the Azure Databricks ecosystem. From $14B industrial projects to cutting-edge AI implementations.

john@portfolio ~
$ whoami
{
"name" : "John Chernoff"
"role" : "Data Engineer"
"location" : "Calgary, AB"
"status" : "Building data pipelines โšก"
}

Engineering at Every Scale

I'm a Professional Engineer who made the strategic leap from traditional engineering to software development. My career began in the oil and gas industry, where I worked on some of North America's largest engineering projects, including the $14B LNG Canada facility.

That experience taught me how to manage complex systems, coordinate global teams, and deliver under pressure. Now I apply those same principles to building scalable data infrastructure and intelligent analytics solutions.

Today, I specialize in the Azure Databricks ecosystem, designing ETL pipelines that process terabytes of data, implementing RAG systems for AI applications, and establishing data governance frameworks that ensure quality and compliance.

8+
Years Experience
$14B
Largest Project
1TB+
Data Processed
3K
Events/Second

Tools & Technologies

โšก

Languages

Python SQL Bash JavaScript TypeScript C#
๐Ÿ”ง

Data Engineering

Databricks Apache Spark Delta Lake Airflow dbt Kafka Power BI
โ˜๏ธ

Cloud & DevOps

Microsoft Azure AWS GCP Docker GitHub Actions Bicep
๐Ÿ—„๏ธ

Databases

PostgreSQL MySQL MongoDB Firebase VectorDB AVEVA PI
๐Ÿค–

AI & Machine Learning

TensorFlow PyTorch scikit-learn LangChain RAG HuggingFace
๐Ÿญ

Industrial & Control Systems

AVEVA PI Honeywell Forge DCS/PLC HMI Design P&IDs SCADA

Professional Journey

Software Developer

Arcurve

Mar 2025 โ€” Present

Building enterprise data solutions and AI-powered applications for diverse clients.

  • Design and develop robust data pipelines integrating multiple sources using Azure Databricks and Spark
  • Develop RAG pipelines and vector database solutions linking frontier LLMs with internal knowledge bases
  • Perform exploratory data analysis on 1TB+ datasets for causal analysis on equipment failure
  • Reduced client operational costs by $3k/month by replacing Fivetran with Databricks connectors
  • Upgrade legacy workspaces to Unity Catalog, implementing data governance frameworks
  • Build CI/CD pipelines using GitHub Actions and Databricks Asset Bundles

Data Engineer

MetaFactor

Jun 2024 โ€” Mar 2025

Managed enterprise-scale time series data infrastructure for industrial clients.

  • Managed complex database with 150,000+ high-value time series data points processing 3,000 events/second
  • Created AVEVA PI asset framework databases and analyses for reporting and analytics
  • Designed Azure cloud infrastructure for databases and PI system components

Automation Engineer

Suncor

2021 โ€” 2022

Led automation improvements across all Suncor facilities.

  • Coordinated cross-functional stakeholders to implement automation improvements and consistent standards
  • Caught 50+ unfit pressure transmitters during reviews, resulting in significant project savings
  • Investigated and integrated 'stranded data' from packaged control systems into enterprise historian

Control Systems Engineer

Fluor Canada

2017 โ€” 2020

Key contributor to major energy infrastructure projects including LNG Canada ($14B).

  • Led HMI graphics development for LNG Canada, creating 5,000+ customized digital graphics
  • Managed team of 4 engineers for water treatment, nitrogen, marine loading and other process units
  • Coordinated with global teams in Japan and Philippines to execute as one unified team
  • Developed 40+ P&IDs and specified 100+ instrumentation data sheets
  • Created MTOs for instrumentation and control systems valuing over $10M

Automation Engineering Student

Husky Energy

Sep 2015 โ€” Aug 2016

Engineering internship at SAGD oil sands facility.

  • Maintained PI database in alignment with local DeltaV historian
  • Implemented new control schemes to solve automation debottlenecks
  • Fixed and calibrated level instrumentation including nuclear profilers and guided wave radars

Manufacturing Engineering Student

Windsor Machine Group

May 2015 โ€” Aug 2015

Engineering internship focused on automotive manufacturing optimization.

  • Optimized polyurethane foam production to reduce automotive part weights while maintaining part specifications for hardness

Process Engineering Student

City of Calgary

May 2014 โ€” Aug 2014

Engineering internship at municipal wastewater treatment facility.

  • Operated small wastewater pilot plant including high density sludge, membrane bioreactor, and reverse osmosis treatment

Featured Work

๐Ÿค–

RAG Proof of Concept

Retrieval-Augmented Generation pipeline connecting LLMs to internal knowledge bases, enabling accurate responses without hallucinations using vector embeddings.

Python LangChain VectorDB OpenAI
โœˆ๏ธ

Flight Reservation System

Full-stack flight booking application with user authentication, search functionality, and reservation management.

JavaScript Node.js Database
๐Ÿธ

Badminton Tournament Manager

Tournament management application with knockout brackets, player registration, and match tracking. Built as a passion project combining sports and code.

HTML JavaScript CSS
๐Ÿงฎ

Math Facts

Interactive math practice application for learning and reinforcing arithmetic fundamentals. Fun educational tool for building math fluency.

HTML JavaScript CSS

Academic Background

๐ŸŽ“

MEng in Software Engineering

University of Calgary

Apr 2023 โ€” May 2024 | GPA: 3.8

Specialized in Machine Learning and Big Data. Coursework included distributed systems, advanced algorithms, and data engineering principles.

โš—๏ธ

BASc in Chemical Engineering

Queen's University

Sep 2012 โ€” May 2017 | GPA: 3.5

Dean's Honours List. Professional Internship Program. Varsity Badminton Athlete. Foundation in process control and systems thinking.

๐Ÿ…

Databricks Professional Data Engineer

Advanced certification

๐Ÿ“œ

Databricks Associate Data Engineer

Azure Databricks certified

โš™๏ธ

Professional Engineer (P.Eng.)

APEGA Licensed - Alberta

Let's Connect

I'm always open to discussing new opportunities, interesting projects, or just connecting with fellow engineers and data enthusiasts.