I architect and build enterprise-grade data platforms using the modern data stack. Specialized in Snowflake, dbt, Matillion, and Azure Data Factory with advanced expertise in AI/ML integration, schema evolution, and real-time analytics.
I'm Avinash Rai (@AvinashAnalytics), a Data Engineer who transforms complex business requirements into scalable, production-ready data solutions.
My expertise spans the modern data stack — from designing Snowflake data warehouses and building dbt transformation layers, to orchestrating Matillion ETL pipelines and architecting Azure Data Factory workflows.
What sets me apart is my ability to integrate cutting-edge AI/ML capabilities into data pipelines, including neural network-based transliteration systems, LLM-powered analytics, and automated schema evolution frameworks.
Built neural transliteration systems, 3D Azure analytics dashboards, and AI-powered ETL pipelines
Expert in Snowflake, dbt, Matillion - the latest in enterprise data engineering
Integrating machine learning models into production data pipelines
Architecting scalable solutions on Azure, AWS, and Snowflake Cloud
Design and implement enterprise data warehouses, optimize query performance, manage Snowpipe ingestion, and architect star/snowflake schemas
Build modular, tested, and documented transformation layers with dbt. Implement data quality checks, incremental models, and CI/CD workflows
Design complex ETL workflows with Matillion, integrate with Cortex AI, implement data validation, and automate pipeline deployment
Build interactive ADF analyzers with 3D visualizations, dependency mapping, pipeline impact analysis, and orphan resource detection
Develop neural networks (LSTM, Transformers), integrate LLMs, build real-time ML inference pipelines, and deploy production ML models
Implement automated schema evolution, build self-healing pipelines, create data quality frameworks, and design adaptive data systems
Advanced data engineering and AI/ML solutions showcasing enterprise-grade implementations
State-of-the-art neural transliteration system converting Hindi text from Roman to Devanagari script using LSTM, Transformer, and LLM models. Implements sequence-to-sequence architecture with attention mechanisms.
Interactive Streamlit dashboard for visualizing Azure Data Factory dependencies with 3D graphs, pipeline impact analysis, resource analytics, and orphan detection. Real-time filtering and interactive exploration.
Automated schema evolution framework demonstrating intelligent data pipeline adaptation. Handles schema changes dynamically without breaking downstream dependencies.
Integration of Matillion's AI-powered Maia with Snowflake Cortex AI for intelligent ETL automation. Demonstrates cutting-edge AI-assisted data transformation workflows.
Production-ready dbt project with Snowflake integration. Implements modular transformations, incremental models, data quality tests, and comprehensive documentation.
Advanced analytics using dbt + Snowflake for credit card transaction analysis. Features dimensional modeling, aggregations, and business metrics calculation.
Complete data warehouse solution with AWS S3 ingestion, star schema modeling (8+ tables), and Power BI dashboards. Czech banking dataset with financial analytics.
Fully automated pipeline with 4-stage data validation, conversion tracking (30-day window), unsubscribed user extraction, and top customer analysis in Alteryx.
Predictive ML model for employee retention analysis using classification algorithms, feature engineering, and HR analytics insights.
Unique ML project analyzing biological signals to detect smoking patterns. Signal processing + machine learning for healthcare applications.
Real-time NLP sentiment analysis on 15,000+ airline tweets using VADER. Interactive Streamlit dashboard with visualizations and insights.
Advanced market basket analysis using Alteryx to discover product associations, customer purchase patterns, and cross-selling opportunities.
Open to freelance projects, consulting opportunities, and full-time roles in data engineering
I'm available for: