GPTT

Building a foundation model for transportation that unifies multiple prediction tasks through shared representation learning.

Relative Fields: Deep Learning, Representation Learning, Transportation Demand Modeling, Intelligent Transportation Systems, Transformer Architectures, Transfer Learning

Project Overview

Transportation studies often develop separate machine learning models for individual prediction tasks, such as mode choice, trip purpose, destination prediction, or travel demand estimation. While effective for specific applications, these task-specific models fail to leverage the common patterns that exist across different aspects of human travel behaviour.

This ongoing research aims to develop a Transportation Foundation Model capable of learning a shared representation of transportation data that can support multiple prediction tasks within a single deep learning architecture. Rather than training independent models for each problem, the objective is to create a unified model that understands the underlying relationships between traveller characteristics, trip attributes, and transportation systems.

The proposed framework investigates transformer-based architectures, representation learning, and multi-task learning techniques to build reusable embeddings that generalise across a wide range of transportation applications. The long-term vision is to enable a single model to perform predictions such as travel mode choice, trip generation, destination choice, trip purpose classification, travel demand estimation, and other transportation-related tasks without requiring separate models for each objective.

By learning from diverse transportation data and sharing knowledge across tasks, the model aims to improve prediction accuracy, reduce training costs, and provide a more flexible foundation for future intelligent transportation applications.

This research is currently under development. As the project progresses, additional information regarding the model architecture, training methodology, experimental evaluation, and research findings will be published on this website.

Project Steps :

  1. Using the Mode choice model(which works great with behavior) and make it more general using more individual data.
  2. Use behavior data from different cities to train the model in pre-training step.
  3. Fine tune the model and use it in real time problems.

Results of The Project

Wait for it!

Code Sources :

This implementation had been done by Python.

You need to wait for it to be completed. Then I will put the source code in github for you.

 

Scroll to Top