Type of Publication

Journal Articles

Date:

7 /

2024

Status

Published

DOI:

10.1109/TAI.2024.3421175

Social NSTransformers: Low-Quality Pedestrian Trajectory Prediction

Featured in:

IEEE Transactions on Artificial Intelligence

Authors:

Zihan Jiang; Yiqun Ma; Bingyu Shi; Xin Lu; Jian Xing; Nuno Gonçalves; Bo Jin

Abstract

This paper introduces a novel model for low-quality pedestrian trajectory prediction, the Social Non-stationary Transformers (NSTransformers), that merges the strengths of NSTransformers and Spatio-Temporal graph transformer (STAR). The model can capture social interaction cues among pedestrians and integrate features across spatial and temporal dimensions to enhance the precision and resilience of trajectory predictions. We also propose an enhanced loss function that combines diversity loss with logarithmic root mean squared error (log-RMSE) to guarantee the reasonableness and diversity of the generated trajectories. This design adapts well to complex pedestrian interaction scenarios, thereby improving the reliability and accuracy of trajectory prediction. Furthermore, we integrate a Generative Adversarial Network (GAN) to model the randomness inherent in pedestrian trajectories. Compared to the conventional standard Gaussian distribution, our GAN approach better simulates the intricate distribution found in pedestrian trajectories, enhancing the trajectory prediction’s diversity and robustness. Experimental results reveal that our model outperforms several state-of-the-art methods. This research opens the avenue for future exploration in low-quality pedestrian trajectory prediction.

Citation
Zihan Jiang, Yiqun Ma, Bingyu Shi, Xin Lu, Jian Xing, Nuno Gonçalves and Bo Jin (2024). Social NSTransformers: Low-Quality Pedestrian Trajectory Prediction. In IEEE Transactions on Artificial Intelligence, vol. 5, no. 11; pages 5575-5588. DOI: 10.1109/TAI.2024.3421175.

Related Content

Researcher Coordinator, VIS TEAM Leader
Post-Doc Researcher
No tagged content to show
No tagged content to show
No tagged content to show

RECENT PUBLICATIONS

Towards Secure Biometric Solutions: A Multifactor Authentication Framework for Facial Recognition While Protecting User Data

Authors: José Silva; Ajnas Muhammed; Aniana Cruz; Bruno Sousa; Nuno Gonçalves
Featured in: IET Biometrics Volume 2026, Issue 1

Second Competition on Presentation Attack Detection on ID Card

Authors: Juan E Tapia; Mario Nieto; Juan M Espin; Alvaro S Rocamora; Javier Barrachina; Naser Damer; Christoph Busch; Marija Ivanovska; Leon Todorov; Renat Khizbullin; Lazar Lazarevich; Aleksei Grishin; Daniel Schulz; Sebastian Gonzalez; Amir Mohammadi; Ketan Kotwal; Sebastien Marcel; Raghavendra Mudgalgundurao; Kiran Raja; Patrick Schuch; Sushrut Patwardhan; Raghavendra Ramachandra; Pedro Couto Pereira; Joao Ribeiro Pinto; Mariana Xavier; Andrés Valenzuela; Rodrigo Lara; Borut Batagelj; Marko Peterlin; Peter Peer; Ajnas Muhammed; Diogo Nunes; Nuno Gonçalves
Featured in: 2025 IEEE International Joint Conference on Biometrics

DFIC: Towards a balanced facial image dataset for automatic ICAO compliance verification

Authors: Nuno Gonçalves; Diogo Nunes; Carla Guerra; João Marcos
Featured in: Submited to: ArXiv

suggested news

VIS Team will host a session presenting the...
Paper presented at NeurIPS 2025
VIS Team has presented workshop at the 12th...

RECENT PROJECTS

FACING2 – Face Image Understanding
VISUAL-ID – Unique Visual Identities in Graphics, Images and Faces
UniqueMark

Institute of Systems and Robotics Department of Electrical and Computers Engineering University of Coimbra