finished first draft of expose:

This commit is contained in:
2024-10-14 12:42:52 +02:00
parent 493d5ae2b3
commit a3dd6112cf
4 changed files with 296 additions and 20 deletions
+135 -10
View File
@@ -13,28 +13,153 @@
% Document
\begin{document}
% title section
\title{Exposé: Creating a Generalized Transformer Framework for Predictive Analysis of Health Features from Time-Series Data}
\title{Developing a Data-Driven Framework for Advanced Time-Series Analysis:
Integrating Transformer Architectures with Health Data}
\author{Alexander Blank}
\date{September 2024}
\maketitle
\section{Introduction}
\label{sec:introduction}
Test \cite{zhang2023crossformer}
\section{Introduction}\label{sec:introduction}
Time-series data is a cornerstone of many fields, including finance, health, and climate science,
where it plays a crucial role in forecasting, anomaly detection, and classification tasks.
Predictive models based on time-series data are widely used in applications such as weather forecasting,
stock price prediction, health monitoring, and security systems.
In recent years, transformer-based architectures have shown significant improvements in time-series analysis,
outperforming traditional models like LSTMs in capturing complex temporal patterns.
As the field of time-series analysis rapidly evolves, new models and architectures are continually developed to
meet the growing demands of high-frequency data analysis.
\section{Research Objectives and Questions}
This exposé outlines the development of a modular, data-driven framework designed to integrate advanced transformer
architectures for time-series analysis.
To demonstrate its capabilities, the framework will be applied in a case study focused on high-frequency
ovulation cycle health data, showcasing its adaptability across various model architectures.
\section{Related Work}
\section{Methodology}
\section{Related Work}\label{sec:related-work}
Traditional time-series models like LSTMs and GRUs have been widely used but struggle with capturing
long-term dependencies and complex temporal patterns.
Transformer-based architectures, such as the Temporal Fusion Transformer (TFT)\cite{lim_temporal_2020}
and PatchTST\cite{nie_time_2023}, offer significant improvements, particularly in scalability and interpretability.
These models have become key in addressing challenges inherent to time-series data,
but the field continues to evolve rapidly with new architectures being developed frequently.
\section{Expected Results}
Several existing frameworks, including PyTorch Lightning\cite{lightningai_pytorch_2024}, \
Amazons GluonTS\cite{alexandrov_gluonts_2019}, and Meta's Prophet\cite{taylor_forecasting_2017},
provide tools for scalable time-series analysis.
However, they remain low-level, requiring significant customization to incorporate new models or are limited to regression tasks.
This highlights the need for a flexible, modular framework that allows seamless integration of
transformer-based architectures for time-series data, particularly in health applications.
This project aims to bridge this gap by developing a modular, data-driven framework that
simplifies the integration and adaptation of emerging models, focusing on the unique challenges of
health-related time-series data.
\section{Research Questions and Objectives}\label{sec:research-questions-and-objectives}
The primary objective of this project is to create a modular framework designed to address the specific challenges
of high-frequency time-series data in health applications, such as temperature monitoring.
The framework will be adaptable to other types of physiological data, like heart rate and sleep patterns, and scalable across different model architectures.
The key research questions are:
\begin{itemize}
\item \textbf{How can a modular framework be designed to facilitate the integration and adaptation of
transformer-based models for time-series data?}
\item \textbf{What are the unique challenges of applying transformer architectures to health-related
time-series data, and how can the framework address these?}
\item \textbf{How can transformer-based architectures be optimized for high-frequency health data,
such as ovulation cycle monitoring, in terms of performance and interpretability?}
\end{itemize}
This project aims to provide a flexible and scalable solution for the health tech domain, addressing both
performance and integration challenges in time-series analysis.
If time allows, the project will also explore the following:
\begin{itemize}
\item \textbf{How can the framework be extended to allow for training of a foundation model on a large dataset
and fine-tuning on a smaller, domain-specific dataset?}
\item \textbf{What are the most effective evaluation metrics for assessing the performance of transformer models
in the context of health-related time-series data?}
\end{itemize}
\section{Methodology}\label{sec:methodology}
The proposed framework for this project is designed with two major components: dataset creation and model
training, with the potential for model evaluation and deployment depending on the outcomes of the case study.
The framework will be implemented in Python and structured to accommodate the specific requirements of
high-frequency health data analysis, particularly for ovulation cycle monitoring.
\subsection{Dataset Creation}
The dataset creation process will rely on an example MongoDB database as the primary data source, from which health
data will be extracted and prepared for model input.
This phase will involve preprocessing the raw data using \texttt{NumPy} and \texttt{Pandas} to generate
time-series datasets suitable for training transformer models.
The data will be curated to ensure it aligns with the high-frequency nature of ovulation cycle monitoring, and
the preprocessing will include handling missing values, normalizing features, and generating the necessary
time-series sequences.
\subsection{Model Training}
The model training component will focus on applying transformer-based architectures to the prepared dataset.
Two specific models will be used for the case study:
\begin{itemize}
\item \textbf{Temporal Fusion Transformer (TFT)}: Selected for its ability to provide interpretability while
modeling long-term dependencies in time-series data.
\item \textbf{PatchTST}: Chosen for its state-of-the-art performance in handling large-scale time-series
forecasting tasks.
\end{itemize}
Both models will be trained using \texttt{PyTorch}, with support from the \texttt{Transformers} library by
Hugging Face, allowing for efficient implementation and fine-tuning of the transformer architectures.
\subsection{Model Evaluation and Deployment}
The choice of evaluation metrics and deployment strategy will be determined based on the results of the case study.
These components will be incorporated into the framework once the models have been trained and evaluated for
performance and interpretability.
% - quickly introduce the two models I want to use (TFT and PatchTST)
% - framework will be build in python. dataset generation will be based on a example mongodb as data source with numpy and pandas.
% - model training will be done with pytorch with the help of the transformers library by huggingface.
% - choice of model evaluation and deployment will be made during the project, depending on the results of the case study.
\section{Case Study}
The case study will focus on analyzing high-frequency ovulation cycle data obtained from wearable devices,
which records a measurement every 5 minutes (288 measurements a day).
This dataset offers a unique opportunity to evaluate the ability of transformer-based models to handle
complex temporal dependencies in health-related data.
The Temporal Fusion Transformer (TFT) will be employed to explore model interpretability, particularly in terms of
identifying key features and trends that contribute to predictions, while PatchTST will be used to test the
performance and scalability of the framework in handling large-scale time-series forecasting.
The expected outcome of this case study is to demonstrate the adaptability of the framework across two dimensions:
interpretability and performance.
The results will provide insight into how these models can be optimized for real-world health applications and may
offer new directions for handling other physiological data, such as heart rate or sleep patterns.
\section{Timeline}\label{sec:timeline}
Given the exploratory nature of this project, the timeline will be flexible, focusing on key milestones rather than rigid deadlines.
The project will progress in phases, with time allocated for initial exploration, model development, and case study evaluation.
\begin{itemize}
\item \textbf{Exploration and Initial Testing:} Early project phases will involve exploring the transformer-based models (TFT and PatchTST), testing their suitability for high-frequency health data, and refining the framework design.
\item \textbf{Dataset Creation and Preprocessing:} Once the framework design is solidified, attention will turn to creating the dataset and ensuring data preprocessing is aligned with the needs of the transformer models.
\item \textbf{Model Training and Evaluation:} The core phase will focus on model training using PyTorch and evaluating both performance and interpretability, with adjustments made iteratively based on results.
\item \textbf{Final Evaluation and Analysis:} The project will conclude with a thorough analysis of model performance and adaptability, followed by preparing the framework for potential further deployment or case study extensions.
\end{itemize}
This flexible structure allows for adaptation as the project develops, with each phase being iterative and data-driven based on initial findings.
\section{Timeline}
\section{Conclusion}
This project aims to develop a modular framework for integrating transformer-based models in time-series analysis,
with a focus on high-frequency health data.
By applying the framework in a case study involving ovulation cycle monitoring,
the project seeks to demonstrate its scalability, performance, and adaptability for real-world health applications.
The outcomes of this project could pave the way for further advancements in health-related time-series analysis,
extending to other physiological data types and domains.
% bibliography
\printbibliography