title: Automated distribution of high-rate, high-fidelity polarization entangled photons using deployed metropolitan fibers

abstract: Distributing high-fidelity, high-rate entanglement over telecommunication infrastructure is one of the main paths towards large-scale quantum networks, enabling applications such as quantum encryption and network protection, blind quantum computing, distributed quantum computing, and distributed quantum sensing. However, the fragile nature of entangled photons operating in real-world fiber infrastructure has historically limited continuous operation of such networks. Here, we present a fully automated system capable of distributing polarization entangled photons over a 34 km deployed fiber in New York City. We achieve end-to-end pair rates of nearly $5\times10^5$ pairs/s and entanglement fidelity of approximately $99\%$. Separately, we achieve 15 days of continuous distribution, with a network up-time of $99.84\%$. Our work paves the way for practical deployment of 24/7 entanglement-based networks with rates and fidelity adequate for many current and future use-cases.


title: Is ChatGPT Transforming Academics' Writing Style?

abstract: Based on one million arXiv papers submitted from May 2018 to January 2024, we assess the textual density of ChatGPT's writing style in their abstracts by means of a statistical analysis of word frequency changes. Our model is calibrated and validated on a mixture of real abstracts and ChatGPT-modified abstracts (simulated data) after a careful noise analysis. We find that ChatGPT is having an increasing impact on arXiv abstracts, especially in the field of computer science, where the fraction of ChatGPT-revised abstracts is estimated to be approximately 35%, if we take the output of one of the simplest prompts, "revise the following sentences", as a baseline. We conclude with an analysis of both positive and negative aspects of the penetration of ChatGPT into academics' writing style.


title: Accessibility in Information Retrieval

abstract: This paper introduces the concept of accessibility from the field of transportation planning and adopts it within the context of Information Retrieval (IR). An analogy is drawn between the fields, which motivates the development of document accessibility measures for IR systems. Considering the accessibility of documents within a collection given an IR System provides a different perspective on the analysis and evaluation of such systems which could be used to inform the design, tuning and management of current and future IR systems.


title: Classification of Boolean Algebras through von Neumann regular $\mathcal{C}^{\infty}-$Rings

abstract: In this paper, we introduce the concept of a "von Neumann regular $\mathcal{C}^{\infty}$-ring", which is a model for a specific equational theory. We delve into the characteristics of these rings and demonstrate that each Boolean space can be effectively represented as the image of a von Neumann regular $\mathcal{C}^{\infty}$-ring through a specific functor. Additionally, we establish that every homomorphism between Boolean algebras can be expressed through a $\mathcal{C}^{\infty}$-ring homomorphism between von Neumann regular $\mathcal{C}^{\infty}$-rings.


title: A Conceptual Framework for Conversational Search and Recommendation: Conceptualizing Agent-Human Interactions During the Conversational Search Process

abstract: The conversational search task aims to enable a user to resolve information needs via natural language dialogue with an agent. In this paper, we aim to develop a conceptual framework of the actions and intents of users and agents explaining how these actions enable the user to explore the search space and resolve their information need. We outline the different actions and intents, before discussing key decision points in the conversation where the agent needs to decide how to steer the conversational search process to a successful and/or satisfactory conclusion. Essentially, this paper provides a conceptualization of the conversational search process between an agent and user, which provides a framework and a starting point for research, development and evaluation of conversational search agents.


title: FCert: Certifiably Robust Few-Shot Classification in the Era of Foundation Models

abstract: Few-shot classification with foundation models (e.g., CLIP, DINOv2, PaLM-2) enables users to build an accurate classifier with a few labeled training samples (called support samples) for a classification task. However, an attacker could perform data poisoning attacks by manipulating some support samples such that the classifier makes the attacker-desired, arbitrary prediction for a testing input. Empirical defenses cannot provide formal robustness guarantees, leading to a cat-and-mouse game between the attacker and defender. Existing certified defenses are designed for traditional supervised learning, resulting in sub-optimal performance when extended to few-shot classification. In our work, we propose FCert, the first certified defense against data poisoning attacks to few-shot classification. We show our FCert provably predicts the same label for a testing input under arbitrary data poisoning attacks when the total number of poisoned support samples is bounded. We perform extensive experiments on benchmark few-shot classification datasets with foundation models released by OpenAI, Meta, and Google in both vision and text domains. Our experimental results show our FCert: 1) maintains classification accuracy without attacks, 2) outperforms existing state-of-the-art certified defenses for data poisoning attacks, and 3) is efficient and general.


title: Advancing aortic stenosis assessment: validation of fluid-structure interaction models against 4D flow MRI data

abstract: Systematic in vivo validations of computational models of the aortic valve remain scarce, despite successful validation against in vitro data. Utilizing a combination of computed tomography and 4D flow magnetic resonance imaging data, we developed patient-specific fluid-structure interaction models of the aortic valve immersed in the aorta for five patients in the pre-transcatheter aortic valve replacement configuration. Incorporating also an in vitro setup of the valve, our computational models are subjected to rigorous validation against 4D flow measurements. Our results demonstrate the models' capacity to accurately replicate flow dynamics within established ranges of uncertainties mainly arising from 4D flow noise. In addition, we illustrate how computational models can serve as valuable cross-checks to reduce noise and erratic behaviour of in vivo data. This study represents a significant step towards integrating in silico technologies into real clinical contexts, providing a robust framework for improving aortic stenosis diagnosis and the design of next-generation aortic valve bioprostheses.


title: Does DESI 2024 Confirm $\Lambda$CDM?

abstract: We demonstrate that a $\sim 2 \sigma$ discrepancy with the Planck-$\Lambda$CDM cosmology in DESI Luminous Red Galaxy (LRG) data at $z_{\textrm{eff}} = 0.51$ translates into an unexpectedly large $\Omega_m$ value, $\Omega_m = 0.668^{+0.180}_{-0.169}$. We independently confirm that this anomaly drives the preference for $w_0 > -1$ in DESI data confronted to the $w_0 w_a$CDM model. We show that redshift bins of DESI constraints allow $\Omega_m$ to wiggle at the $\sim 2 \sigma$ level with increasing effective redshift in the $\Lambda$CDM model. Given that LRG data at $z_{\textrm{eff}} = 0.51$ is at odds with Type Ia supernovae in overlapping redshifts, we expect that this anomaly will decrease in statistical significance with future DESI data releases leaving an increasing $\Omega_m$ trend with effective redshift at higher redshifts. We estimate the significance of the latter in DESI data at $\sim 1.8 \sigma$ and comment on how it dovetails with independent observations. It is imperative to understand what makes DESI LRG data at $z_{\textrm{eff}} = 0.51$ an outlier when it comes to $\Omega_m$ determinations.


title: Pre-training Small Base LMs with Fewer Tokens

abstract: We study the effectiveness of a simple approach to develop a small base language model (LM) starting from an existing large base LM: first inherit a few transformer blocks from the larger LM, and then train this smaller model on a very small subset (0.1\%) of the raw pretraining data of the larger model. We call our simple recipe Inheritune and first demonstrate it for building a small base LM with 1.5B parameters using 1B tokens (and a starting few layers of larger LM of 3B parameters); we do this using a single A6000 GPU for less than half a day. Across 9 diverse evaluation datasets as well as the MMLU benchmark, the resulting model compares favorably to publicly available base models of 1B-2B size, some of which have been trained using 50-1000 times more tokens. We investigate Inheritune in a slightly different setting where we train small LMs utilizing larger LMs and their full pre-training dataset. Here we show that smaller LMs trained utilizing some of the layers of GPT2-medium (355M) and GPT-2-large (770M) can effectively match the val loss of their bigger counterparts when trained from scratch for the same number of training steps on OpenWebText dataset with 9B tokens. We analyze our recipe with extensive experiments and demonstrate it efficacy on diverse settings. Our code is available at https://github.com/sanyalsunny111/LLM-Inheritune.


title: Transport properties in non-Fermi liquid phases of nodal-point semimetals

abstract: In this review, we survey the current progress in computing transport properties in semimetals which harbour non-Fermi liquid phases. We first discuss the widely used Kubo formalism, which can be applied to the effective theory describing the stable non-Fermi liquid pase obtained via a renormalization group procedure and, hence, is applicable for temperatures close to zero (e.g., optical conductivity). For finite temperature regimes, which apply to the computations of the generalized dc conductivity tensors, we elucidate the memory matrix approach. This approach is based on an effective hydrodynamic description of the system, and is especially suited for tackling transport calculations in strongly-interacting quantum field theories, because it does not rely on the existence of long-lived quasiparticles. As a concrete example, we apply these two approaches to find the response of the so-called Luttinger-Abrikosov-Benelavskii phase of isotropic three-dimensional Luttinger semimetals, which arise under the effects of long-ranged (unscreened) Coulomb interactions, with the chemical potential fine-tuned to cut exactly the nodal point. In particular, we focus on the electric conductivity tensors, thermal and thermoelectric response, Raman response, free energy, entropy density, and shear viscosity.

categories: cond-mat.str-el cond-mat.dis-nn cond-mat.mes-hall hep-th


title: Probing the 3D Awareness of Visual Foundation Models

abstract: Recent advances in large-scale pretraining have yielded visual foundation models with strong capabilities. Not only can recent models generalize to arbitrary images for their training task, their intermediate representations are useful for other visual tasks such as detection and segmentation. Given that such models can classify, delineate, and localize objects in 2D, we ask whether they also represent their 3D structure? In this work, we analyze the 3D awareness of visual foundation models. We posit that 3D awareness implies that representations (1) encode the 3D structure of the scene and (2) consistently represent the surface across views. We conduct a series of experiments using task-specific probes and zero-shot inference procedures on frozen features. Our experiments reveal several limitations of the current models. Our code and analysis can be found at https://github.com/mbanani/probe3d.


title: Optimal Slicing and Scheduling with Service Guarantees in Multi-Hop Wireless Networks

abstract: We analyze the problem of scheduling in wireless networks to meet end-to-end service guarantees. Using network slicing to decouple the queueing dynamics between flows, we show that the network's ability to meet hard throughput and deadline requirements is largely influenced by the scheduling policy. We characterize the feasible throughput/deadline region for a flow under a fixed route and set of slices, and find throughput- and deadline-optimal policies for a solitary flow. We formulate the feasibility problem for multiple flows in a general topology as a mixed-integer program, and show that it grows exponentially in the size of the network. Drawing on results from the solitary flow setting, we show that scheduling links in a regular fashion leads to smaller delay, and we derive tighter upper bounds on end-to-end delay for regular schedules. Finally, we design a polynomial-time algorithm that returns an (almost) regular schedule, optimized to meet service guarantees for all flows.


title: Age of Information Optimization and State Error Analysis for Correlated Multi-Process Multi-Sensor Systems

abstract: In this paper, we examine a multi-sensor system where each sensor may monitor more than one time-varying information process and send status updates to a remote monitor over a common channel. We consider that each sensor's status update may contain information about more than one information process in the system subject to the system's constraints. To investigate the impact of this correlation on the overall system's performance, we conduct an analysis of both the average Age of Information (AoI) and source state estimation error at the monitor. Building upon this analysis, we subsequently explore the impact of the packet arrivals, correlation probabilities, and rate of processes' state change on the system's performance. Next, we consider the case where sensors have limited sensing abilities and distribute a portion of their sensing abilities across the different processes. We optimize this distribution to minimize the total AoI of the system. Interestingly, we show that monitoring multiple processes from a single source may not always be beneficial. Our results also reveal that the optimal sensing distribution for diverse arrival rates may exhibit a rapid regime switch, rather than smooth transitions, after crossing critical system values. This highlights the importance of identifying these critical thresholds to ensure effective system performance.


title: COCONut: Modernizing COCO Segmentation

abstract: In recent decades, the vision community has witnessed remarkable progress in visual recognition, partially owing to advancements in dataset benchmarks. Notably, the established COCO benchmark has propelled the development of modern detection and segmentation systems. However, the COCO segmentation benchmark has seen comparatively slow improvement over the last decade. Originally equipped with coarse polygon annotations for thing instances, it gradually incorporated coarse superpixel annotations for stuff regions, which were subsequently heuristically amalgamated to yield panoptic segmentation annotations. These annotations, executed by different groups of raters, have resulted not only in coarse segmentation masks but also in inconsistencies between segmentation types. In this study, we undertake a comprehensive reevaluation of the COCO segmentation annotations. By enhancing the annotation quality and expanding the dataset to encompass 383K images with more than 5.18M panoptic masks, we introduce COCONut, the COCO Next Universal segmenTation dataset. COCONut harmonizes segmentation annotations across semantic, instance, and panoptic segmentation with meticulously crafted high-quality masks, and establishes a robust benchmark for all segmentation tasks. To our knowledge, COCONut stands as the inaugural large-scale universal segmentation dataset, verified by human raters. We anticipate that the release of COCONut will significantly contribute to the community's ability to assess the progress of novel neural networks.


title: EventEgo3D: 3D Human Motion Capture from Egocentric Event Streams

abstract: Monocular egocentric 3D human motion capture is a challenging and actively researched problem. Existing methods use synchronously operating visual sensors (e.g. RGB cameras) and often fail under low lighting and fast motions, which can be restricting in many applications involving head-mounted devices. In response to the existing limitations, this paper 1) introduces a new problem, i.e., 3D human motion capture from an egocentric monocular event camera with a fisheye lens, and 2) proposes the first approach to it called EventEgo3D (EE3D). Event streams have high temporal resolution and provide reliable cues for 3D human motion capture under high-speed human motions and rapidly changing illumination. The proposed EE3D framework is specifically tailored for learning with event streams in the LNES representation, enabling high 3D reconstruction accuracy. We also design a prototype of a mobile head-mounted device with an event camera and record a real dataset with event observations and the ground-truth 3D human poses (in addition to the synthetic dataset). Our EE3D demonstrates robustness and superior 3D accuracy compared to existing solutions across various challenging experiments while supporting real-time 3D pose update rates of 140Hz.


title: A new SU(2/1) supergroup with determinant 1 explains many mysteries of the weak interactions

abstract: Taken as a classification paradigm completing the standard model, a new compact form of the SU(2/1) supergroup explains many mysterious properties of the weak interactions: the maximal breaking of parity, the fractional charges of the quarks, the cancellation of the quantum field theory anomalies, and ties together the existence of the right neutrinos and of the heavier Fermions. This compact supergroup is constructed by exponentiating the matrices representing the leptons and the quarks which form a semi-direct sum of Kac modules of the real superalgebra su(2/1,R) such that the overall trace of the $U(1)$ weak-hypercharge $Y$ vanishes. Remarkably, all the elements of this supergroup have Berezinian 1 and determinant 1. In practice, $Tr(Y)=0$ simply means that the electric charge of the hydrogen atom is zero.


title: Integrating Multi -WAN, VPN and IEEE 802.3ad for Advanced IPSEC

abstract: Since the emergence of the internet, IPSEC has undergone significant changes due to changes in the type and behavior of users worldwide. IEEE 802.3ad, while considered a key aspect of the IPSEC model, is predictable and can result in potential design flaws, making it relatively easy to access a secure workstation. Thus, it is critical to leverage the benefits of multiple ISPs (multi-WAN) and a link aggregation model and integrate an aspect of randomisation in the network. This facet of the network is highlighted by the proof of concept in the simulation of a double pendulum. The analysis of POC provided a network topology designed to utilize multiple WAN, 802.3ad link aggregation, and other environmental components to create a sense of true randomness within a network system. An analysis of this approach shows that it accounts for the data stream's size, transmission speed, WANs and VPNs' location, and other environmental factors to create a sense of randomness. Based on the proof concept, it can be concluded that attaining randomisation using multi-WAN, VPN, and 802.3ad is a highly effective model for improving IPSEC.


title: 6AInets: Harnessing artificial intelligence for the 6G network security: Impacts and Challenges

abstract: This decade has witnessed the initiation of the digital revolution, as anticipated with the advent of 5G networks. Looking ahead to the 6G communication era, considerations are being made regarding how individuals will engage with the digital virtual world. The design of 6G technology, which will present enormous opportunities to develop and enhance human potential, will have a major impact on communications in the 2030s. We believe that in 6G we will see an unprecedented transformation that will set it apart from earlier wireless cellular network generations. Specifically, 6G will leverage ubiquitous AI services ranging from the network's core to its end devices, going beyond unpredictable limits. Despite the numerous advantages offered by 6G over existing technologies, there remains a pressing need to address security concerns. For example, the automation of critical processes in the 6G infrastructure will lead to a significantly broader and more intricate attack surface. Thus, the significance of Artificial Intelligence (AI) in providing security aspects within the envisioned 6G paradigm is substantial, but its integration presents a dual-edged dynamic. Therefore, to strengthen and validate the relevance of AI in securing 6G networks, this article elucidates how AI can be strategically used in 6G security, addressing potential challenges, and proposing solutions to enhance its role in securing networks.


title: RIS Assisted Wireless Networks: Collaborative Regulation, Deployment Mode and Field Testing

abstract: In recent years, RIS has made significant progress in engineering application research and industrialization and academic research. However, the engineering application research field of RIS still faces several challenges. This article analyzes and discusses the two deployment modes of RIs-assisted wireless networks: Network Controlled Mode and Standalone mode. It also presents three typical collaboration scenarios of RIS networks, including multi-RIS collaboration, multi-user access, and multi-cell coordination, which reflect the differences between the two deployment modes of RIS. The article proposes collaborative regulation mechanisms for RIS and analyzes their applications in the two network deployment modes in-depth. Furthermore, the article establishes simulation models of three scenarios and provides rich numerical simulation results. An actual field test environment was also built, where a specially designed and processed RIS prototype was used for preliminary field test and verification. Finally, this article puts forward future trends and challenges.


title: Implementation of a Low-Cost, Distributed, Absolute Time Reference in an application dedicated to damage detection

abstract: Typical structural health monitoring configuration implies sensors and supervisor installations connected by electric cable for communication. As done in other wireless projects, this one aim at reducing installation and maintenance costsby designing a wireless sensor network. One of the problem when designing wireless sensors, is data tagging: an event has to be correctly dated by many sensors. This problem increases when a precise time stamping is required. What distinguishes this project is the implementation of algorithms that allows precise time stamping by the use of a standard protocol and the separation between measurements operations and communication task in order to make modular sensors.


title: A simple proof of Werner Schulte's conjecture

abstract: Lately, Werner Schulte has conjectured that for all positive $n>1$, $n$ divides $\frac{(n-2)! (n-1)!}{2^{n-3}} + 4$ if and only if $n$ is prime. In this paper, We use elementary methods, to give a simple proof of this conjecture.


title: A simple mathematical theory for Simple Volatile Memristors and their spiking circuits

abstract: In pursuit of neuromorphic (brain-inspired) devices, memristors (memory-resistors) have emerged as promising candidates for emulating neuronal circuitry. Here we mathematically define a class of Simple Volatile Memristors (SVMs), which notably includes various fluidic iontronic devices that have recently garnered significant interest due to their unique quality of operating within the same medium as the brain. We show that symmetric SVMs produce non self-crossing current-voltage hysteresis loops, while simple asymmetric SVMs produce self-crossing loops. Additionally, we derive a general expression for the enclosed area in a loop, providing a relation between the voltage frequency and the SVM memory timescale. These general results are shown to materialise in physical finite-element calculations of microfluidic memristors. An SVM-based circuit has been proposed that exhibits all-or-none and tonic neuronal spiking. We generalise and analyse this spiking circuit, characterising it as a two-dimensional dynamical system. Additionally, we demonstrate that stochastic effects can induce novel neuronal firing modes absent in the deterministic case. Through our analysis, the circuit dynamics are well understood, while retaining its explicit link with the physically plausible underlying system.


title: Software-defined optical networking applications enabled by programmable integrated photonics

abstract: Data center networks are experiencing unprecedented exponential growth, mostly driven by the continuous computing demands in machine learning and artificial intelligence algorithms. Within this realm, optical networking offers numerous advantages, including low latency, energy efficiency, and bandwidth transparency, positioning it as a compelling alternative to its electronic counterparts. In this work, we showcase a range of software-defined optical networking applications deployed on a general-purpose programmable integrated photonic processor. Leveraging graph-based theory, we experimentally demonstrate dynamic optical interconnects, circuit switching, and multicasting on the same photonic platform, yielding remarkable results in terms of crosstalk and reconfiguration speed. Our approach harnesses the benefits of reconfigurability and reliability, paving the way for a new generation of high-performance optical devices tailored for data center and computing clusters.


title: Note: Applying the Brillouin Zone and Band Gap Leveraging AB Initio Calculation for Digital Well-Being: In-Depth Analysis of Band Structures in Information Spaces Insights from Solid-State Physics

abstract: The efforts of this Note are aimed at understanding various phenomena in digital space that are incomplete and difficult to define, and to translate them into language from research fields that are based on existing large-scale experimental data. Information diffusion and user behavior patterns in digital space are often hard to intuitively capture, and the principles and mechanisms behind them are difficult to articulate. To address this challenge, we have drawn on first-principles methods in physics, particularly solid state physics. This approach is known to be effective in analyzing the behavior of real physical materials at the atomic level and in understanding the electronic properties and bonding structures of materials. We have attempted to apply physical concepts based on first-principles calculations, in particular concepts such as first Brillouin zones, band gaps, and reciprocal lattice vectors, to digital space as a metaphor. This theoretical framework allows us to quantitatively and logically infer the behavior and trends of incomplete and ambiguous digital data and phenomena. For example, the "first Brillouin zone" of information in digital media indicates the potential sphere of influence of that information, and the band gap defines the threshold of influence for the information to be widely accepted. In addition, the reciprocal lattice vector serves as a boundary that indicates the limits of information characteristics and is an indicator of the degree to which a particular piece of information resonates with users. With this theoretical supplement, our research goes beyond the mere analysis of phenomena in the digital space and provides new methods for understanding and predicting the behavior of imperfect data and uncertain digital media.


title: QSPR Analysis with Curvilinear Regression Modeling and Temperature-based Topological Indices

abstract: Establishing quantitative correlations between various molecular properties and chemical structures is of great technological importance for environmental and medical aspects. These approaches are referred to as Quantitative Structure-Property Relationships (QSPR), which relate the physicochemical or thermodynamic properties of compounds to their structures. The main goal of QSPR studies is to find a mathematical relationship between the property of interest and several molecular descriptors derived from the structure of the molecule. Topological indices are the molecular descriptors that characterize the formation of chemical compounds and predict certain physicochemical properties. In this study, the QSPR models are designed using certain temperature-based topological indices such as the sum connectivity temperature index, product connectivity temperature index, F-temperature index, and symmetric division temperature index to predict the thermodynamic properties, such as enthalpies of formation ($\Delta H^{0}_{f}$ \hspace{1mm} liquid), enthalpies of combustion ($\Delta H^{0}_{C}$ \hspace{1mm} liquid), and enthalpies of vaporization ($\Delta H^{0}_{vap}$ \hspace{1mm} gas) of monocarboxylic acids ($C_2H_{4}O_{2}$ - $C_{20}H_{40}O_{2}$). The relationship analysis between thermodynamic properties and topological indices is done using linear, quadratic, and cubic equations of a curvilinear regression model. These regression models are then compared.


title: Analysis of growth of silicon thin films on textured and non-textured surface

abstract: Hydrogenated amorphous silicon alloy films are generally deposited by radio frequency plasma enhanced chemical vapor deposition (RF PECVD) technique on various types of substrates. Generally it is assumed that film quality remains unchanged when deposited on textured or non-textured substrates. Here we analyzed the difference in growth of thin film silicon layers when deposited in a textured and a non-textured surface. In this investigation characteristics of two solar cells were compared, where one cell was prepared on a textured surface ( Cell-A) while the other prepared on a non-textured surface (Cell-B). Defect analysis of the devices were carried out by simulation and device modeling. It shows that the intrinsic film deposited on a textured surface was more defective ($2.4\times 10^{17}$ cm$^{-3}$) than that deposited on a flat surface ($3.2\times 10^{16}$ cm$^{-3}$). Although the primary differences in these two cells were thickness of the active layer and nature of surface texturing, the simulation results show that thin film deposited on a textured surface may acquire an increased defect density than that deposited on a flat surface. Lower effective flux density of $SiH_{3}$ precursors on the textured surface can be one of the reasons for higher defect density in the film deposited on textured surface. An Improved light coupling can be achieved by using a thinner doped window layer. By changing the thickness from 15 nm to 3 nm, the short circuit current density increased from 16.4 mA/cm$^{2}$ to 20.96 mA/cm$^{2}$ and efficiency increased from $9.4\%$ to $12.32\%$.


title: Algorithm for AGC index management against crowded radio environment

abstract: This paper describes a receiver that uses an innovative method to predict, according to history of receiver operating metrics (packet lost/well received), the optimum automatic gain control (AGC) index or most appropriate variable gain range to be used for next packet reception, anticipating an interferer appearing during the payload reception. This allows the receiver to have higher immunity to interferers even if they occur during the gain frozen payload reception period whilst still ensuring an optimum sensitivity level. As a result, the method allows setting the receiver gain to get an optimum trade-off between reception sensitivity and random interferer immunity.


title: Machine-Learning Based Selection and Synthesis of Candidate Metal-Insulator Transition Metal Oxides

abstract: The discovery of materials that exhibit a metal-insulator transition (MIT) is key to the development of multiple types of novel efficient microelectronic and optoelectronic devices. However, identifying MIT materials is challenging due to a combination of high computational cost of electronic structure calculations needed to understand their mechanism, the mechanisms' complexity, and the labor-intensive experimental validation process. To that end, we use a machine learning classification model to rapidly screen a high-throughput crystal structure database to identify candidate compounds exhibiting thermally-driven MITs. We focus on three candidate oxides, Ca$_2$Fe$_3$O$_8$, CaCo$_2$O$_4$, and CaMn$_2$O$_4$, and identify their MIT mechanism using high-fidelity density functional theory calculations. Then, we provide a probabilistic estimate of which synthesis reactions may lead to their realization. Our approach couples physics-informed machine learning, density functional theory calculations, and machine learning-suggested synthesis to reduce the time to discovery and synthesis of new technologically relevant materials.


title: Optimal path for Biomedical Text Summarization Using Pointer GPT

abstract: Biomedical text summarization is a critical tool that enables clinicians to effectively ascertain patient status. Traditionally, text summarization has been accomplished with transformer models, which are capable of compressing long documents into brief summaries. However, transformer models are known to be among the most challenging natural language processing (NLP) tasks. Specifically, GPT models have a tendency to generate factual errors, lack context, and oversimplify words. To address these limitations, we replaced the attention mechanism in the GPT model with a pointer network. This modification was designed to preserve the core values of the original text during the summarization process. The effectiveness of the Pointer-GPT model was evaluated using the ROUGE score. The results demonstrated that Pointer-GPT outperformed the original GPT model. These findings suggest that pointer networks can be a valuable addition to EMR systems and can provide clinicians with more accurate and informative summaries of patient medical records. This research has the potential to usher in a new paradigm in EMR systems and to revolutionize the way that clinicians interact with patient medical records.


title: Transformer-based Joint Modelling for Automatic Essay Scoring and Off-Topic Detection

abstract: Automated Essay Scoring (AES) systems are widely popular in the market as they constitute a cost-effective and time-effective option for grading systems. Nevertheless, many studies have demonstrated that the AES system fails to assign lower grades to irrelevant responses. Thus, detecting the off-topic response in automated essay scoring is crucial in practical tasks where candidates write unrelated text responses to the given task in the question. In this paper, we are proposing an unsupervised technique that jointly scores essays and detects off-topic essays. The proposed Automated Open Essay Scoring (AOES) model uses a novel topic regularization module (TRM), which can be attached on top of a transformer model, and is trained using a proposed hybrid loss function. After training, the AOES model is further used to calculate the Mahalanobis distance score for off-topic essay detection. Our proposed method outperforms the baseline we created and earlier conventional methods on two essay-scoring datasets in off-topic detection as well as on-topic scoring. Experimental evaluation results on different adversarial strategies also show how the suggested method is robust for detecting possible human-level perturbations.


title: Linear Cross-document Event Coreference Resolution with X-AMR

abstract: Event Coreference Resolution (ECR) as a pairwise mention classification task is expensive both for automated systems and manual annotations. The task's quadratic difficulty is exacerbated when using Large Language Models (LLMs), making prompt engineering for ECR prohibitively costly. In this work, we propose a graphical representation of events, X-AMR, anchored around individual mentions using a \textbf{cross}-document version of \textbf{A}bstract \textbf{M}eaning \textbf{R}epresentation. We then linearize the ECR with a novel multi-hop coreference algorithm over the event graphs. The event graphs simplify ECR, making it a) LLM cost-effective, b) compositional and interpretable, and c) easily annotated. For a fair assessment, we first enrich an existing ECR benchmark dataset with these event graphs using an annotator-friendly tool we introduce. Then, we employ GPT-4, the newest LLM by OpenAI, for these annotations. Finally, using the ECR algorithm, we assess GPT-4 against humans and analyze its limitations. Through this research, we aim to advance the state-of-the-art for efficient ECR and shed light on the potential shortcomings of current LLMs at this task. Code and annotations: \url{https://github.com/ahmeshaf/gpt_coref}


title: Advancing Extrapolative Predictions of Material Properties through Learning to Learn

abstract: Recent advancements in machine learning have showcased its potential to significantly accelerate the discovery of new materials. Central to this progress is the development of rapidly computable property predictors, enabling the identification of novel materials with desired properties from vast material spaces. However, the limited availability of data resources poses a significant challenge in data-driven materials research, particularly hindering the exploration of innovative materials beyond the boundaries of existing data. While machine learning predictors are inherently interpolative, establishing a general methodology to create an extrapolative predictor remains a fundamental challenge, limiting the search for innovative materials beyond existing data boundaries. In this study, we leverage an attention-based architecture of neural networks and meta-learning algorithms to acquire extrapolative generalization capability. The meta-learners, experienced repeatedly with arbitrarily generated extrapolative tasks, can acquire outstanding generalization capability in unexplored material spaces. Through the tasks of predicting the physical properties of polymeric materials and hybrid organic--inorganic perovskites, we highlight the potential of such extrapolatively trained models, particularly with their ability to rapidly adapt to unseen material domains in transfer learning scenarios.


title: Coupling Phase Field Crystal and Field Dislocation Mechanics for a consistent description of dislocation structure and elasticity

abstract: This work addresses differences in predicted elastic fields created by dislocations either by the Phase Field Crystal (PFC) model, or by static Field Dislocation Mechanics (FDM). The PFC order parameter describes the topological content of the lattice, but it fails to correctly capture the elastic distortion. In contrast, static FDM correctly captures the latter but requires input about defect cores. The case of a dislocation dipole in two dimensional, isotropic, elastic medium is studied, and a weak coupling is introduced between the two models. The PFC model produces compact and stable dislocation cores, free of any singularity, i.e., diffuse. The PFC predicted dislocation density field (a measure of the topological defect content) is used as the source (input) for the static FDM problem. This coupling allows a critical analysis of the relative role played by configurational (from PFC) and elastic (from static FDM) fields in the theory, and of the consequences of the lack of elastic relaxation in the diffusive evolution of the PFC order parameter.


title: Field method approach in the factorization of nonlinear second order differential equations

abstract: In this paper, the general solution of second-order nonlinear differential equations of Lienard type is obtained within the nonlinear factorization method of Rosu and Cornejo-Perez by the so-called field method approach. This method is based on writing the factorization conditions in the dynamical systems form and requires to assume that the intermediate function Phi that occurs in the factorization be dependent not only on the dependent variable of the nonlinear equation, but also on the independent variable. The method is applied to several cases of Lienard type equations which are written in a commutative factorization form and their general solutions are obtained by solving Bernoulli differential equations.


title: How Does Message Passing Improve Collaborative Filtering?

abstract: Collaborative filtering (CF) has exhibited prominent results for recommender systems and been broadly utilized for real-world applications. A branch of research enhances CF methods by message passing used in graph neural networks, due to its strong capabilities of extracting knowledge from graph-structured data, like user-item bipartite graphs that naturally exist in CF. They assume that message passing helps CF methods in a manner akin to its benefits for graph-based learning tasks in general. However, even though message passing empirically improves CF, whether or not this assumption is correct still needs verification. To address this gap, we formally investigate why message passing helps CF from multiple perspectives and show that many assumptions made by previous works are not entirely accurate. With our curated ablation studies and theoretical analyses, we discover that (1) message passing improves the CF performance primarily by additional representations passed from neighbors during the forward pass instead of additional gradient updates to neighbor representations during the model back-propagation and (ii) message passing usually helps low-degree nodes more than high-degree nodes. Utilizing these novel findings, we present Test-time Aggregation for CF, namely TAG-CF, a test-time augmentation framework that only conducts message passing once at inference time. The key novelty of TAG-CF is that it effectively utilizes graph knowledge while circumventing most of notorious computational overheads of message passing. Besides, TAG-CF is extremely versatile can be used as a plug-and-play module to enhance representations trained by different CF supervision signals. Evaluated on six datasets, TAG-CF consistently improves the recommendation performance of CF methods without graph by up to 39.2% on cold users and 31.7% on all users, with little to no extra computational overheads.


title: The Comparison of Translationese in Machine Translation and Human Transation in terms of Translation Relations

abstract: This study explores the distinctions between neural machine translation (NMT) and human translation (HT) through the lens of translation relations. It benchmarks HT to assess the translation techniques produced by an NMT system and aims to address three key research questions: the differences in overall translation relations between NMT and HT, how each utilizes non-literal translation techniques, and the variations in factors influencing their use of specific non-literal techniques. The research employs two parallel corpora, each spanning nine genres with the same source texts with one translated by NMT and the other by humans. Translation relations in these corpora are manually annotated on aligned pairs, enabling a comparative analysis that draws on linguistic insights, including semantic and syntactic nuances such as hypernyms and alterations in part-of-speech tagging. The results indicate that NMT relies on literal translation significantly more than HT across genres. While NMT performs comparably to HT in employing syntactic non-literal translation techniques, it falls behind in semantic-level performance.


title: FewUser: Few-Shot Social User Geolocation via Contrastive Learning

abstract: To address the challenges of scarcity in geotagged data for social user geolocation, we propose FewUser, a novel framework for Few-shot social User geolocation. We incorporate a contrastive learning strategy between users and locations to improve geolocation performance with no or limited training data. FewUser features a user representation module that harnesses a pre-trained language model (PLM) and a user encoder to process and fuse diverse social media inputs effectively. To bridge the gap between PLM's knowledge and geographical data, we introduce a geographical prompting module with hard, soft, and semi-soft prompts, to enhance the encoding of location information. Contrastive learning is implemented through a contrastive loss and a matching loss, complemented by a hard negative mining strategy to refine the learning process. We construct two datasets TwiU and FliU, containing richer metadata than existing benchmarks, to evaluate FewUser and the extensive experiments demonstrate that FewUser significantly outperforms state-of-the-art methods in both zero-shot and various few-shot settings, achieving absolute improvements of 26.95\% and \textbf{41.62\%} on TwiU and FliU, respectively, with only one training sample per class. We further conduct a comprehensive analysis to investigate the impact of user representation on geolocation performance and the effectiveness of FewUser's components, offering valuable insights for future research in this area.


title: Assessing wind energy's potential for Kentucky

abstract: Recently, there has been a push by countries to diversify their energy mix considering various factors. In this regard, there have been several studies conducted to assess the potential for using sources such as wind and solar to generate supplemental energy to the already present energy generation setup. In this regard, this study explores the potential of wind for the Commonwealth of Kentucky. To perform this study, wind data was sourced for eight locations across Kentucky from the publicly accessible wind speed information present at Weatherunderground for the years 2020-2021. An analysis was performed concerning the seasonal, monthly and hourly variation in the wind speed so as to identify the expected times of sufficient wind energy generation. Moreover, a comparison of the collected data was performed with data from a home-based weather station and a deployed wind turbine as well to validate the variation pattern of the publicly sourced data. Finally, in order to investigate the variation patterns of wind and solar energy sources, a comparative analysis was also performed using data from a solar power generation plant in Kentucky. It was observed that a seasonal and monthly complemetarity was observed between the wind and solar. However, when considering daily patterns, the wind was found to follow solar generation with an offset. While further research is required, this analysis indicates that it is possible to deploy wind energy power generation projects in the Commonwealth of Kentucky. The seasonal complementary behavior of wind and solar can be used along with battery storage in conjunction with natural gas to provide a diversified electricity generation portfolio.


title: Identifying Banking Transaction Descriptions via Support Vector Machine Short-Text Classification Based on a Specialized Labelled Corpus

abstract: Short texts are omnipresent in real-time news, social network commentaries, etc. Traditional text representation methods have been successfully applied to self-contained documents of medium size. However, information in short texts is often insufficient, due, for example, to the use of mnemonics, which makes them hard to classify. Therefore, the particularities of specific domains must be exploited. In this article we describe a novel system that combines Natural Language Processing techniques with Machine Learning algorithms to classify banking transaction descriptions for personal finance management, a problem that was not previously considered in the literature. We trained and tested that system on a labelled dataset with real customer transactions that will be available to other researchers on request. Motivated by existing solutions in spam detection, we also propose a short text similarity detector to reduce training set size based on the Jaccard distance. Experimental results with a two-stage classifier combining this detector with a SVM indicate a high accuracy in comparison with alternative approaches, taking into account complexity and computing time. Finally, we present a use case with a personal finance application, CoinScrap, which is available at Google Play and App Store.


title: Targeted aspect-based emotion analysis to detect opportunities and precaution in financial Twitter messages

abstract: Microblogging platforms, of which Twitter is a representative example, are valuable information sources for market screening and financial models. In them, users voluntarily provide relevant information, including educated knowledge on investments, reacting to the state of the stock markets in real-time and, often, influencing this state. We are interested in the user forecasts in financial, social media messages expressing opportunities and precautions about assets. We propose a novel Targeted Aspect-Based Emotion Analysis (TABEA) system that can individually discern the financial emotions (positive and negative forecasts) on the different stock market assets in the same tweet (instead of making an overall guess about that whole tweet). It is based on Natural Language Processing (NLP) techniques and Machine Learning streaming algorithms. The system comprises a constituency parsing module for parsing the tweets and splitting them into simpler declarative clauses; an offline data processing module to engineer textual, numerical and categorical features and analyse and select them based on their relevance; and a stream classification module to continuously process tweets on-the-fly. Experimental results on a labelled data set endorse our solution. It achieves over 90% precision for the target emotions, financial opportunity, and precaution on Twitter. To the best of our knowledge, no prior work in the literature has addressed this problem despite its practical interest in decision-making, and we are not aware of any previous NLP nor online Machine Learning approaches to TABEA.


title: Revealing Trends in Datasets from the 2022 ACL and EMNLP Conferences

abstract: Natural language processing (NLP) has grown significantly since the advent of the Transformer architecture. Transformers have given birth to pre-trained large language models (PLMs). There has been tremendous improvement in the performance of NLP systems across several tasks. NLP systems are on par or, in some cases, better than humans at accomplishing specific tasks. However, it remains the norm that \emph{better quality datasets at the time of pretraining enable PLMs to achieve better performance, regardless of the task.} The need to have quality datasets has prompted NLP researchers to continue creating new datasets to satisfy particular needs. For example, the two top NLP conferences, ACL and EMNLP, accepted ninety-two papers in 2022, introducing new datasets. This work aims to uncover the trends and insights mined within these datasets. Moreover, we provide valuable suggestions to researchers interested in curating datasets in the future.


title: Traffic State Estimation and Uncertainty Quantification at Signalized Intersections with Low Penetration Rate Vehicle Trajectory Data

abstract: This paper studies the traffic state estimation problem at signalized intersections with low penetration rate vehicle trajectory data. While many existing studies have proposed different methods to estimate unknown traffic states and parameters (e.g., penetration rate, queue length) with this data, most of them only provide a point estimation without knowing the uncertainty of these estimated values. It is important to quantify the estimation uncertainty caused by limited available data since it can explicitly inform us whether the available data is sufficient to satisfy the desired estimation accuracy. To fill this gap, we formulate the partially observable system as a hidden Markov model (HMM) based on the recently developed probabilistic time-space (PTS) model. The PTS model is a stochastic traffic flow model that is designed for modeling traffic flow dynamics near signalized intersections. Based on the HMM formulation, a single recursive program is developed for the Bayesian estimation of both traffic states and parameters. As a Bayesian approach, the proposed method provides the distributional estimation outcomes and directly quantifies the estimation uncertainty. We validate the proposed method with simulation studies and showcase its applicability to real-world vehicle trajectory data.


title: A Comprehensive Survey on AI-based Methods for Patents

abstract: Recent advancements in Artificial Intelligence (AI) and machine learning have demonstrated transformative capabilities across diverse domains. This progress extends to the field of patent analysis and innovation, where AI-based tools present opportunities to streamline and enhance important tasks in the patent cycle such as classification, retrieval, and valuation prediction. This not only accelerates the efficiency of patent researchers and applicants but also opens new avenues for technological innovation and discovery. Our survey provides a comprehensive summary of recent AI tools in patent analysis from more than 40 papers from 26 venues between 2017 and 2023. Unlike existing surveys, we include methods that work for patent image and text data. Furthermore, we introduce a novel taxonomy for the categorization based on the tasks in the patent life cycle as well as the specifics of the AI methods. This interdisciplinary survey aims to serve as a resource for researchers and practitioners who are working at the intersection of AI and patent analysis as well as the patent offices that are aiming to build efficient patent systems.


title: Combining PatternRank with Huffman Coding: A Novel Compression Algorithm

abstract: The escalating volume of data involved in Android backup packages necessitates an innovative approach to compression beyond traditional methods like GZIP, which may not fully exploit the redundancy inherent in Android backups, particularly those containing extensive XML data. This paper introduces the PatternRank algorithm, a novel compression strategy specifically designed for Android backups. PatternRank leverages pattern recognition and ranking, combined with Huffman coding, to efficiently compress data by identifying and replacing frequent, longer patterns with shorter codes. We detail two versions of the PatternRank algorithm: the original version focuses on dynamic pattern extraction and ranking, while the second version incorporates a pre-defined dictionary optimized for the common patterns found in Android backups, particularly within XML files. This tailored approach ensures that PatternRank not only outperforms traditional compression methods in terms of compression ratio and speed but also remains highly effective when dealing with the specific challenges posed by Android backup data. Our analysis includes a comparative study of compression performance across GZIP, PatternRank v1, PatternRank v2, and a combined PatternRank-Huffman method, highlighting the superior efficiency and potential of PatternRank in managing the growing data demands of Android backup packages. Through this exploration, we underscore the significance of adopting pattern-based compression algorithms in optimizing data storage and transmission in the mobile domain.


title: A Bayesian Regression Approach for Estimating the Impact of COVID-19 on Consumer Behavior in the Restaurant Industry

abstract: The COVID-19 pandemic has had a long-term impact on industries worldwide, with the hospitality and food industry facing significant challenges, leading to the permanent closure of many restaurants and the loss of jobs. In this study, we developed an innovative analytical framework using Hamiltonian Monte Carlo for predictive modeling with Bayesian regression, aiming to estimate the change point in consumer behavior towards different types of restaurants due to COVID-19. Our approach emphasizes a novel method in computational analysis, providing insights into customer behavior changes before and after the pandemic. This research contributes to understanding the effects of COVID-19 on the restaurant industry and is valuable for restaurant owners and policymakers.


title: Navigating the Evaluation Funnel to Optimize Iteration Speed for Recommender Systems

abstract: Over the last decades has emerged a rich literature on the evaluation of recommendation systems. However, less is written about how to efficiently combine different evaluation methods from this rich field into a single efficient evaluation funnel. In this paper we aim to build intuition for how to choose evaluation methods, by presenting a novel framework that simplifies the reasoning around the evaluation funnel for a recommendation system. Our contribution is twofold. First we present our framework for how to decompose the definition of success to construct efficient evaluation funnels, focusing on how to identify and discard non-successful iterations quickly. We show that decomposing the definition of success into smaller necessary criteria for success enables early identification of non-successful ideas. Second, we give an overview of the most common and useful evaluation methods, discuss their pros and cons, and how they fit into, and complement each other in, the evaluation process. We go through so-called offline and online evaluation methods such as counterfactual logging, validation, verification, A/B testing, and interleaving. The paper concludes with some general discussion and advice on how to design an efficient evaluation process for recommender systems.


title: Taxonomy and Analysis of Sensitive User Queries in Generative AI Search

abstract: Although there has been a growing interest among industries to integrate generative LLMs into their services, limited experiences and scarcity of resources acts as a barrier in launching and servicing large-scale LLM-based conversational services. In this paper, we share our experiences in developing and operating generative AI models within a national-scale search engine, with a specific focus on the sensitiveness of user queries. We propose a taxonomy for sensitive search queries, outline our approaches, and present a comprehensive analysis report on sensitive queries from actual users.


title: Sentiment analysis and random forest to classify LLM versus human source applied to Scientific Texts

abstract: After the launch of ChatGPT v.4 there has been a global vivid discussion on the ability of this artificial intelligence powered platform and some other similar ones for the automatic production of all kinds of texts, including scientific and technical texts. This has triggered a reflection in many institutions on whether education and academic procedures should be adapted to the fact that in future many texts we read will not be written by humans (students, scholars, etc.), at least, not entirely. In this work it is proposed a new methodology to classify texts coming from an automatic text production engine or a human, based on Sentiment Analysis as a source for feature engineering independent variables and then train with them a Random Forest classification algorithm. Using four different sentiment lexicons, a number of new features where produced, and then fed to a machine learning random forest methodology, to train such a model. Results seem very convincing that this may be a promising research line to detect fraud, in such environments where human are supposed to be the source of texts.


title: Effects of Different Prompts on the Quality of GPT-4 Responses to Dementia Care Questions

abstract: Evidence suggests that different prompts lead large language models (LLMs) to generate responses with varying quality. Yet, little is known about prompts' effects on response quality in healthcare domains. In this exploratory study, we address this gap, focusing on a specific healthcare domain: dementia caregiving. We first developed an innovative prompt template with three components: (1) system prompts (SPs) featuring 4 different roles; (2) an initialization prompt; and (3) task prompts (TPs) specifying different levels of details, totaling 12 prompt combinations. Next, we selected 3 social media posts containing complicated, real-world questions about dementia caregivers' challenges in 3 areas: memory loss and confusion, aggression, and driving. We then entered these posts into GPT-4, with our 12 prompts, to generate 12 responses per post, totaling 36 responses. We compared the word count of the 36 responses to explore potential differences in response length. Two experienced dementia care clinicians on our team assessed the response quality using a rating scale with 5 quality indicators: factual, interpretation, application, synthesis, and comprehensiveness (scoring range: 0-5; higher scores indicate higher quality).


title: RecGPT: Generative Personalized Prompts for Sequential Recommendation via ChatGPT Training Paradigm

abstract: ChatGPT has achieved remarkable success in natural language understanding. Considering that recommendation is indeed a conversation between users and the system with items as words, which has similar underlying pattern with ChatGPT, we design a new chat framework in item index level for the recommendation task. Our novelty mainly contains three parts: model, training and inference. For the model part, we adopt Generative Pre-training Transformer (GPT) as the sequential recommendation model and design a user modular to capture personalized information. For the training part, we adopt the two-stage paradigm of ChatGPT, including pre-training and fine-tuning. In the pre-training stage, we train GPT model by auto-regression. In the fine-tuning stage, we train the model with prompts, which include both the newly-generated results from the model and the user's feedback. For the inference part, we predict several user interests as user representations in an autoregressive manner. For each interest vector, we recall several items with the highest similarity and merge the items recalled by all interest vectors into the final result. We conduct experiments with both offline public datasets and online A/B test to demonstrate the effectiveness of our proposed method.


title: ALERT: A Comprehensive Benchmark for Assessing Large Language Models' Safety through Red Teaming

abstract: When building Large Language Models (LLMs), it is paramount to bear safety in mind and protect them with guardrails. Indeed, LLMs should never generate content promoting or normalizing harmful, illegal, or unethical behavior that may contribute to harm to individuals or society. This principle applies to both normal and adversarial use. In response, we introduce ALERT, a large-scale benchmark to assess safety based on a novel fine-grained risk taxonomy. It is designed to evaluate the safety of LLMs through red teaming methodologies and consists of more than 45k instructions categorized using our novel taxonomy. By subjecting LLMs to adversarial testing scenarios, ALERT aims to identify vulnerabilities, inform improvements, and enhance the overall safety of the language models. Furthermore, the fine-grained taxonomy enables researchers to perform an in-depth evaluation that also helps one to assess the alignment with various policies. In our experiments, we extensively evaluate 10 popular open- and closed-source LLMs and demonstrate that many of them still struggle to attain reasonable levels of safety.


title: PMG : Personalized Multimodal Generation with Large Language Models

abstract: The emergence of large language models (LLMs) has revolutionized the capabilities of text comprehension and generation. Multi-modal generation attracts great attention from both the industry and academia, but there is little work on personalized generation, which has important applications such as recommender systems. This paper proposes the first method for personalized multimodal generation using LLMs, showcases its applications and validates its performance via an extensive experimental study on two datasets. The proposed method, Personalized Multimodal Generation (PMG for short) first converts user behaviors (e.g., clicks in recommender systems or conversations with a virtual assistant) into natural language to facilitate LLM understanding and extract user preference descriptions. Such user preferences are then fed into a generator, such as a multimodal LLM or diffusion model, to produce personalized content. To capture user preferences comprehensively and accurately, we propose to let the LLM output a combination of explicit keywords and implicit embeddings to represent user preferences. Then the combination of keywords and embeddings are used as prompts to condition the generator. We optimize a weighted sum of the accuracy and preference scores so that the generated content has a good balance between them. Compared to a baseline method without personalization, PMG has a significant improvement on personalization for up to 8% in terms of LPIPS while retaining the accuracy of generation.


title: Information Retrieval with Entity Linking

abstract: Despite the advantages of their low-resource settings, traditional sparse retrievers depend on exact matching approaches between high-dimensional bag-of-words (BoW) representations of both the queries and the collection. As a result, retrieval performance is restricted by semantic discrepancies and vocabulary gaps. On the other hand, transformer-based dense retrievers introduce significant improvements in information retrieval tasks by exploiting low-dimensional contextualized representations of the corpus. While dense retrievers are known for their relative effectiveness, they suffer from lower efficiency and lack of generalization issues, when compared to sparse retrievers. For a lightweight retrieval task, high computational resources and time consumption are major barriers encouraging the renunciation of dense models despite potential gains. In this work, I propose boosting the performance of sparse retrievers by expanding both the queries and the documents with linked entities in two formats for the entity names: 1) explicit and 2) hashed. A zero-shot end-to-end dense entity linking system is employed for entity recognition and disambiguation to augment the corpus. By leveraging the advanced entity linking methods, I believe that the effectiveness gap between sparse and dense retrievers can be narrowed. Experiments are conducted on the MS MARCO passage dataset using the original qrel set, the re-ranked qrels favoured by MonoT5 and the latter set further re-ranked by DuoT5. Since I am concerned with the early stage retrieval in cascaded ranking architectures of large information retrieval systems, the results are evaluated using recall@1000. The suggested approach is also capable of retrieving documents for query subsets judged to be particularly difficult in prior work.


title: Your Finetuned Large Language Model is Already a Powerful Out-of-distribution Detector

abstract: We revisit the likelihood ratio between a pretrained large language model (LLM) and its finetuned variant as a criterion for out-of-distribution (OOD) detection. The intuition behind such a criterion is that, the pretrained LLM has the prior knowledge about OOD data due to its large amount of training data, and once finetuned with the in-distribution data, the LLM has sufficient knowledge to distinguish their difference. Leveraging the power of LLMs, we show that, for the first time, the likelihood ratio can serve as an effective OOD detector. Moreover, we apply the proposed LLM-based likelihood ratio to detect OOD questions in question-answering (QA) systems, which can be used to improve the performance of specialized LLMs for general questions. Given that likelihood can be easily obtained by the loss functions within contemporary neural network frameworks, it is straightforward to implement this approach in practice. Since both the pretrained LLMs and its various finetuned models are available, our proposed criterion can be effortlessly incorporated for OOD detection without the need for further training. We conduct comprehensive evaluation across on multiple settings, including far OOD, near OOD, spam detection, and QA scenarios, to demonstrate the effectiveness of the method.


title: Automating Research Synthesis with Domain-Specific Large Language Model Fine-Tuning

abstract: This research pioneers the use of fine-tuned Large Language Models (LLMs) to automate Systematic Literature Reviews (SLRs), presenting a significant and novel contribution in integrating AI to enhance academic research methodologies. Our study employed the latest fine-tuning methodologies together with open-sourced LLMs, and demonstrated a practical and efficient approach to automating the final execution stages of an SLR process that involves knowledge synthesis. The results maintained high fidelity in factual accuracy in LLM responses, and were validated through the replication of an existing PRISMA-conforming SLR. Our research proposed solutions for mitigating LLM hallucination and proposed mechanisms for tracking LLM responses to their sources of information, thus demonstrating how this approach can meet the rigorous demands of scholarly research. The findings ultimately confirmed the potential of fine-tuned LLMs in streamlining various labor-intensive processes of conducting literature reviews. Given the potential of this approach and its applicability across all research domains, this foundational study also advocated for updating PRISMA reporting guidelines to incorporate AI-driven processes, ensuring methodological transparency and reliability in future SLRs. This study broadens the appeal of AI-enhanced tools across various academic and research fields, setting a new standard for conducting comprehensive and accurate literature reviews with more efficiency in the face of ever-increasing volumes of academic studies.


title: EFSA: Towards Event-Level Financial Sentiment Analysis

abstract: In this paper, we extend financial sentiment analysis~(FSA) to event-level since events usually serve as the subject of the sentiment in financial text. Though extracting events from the financial text may be conducive to accurate sentiment predictions, it has specialized challenges due to the lengthy and discontinuity of events in a financial text. To this end, we reconceptualize the event extraction as a classification task by designing a categorization comprising coarse-grained and fine-grained event categories. Under this setting, we formulate the \textbf{E}vent-Level \textbf{F}inancial \textbf{S}entiment \textbf{A}nalysis~(\textbf{EFSA} for short) task that outputs quintuples consisting of (company, industry, coarse-grained event, fine-grained event, sentiment) from financial text. A large-scale Chinese dataset containing $12,160$ news articles and $13,725$ quintuples is publicized as a brand new testbed for our task. A four-hop Chain-of-Thought LLM-based approach is devised for this task. Systematically investigations are conducted on our dataset, and the empirical results demonstrate the benchmarking scores of existing methods and our proposed method can reach the current state-of-the-art. Our dataset and framework implementation are available at https://anonymous.4open.science/r/EFSA-645E


title: Access to Library Information Resources by University Students during COVID-19 Pandemic in Africa: A Systematic Literature Review

abstract: The study examined access to library information resources by university students during the outbreak of the COVID-19 pandemic. The study investigated measures that were adopted by academic libraries for smooth delivery of library information resources to their patrons. It also identified technological tools that were employed by libraries to facilitate access to library information resources. We also investigated the challenges faced by students in accessing library information resources. A systematic literature review approach using PRISMA guidelines was employed to investigate the relevant literature on the subject. The keyword search strategy was employed to search for relevant literature from four scholarly databases Scopus, emerald, Research4life, and Google Scholar. In this study, 23 studies that fulfilled the criteria were included. The findings revealed that the majority of the reviewed studies indicate that, during the COVID-19 pandemic many academic libraries in Africa adopted different approaches to facilitate access to library information resources by university students including expanding access to electronic resources off-campus, virtual reference services, circulation and lending services. To support access to different library services and information resources academic libraries in Africa used various digital technological tools like social media, library websites, email and video conferencing. Moreover, the study revealed that limited access to internet services and ICT devices, inadequate electronic library collection and inadequate digital and information literacy were the major challenges faced by patrons during the pandemic. This study recommends investment in ICT infrastructures and expanding electronic resource collections which are vital resources in the digital era.


title: Text clustering applied to data augmentation in legal contexts

abstract: Data analysis and machine learning are of preeminent importance in the legal domain, especially in tasks like clustering and text classification. In this study, we harnessed the power of natural language processing tools to enhance datasets meticulously curated by experts. This process significantly improved the classification workflow for legal texts using machine learning techniques. We considered the Sustainable Development Goals (SDGs) data from the United Nations 2030 Agenda as a practical case study. Data augmentation clustering-based strategy led to remarkable enhancements in the accuracy and sensitivity metrics of classification models. For certain SDGs within the 2030 Agenda, we observed performance gains of over 15%. In some cases, the example base expanded by a noteworthy factor of 5. When dealing with unclassified legal texts, data augmentation strategies centered around clustering prove to be highly effective. They provide a valuable means to expand the existing knowledge base without the need for labor-intensive manual classification efforts.


title: Is English the New Programming Language? How About Pseudo-code Engineering?

abstract: Background: The integration of artificial intelligence (AI) into daily life, particularly through chatbots utilizing natural language processing (NLP), presents both revolutionary potential and unique challenges. This intended to investigate how different input forms impact ChatGPT, a leading language model by OpenAI, performance in understanding and executing complex, multi-intention tasks. Design: Employing a case study methodology supplemented by discourse analysis, the research analyzes ChatGPT's responses to inputs varying from natural language to pseudo-code engineering. The study specifically examines the model's proficiency across four categories: understanding of intentions, interpretability, completeness, and creativity. Setting and Participants: As a theoretical exploration of AI interaction, this study focuses on the analysis of structured and unstructured inputs processed by ChatGPT, without direct human participants. Data collection and analysis: The research utilizes synthetic case scenarios, including the organization of a "weekly meal plan" and a "shopping list," to assess ChatGPT's response to prompts in both natural language and pseudo-code engineering. The analysis is grounded in the identification of patterns, contradictions, and unique response elements across different input formats. Results: Findings reveal that pseudo-code engineering inputs significantly enhance the clarity and determinism of ChatGPT's responses, reducing ambiguity inherent in natural language. Enhanced natural language, structured through prompt engineering techniques, similarly improves the model's interpretability and creativity. Conclusions: The study underscores the potential of pseudo-code engineering in refining human-AI interaction and achieving more deterministic, concise, and direct outcomes, advocating for its broader application across disciplines requiring precise AI responses.


title: Neural Sequence-to-Sequence Modeling with Attention by Leveraging Deep Learning Architectures for Enhanced Contextual Understanding in Abstractive Text Summarization

abstract: Automatic text summarization (TS) plays a pivotal role in condensing large volumes of information into concise, coherent summaries, facilitating efficient information retrieval and comprehension. This paper presents a novel framework for abstractive TS of single documents, which integrates three dominant aspects: structural, semantic, and neural-based approaches. The proposed framework merges machine learning and knowledge-based techniques to achieve a unified methodology. The framework consists of three main phases: pre-processing, machine learning, and post-processing. In the pre-processing phase, a knowledge-based Word Sense Disambiguation (WSD) technique is employed to generalize ambiguous words, enhancing content generalization. Semantic content generalization is then performed to address out-of-vocabulary (OOV) or rare words, ensuring comprehensive coverage of the input document. Subsequently, the generalized text is transformed into a continuous vector space using neural language processing techniques. A deep sequence-to-sequence (seq2seq) model with an attention mechanism is employed to predict a generalized summary based on the vector representation. In the post-processing phase, heuristic algorithms and text similarity metrics are utilized to refine the generated summary further. Concepts from the generalized summary are matched with specific entities, enhancing coherence and readability. Experimental evaluations conducted on prominent datasets, including Gigaword, Duc 2004, and CNN/DailyMail, demonstrate the effectiveness of the proposed framework. Results indicate significant improvements in handling rare and OOV words, outperforming existing state-of-the-art deep learning techniques. The proposed framework presents a comprehensive and unified approach towards abstractive TS, combining the strengths of structure, semantics, and neural-based methodologies.


title: Extractive text summarisation of Privacy Policy documents using machine learning approaches

abstract: This work demonstrates two Privacy Policy (PP) summarisation models based on two different clustering algorithms: K-means clustering and Pre-determined Centroid (PDC) clustering. K-means is decided to be used for the first model after an extensive evaluation of ten commonly used clustering algorithms. The summariser model based on the PDC-clustering algorithm summarises PP documents by segregating individual sentences by Euclidean distance from each sentence to the pre-defined cluster centres. The cluster centres are defined according to General Data Protection Regulation (GDPR)'s 14 essential topics that must be included in any privacy notices. The PDC model outperformed the K-means model for two evaluation methods, Sum of Squared Distance (SSD) and ROUGE by some margin (27% and 24% respectively). This result contrasts the K-means model's better performance in the general clustering of sentence vectors before running the task-specific evaluation. This indicates the effectiveness of operating task-specific fine-tuning measures on unsupervised machine-learning models. The summarisation mechanisms implemented in this paper demonstrates an idea of how to efficiently extract essential sentences that should be included in any PP documents. The summariser models could be further developed to an application that tests the GDPR-compliance (or any data privacy legislation) of PP documents.


title: A Survey of Reasoning for Substitution Relationships: Definitions, Methods, and Directions

abstract: Substitute relationships are fundamental to people's daily lives across various domains. This study aims to comprehend and predict substitute relationships among products in diverse fields, extensively analyzing the application of machine learning algorithms, natural language processing, and other technologies. By comparing model methodologies across different domains, such as defining substitutes, representing and learning substitute relationships, and substitute reasoning, this study offers a methodological foundation for delving deeper into substitute relationships. Through ongoing research and innovation, we can further refine the personalization and accuracy of substitute recommendation systems, thus advancing the development and application of this field.


title: Partial Nambu-Poisson structures on a convenient manifold

abstract: This paper offers an adaptation to the convenient setting of finite dimensional Nambu-Poisson structures. In particular, for partial Nambu structures, we look for those whose classical geometrical results in finite dimension can be extended to this infinite dimensional context. Finally, we are interested in the projective and direct limits of such structures.


title: An Introduction to Deligne Categories

abstract: This work hopes to be an introduction to Deligne categories for someone familiar with classical representation theory and some category theory. In the first chapter, we motivate and define (symmetric) tensor categories, construct the Deligne categories, and prove their universal properties. In the second chapter, we define ultraproducts and use them to construct the Deligne categories in a different way; in particular, this construction works in positive characteristic. In the third chapter, we connect Deligne categories to the classical categories by discussing simple objects and explaining what happens in the $t = n$ case. In the last chapter, along with recommendations for further and related reading, we give an example of an investigation of Harish-Chandra bimodules in representation theory in complex rank, which is a joint work with Alexandra Utiralova (arXiv:2107.03173).


title: Towards Building a Robust Toxicity Predictor

abstract: Recent NLP literature pays little attention to the robustness of toxicity language predictors, while these systems are most likely to be used in adversarial contexts. This paper presents a novel adversarial attack, \texttt{ToxicTrap}, introducing small word-level perturbations to fool SOTA text classifiers to predict toxic text samples as benign. ToxicTrap exploits greedy based search strategies to enable fast and effective generation of toxic adversarial examples. Two novel goal function designs allow ToxicTrap to identify weaknesses in both multiclass and multilabel toxic language detectors. Our empirical results show that SOTA toxicity text classifiers are indeed vulnerable to the proposed attacks, attaining over 98\% attack success rates in multilabel cases. We also show how a vanilla adversarial training and its improved version can help increase robustness of a toxicity detector even against unseen attacks.


title: Enhancing Adaptive Video Streaming through Fuzzy Logic-Based Content Recommendation Systems: A Comprehensive Review and Future Directions

abstract: As the demand for high-quality video content continues to rise, adaptive video streaming plays a pivotal role in delivering an optimal viewing experience. However, traditional content recommendation systems face challenges in dynamically adapting to users' preferences, content features, and contextual information. This review paper explores the integration of fuzzy logic into content recommendation systems for adaptive video streaming. Fuzzy logic, known for handling uncertainty and imprecision, provides a promising framework for modeling and accommodating the dynamic nature of user preferences and contextual factors. The paper discusses the evolution of adaptive video streaming, reviews traditional content recommendation algorithms, and introduces fuzzy logic as a solution to enhance the adaptability of these systems. Through a comprehensive exploration of case studies and applications, the effectiveness of fuzzy logic in improving user satisfaction and system performance is highlighted. The review also addresses challenges associated with the integration of fuzzy logic and suggests future research directions to further advance this approach. The proposed framework offers insights into a dynamic and context-aware content recommendation system, contributing to the evolution of adaptive video streaming technologies.


title: Apollonion: Profile-centric Dialog Agent

abstract: The emergence of Large Language Models (LLMs) has innovated the development of dialog agents. Specially, a well-trained LLM, as a central process unit, is capable of providing fluent and reasonable response for user's request. Besides, auxiliary tools such as external knowledge retrieval, personalized character for vivid response, short/long-term memory for ultra long context management are developed, completing the usage experience for LLM-based dialog agents. However, the above-mentioned techniques does not solve the issue of \textbf{personalization from user perspective}: agents response in a same fashion to different users, without consideration of their features, such as habits, interests and past experience. In another words, current implementation of dialog agents fail in ``knowing the user''. The capacity of well-description and representation of user is under development. In this work, we proposed a framework for dialog agent to incorporate user profiling (initialization, update): user's query and response is analyzed and organized into a structural user profile, which is latter served to provide personal and more precise response. Besides, we proposed a series of evaluation protocols for personalization: to what extend the response is personal to the different users. The framework is named as \method{}, inspired by inscription of ``Know Yourself'' in the temple of Apollo (also known as \method{}) in Ancient Greek. Few works have been conducted on incorporating personalization into LLM, \method{} is a pioneer work on guiding LLM's response to meet individuation via the application of dialog agents, with a set of evaluation methods for measurement in personalization.


title: Building an AI Support Tool for Real-time Ulcerative Colitis Diagnosis

abstract: Ulcerative Colitis (UC) is a chronic inflammatory bowel disease decreasing life quality through symptoms such as bloody diarrhoea and abdominal pain. Endoscopy is a cornerstone of diagnosis and monitoring of UC. The Mayo endoscopic subscore (MES) index is the standard for measuring UC severity during endoscopic evaluation. However, the MES is subject to high inter-observer variability leading to misdiagnosis and suboptimal treatment. We propose using a machine-learning based MES classification system to support the endoscopic process and to mitigate the observer-variability. The system runs real-time in the clinic and augments doctors' decision-making during the endoscopy. This project report outlines the process of designing, creating and evaluating our system. We describe our initial evaluation, which is a combination of a standard non-clinical model test and a first clinical test of the system on a real patient.


title: Musical Listening Qualia: A Multivariate Approach

abstract: French and American participants listened to new music stimuli and evaluated the stimuli using either adjectives or quantitative musical dimensions. Results were analyzed using correspondence analysis (CA), hierarchical cluster analysis (HCA), multiple factor analysis (MFA), and partial least squares correlation (PLSC). French and American listeners differed when they described the musical stimuli using adjectives, but not when using the quantitative dimensions. The present work serves as a case study in research methodology that allows for a balance between relaxing experimental control and maintaining statistical rigor.


title: Enhancing Question Answering for Enterprise Knowledge Bases using Large Language Models

abstract: Efficient knowledge management plays a pivotal role in augmenting both the operational efficiency and the innovative capacity of businesses and organizations. By indexing knowledge through vectorization, a variety of knowledge retrieval methods have emerged, significantly enhancing the efficacy of knowledge management systems. Recently, the rapid advancements in generative natural language processing technologies paved the way for generating precise and coherent answers after retrieving relevant documents tailored to user queries. However, for enterprise knowledge bases, assembling extensive training data from scratch for knowledge retrieval and generation is a formidable challenge due to the privacy and security policies of private data, frequently entailing substantial costs. To address the challenge above, in this paper, we propose EKRG, a novel Retrieval-Generation framework based on large language models (LLMs), expertly designed to enable question-answering for Enterprise Knowledge bases with limited annotation costs. Specifically, for the retrieval process, we first introduce an instruction-tuning method using an LLM to generate sufficient document-question pairs for training a knowledge retriever. This method, through carefully designed instructions, efficiently generates diverse questions for enterprise knowledge bases, encompassing both fact-oriented and solution-oriented knowledge. Additionally, we develop a relevance-aware teacher-student learning strategy to further enhance the efficiency of the training process. For the generation process, we propose a novel chain of thought (CoT) based fine-tuning method to empower the LLM-based generator to adeptly respond to user questions using retrieved documents. Finally, extensive experiments on real-world datasets have demonstrated the effectiveness of our proposed framework.


title: Environmental policies as a pull factor for tourists? Insights from Italy

abstract: Tourism consumption has grown into a major economic factor for modern societies. However, the environmental impact of tourism has become a significant concern, leading to an increased focus on sustainable tourism policies. While governments and institutions have introduced frameworks to promote ecological transition in the tourism sector, the effectiveness of such policies remains unclear. This study provides a seminal attempt to examine the complex relationship between tourism demand and sustainable tourism policies. To do so, a gravity model framework has been adopted to examine incoming international tourism flows in Italian provinces in 2019. The findings reveal a positive association between tourism demand and sustainable labels. This study also suggests that eco-labels are appreciated by tourists and have a role in the destination decision-making process. It highlighted the need for continued research to identify effective sustainable tourism policies that can balance the economic benefits of tourism with environmental considerations


title: Testing the standardizability of, and deriving cosmological constraints from, a new Amati-correlated gamma-ray burst data compilation

abstract: By using gamma-ray burst (GRB) data to simultaneously constrain Amati correlation parameters and cosmological parameters in six spatially-flat and nonflat dark energy cosmological models, we show that an updated 220 GRB version of the Jia et al. [Mon. Not. R. Astron. Soc. 516, 2575 (2022)] GRB data compilation are standardizable through the Amati correlation and so can be used for cosmological analyses. However, the resulting GRB data constraints on the current value of the nonrelativistic matter density parameter, $\Omega_{m0}$, are in $>2\sigma$ tension with those from a joint analysis of better-established Hubble parameter [$H(z)$] and baryon acoustic oscillation (BAO) data for most of the cosmological models we consider, indicating that these GRB data cannot be jointly used with better-established $H(z)$ + BAO data to constrain cosmological parameters.


title: Lossless Acceleration of Large Language Model via Adaptive N-gram Parallel Decoding

abstract: While Large Language Models (LLMs) have shown remarkable abilities, they are hindered by significant resource consumption and considerable latency due to autoregressive processing. In this study, we introduce Adaptive N-gram Parallel Decoding (ANPD), an innovative and lossless approach that accelerates inference by allowing the simultaneous generation of multiple tokens. ANPD incorporates a two-stage approach: it begins with a rapid drafting phase that employs an N-gram module, which adapts based on the current interactive context, followed by a verification phase, during which the original LLM assesses and confirms the proposed tokens. Consequently, ANPD preserves the integrity of the LLM's original output while enhancing processing speed. We further leverage a multi-level architecture for the N-gram module to enhance the precision of the initial draft, consequently reducing inference latency. ANPD eliminates the need for retraining or extra GPU memory, making it an efficient and plug-and-play enhancement. In our experiments, models such as LLaMA and its fine-tuned variants have shown speed improvements up to 3.67x, validating the effectiveness of our proposed ANPD.


title: Analyzing the Impact of Data Selection and Fine-Tuning on Economic and Political Biases in LLMs

abstract: In an era where language models are increasingly integrated into decision-making and communication, understanding the biases within Large Language Models (LLMs) becomes imperative, especially when these models are applied in the economic and political domains. This work investigates the impact of fine-tuning and data selection on economic and political biases in LLM. We explore the methodological aspects of biasing LLMs towards specific ideologies, mindful of the biases that arise from their extensive training on diverse datasets. Our approach, distinct from earlier efforts that either focus on smaller models or entail resource-intensive pre-training, employs Parameter-Efficient Fine-Tuning (PEFT) techniques. These techniques allow for the alignment of LLMs with targeted ideologies by modifying a small subset of parameters. We introduce a systematic method for dataset selection, annotation, and instruction tuning, and we assess its effectiveness through both quantitative and qualitative evaluations. Our work analyzes the potential of embedding specific biases into LLMs and contributes to the dialogue on the ethical application of AI, highlighting the importance of deploying AI in a manner that aligns with societal values.


title: DyKnow:Dynamically Verifying Time-Sensitive Factual Knowledge in LLMs

abstract: LLMs acquire knowledge from massive data snapshots collected at different timestamps. Their knowledge is then commonly evaluated using static benchmarks. However, factual knowledge is generally subject to time-sensitive changes, and static benchmarks cannot address those cases. We present an approach to dynamically evaluate the knowledge in LLMs and their time-sensitiveness against Wikidata, a publicly available up-to-date knowledge graph. We evaluate the time-sensitive knowledge in twenty-four private and open-source LLMs, as well as the effectiveness of four editing methods in updating the outdated facts. Our results show that 1) outdatedness is a critical problem across state-of-the-art LLMs; 2) LLMs output inconsistent answers when prompted with slight variations of the question prompt; and 3) the performance of the state-of-the-art knowledge editing algorithms is very limited, as they can not reduce the cases of outdatedness and output inconsistency.


title: Can Contrastive Learning Refine Embeddings

abstract: Recent advancements in contrastive learning have revolutionized self-supervised representation learning and achieved state-of-the-art performance on benchmark tasks. While most existing methods focus on applying contrastive learning to input data modalities such as images, natural language sentences, or networks, they overlook the potential of utilizing outputs from previously trained encoders. In this paper, we introduce SIMSKIP, a novel contrastive learning framework that specifically refines input embeddings for downstream tasks. Unlike traditional unsupervised learning approaches, SIMSKIP takes advantage of the output embeddings of encoder models as its input. Through theoretical analysis, we provide evidence that applying SIMSKIP does not result in larger upper bounds on downstream task errors than those of the original embeddings, which serve as SIMSKIP's input. Experimental results on various open datasets demonstrate that the embeddings produced by SIMSKIP improve performance on downstream tasks.


title: Predictive Modelling of Air Quality Index (AQI) Across Diverse Cities and States of India using Machine Learning: Investigating the Influence of Punjab's Stubble Burning on AQI Variability

abstract: Air pollution is a common and serious problem nowadays and it cannot be ignored as it has harmful impacts on human health. To address this issue proactively, people should be aware of their surroundings, which means the environment where they survive. With this motive, this research has predicted the AQI based on different air pollutant concentrations in the atmosphere. The dataset used for this research has been taken from the official website of CPCB. The dataset has the air pollutant concentration from 22 different monitoring stations in different cities of Delhi, Haryana, and Punjab. This data is checked for null values and outliers. But, the most important thing to note is the correct understanding and imputation of such values rather than ignoring or doing wrong imputation. The time series data has been used in this research which is tested for stationarity using The Dickey-Fuller test. Further different ML models like CatBoost, XGBoost, Random Forest, SVM regressor, time series model SARIMAX, and deep learning model LSTM have been used to predict AQI. For the performance evaluation of different models, I used MSE, RMSE, MAE, and R2. It is observed that Random Forest performed better as compared to other models.