title: TransGlow: Attention-augmented Transduction model based on Graph Neural Networks for Water Flow Forecasting

abstract: The hydrometric prediction of water quantity is useful for a variety of applications, including water management, flood forecasting, and flood control. However, the task is difficult due to the dynamic nature and limited data of water systems. Highly interconnected water systems can significantly affect hydrometric forecasting. Consequently, it is crucial to develop models that represent the relationships between other system components. In recent years, numerous hydrological applications have been studied, including streamflow prediction, flood forecasting, and water quality prediction. Existing methods are unable to model the influence of adjacent regions between pairs of variables. In this paper, we propose a spatiotemporal forecasting model that augments the hidden state in Graph Convolution Recurrent Neural Network (GCRN) encoder-decoder using an efficient version of the attention mechanism. The attention layer allows the decoder to access different parts of the input sequence selectively. Since water systems are interconnected and the connectivity information between the stations is implicit, the proposed model leverages a graph learning module to extract a sparse graph adjacency matrix adaptively based on the data. Spatiotemporal forecasting relies on historical data. In some regions, however, historical data may be limited or incomplete, making it difficult to accurately predict future water conditions. Further, we present a new benchmark dataset of water flow from a network of Canadian stations on rivers, streams, and lakes. Experimental results demonstrate that our proposed model TransGlow significantly outperforms baseline methods by a wide margin.


title: Aikyam: A Video Conferencing Utility for Deaf and Dumb

abstract: With the advent of the pandemic, the use of video conferencing platforms as a means of communication has greatly increased and with it, so have the remote opportunities. The deaf and dumb have traditionally faced several issues in communication, but now the effect is felt more severely. This paper proposes an all-encompassing video conferencing utility that can be used with existing video conferencing platforms to address these issues. Appropriate semantically correct sentences are generated from the signer's gestures which would be interpreted by the system. Along with an audio to emit this sentence, the user's feed is also used to annotate the sentence. This can be viewed by all participants, thus aiding smooth communication with all parties involved. This utility utilizes a simple LSTM model for classification of gestures. The sentences are constructed by a t5 based model. In order to achieve the required data flow, a virtual camera is used.


title: Finding the last bits of positional information

abstract: In a developing embryo, information about the position of cells is encoded in the concentrations of "morphogen" molecules. In the fruit fly, the local concentrations of just a handful of proteins encoded by the gap genes are sufficient to specify position with a precision comparable to the spacing between cells along the anterior--posterior axis. This matches the precision of downstream events such as the striped patterns of expression in the pair-rule genes, but is not quite sufficient to define unique identities for individual cells. We demonstrate theoretically that this information gap can be bridged if positional errors are spatially correlated, with relatively long correlation lengths. We then show experimentally that these correlations are present, with the required strength, in the fluctuating positions of the pair-rule stripes, and this can be traced back to the gap genes. Taking account of these correlations, the available information matches the information needed for unique cellular specification, within error bars of ~2%. These observation support a precisionist view of information flow through the underlying genetic networks, in which accurate signals are available from the start and preserved as they are transformed into the final spatial patterns.


title: ConSequence: Synthesizing Logically Constrained Sequences for Electronic Health Record Generation

abstract: Generative models can produce synthetic patient records for analytical tasks when real data is unavailable or limited. However, current methods struggle with adhering to domain-specific knowledge and removing invalid data. We present ConSequence, an effective approach to integrating domain knowledge into sequential generative neural network outputs. Our rule-based formulation includes temporal aggregation and antecedent evaluation modules, ensured by an efficient matrix multiplication formulation, to satisfy hard and soft logical constraints across time steps. Existing constraint methods often fail to guarantee constraint satisfaction, lack the ability to handle temporal constraints, and hinder the learning and computational efficiency of the model. In contrast, our approach efficiently handles all types of constraints with guaranteed logical coherence. We demonstrate ConSequence's effectiveness in generating electronic health records, outperforming competitors in achieving complete temporal and spatial constraint satisfaction without compromising runtime performance or generative quality. Specifically, ConSequence successfully prevents all rule violations while improving the model quality in reducing its test perplexity by 5% and incurring less than a 13% slowdown in generation speed compared to an unconstrained model.


title: Black Hole Perturbation Theory Meets CFT$_2$: Kerr Compton Amplitudes from Nekrasov-Shatashvili Functions

abstract: We present a novel study of Kerr Compton amplitudes in a partial wave basis in terms of the Nekrasov-Shatashvili (NS) function of the \textit{confluent Heun equation} (CHE). Remarkably, NS-functions enjoy analytic properties and symmetries that are naturally inherited by the Compton amplitudes. Based on this, we characterize the analytic dependence of the Compton phase-shift in the Kerr spin parameter and provide a direct comparison to the standard post-Minkowskian (PM) perturbative approach within General Relativity (GR). We also analyze the universal large frequency behavior of the relevant characteristic exponent of the CHE -- also known as the renormalized angular momentum -- and find agreement with numerical computations. Moreover, we discuss the analytic continuation in the harmonics quantum number $\ell$ of the partial wave, and show that the limit to the physical integer values commutes with the PM expansion of the observables. Finally, we obtain the contributions to the tree level, point-particle, gravitational Compton amplitude in a covariant basis through $\mathcal{O}(a_{\text{BH}}^8)$, without the need to take the super-extremal limit for Kerr spin.


title: Fake It Till Make It: Federated Learning with Consensus-Oriented Generation

abstract: In federated learning (FL), data heterogeneity is one key bottleneck that causes model divergence and limits performance. Addressing this, existing methods often regard data heterogeneity as an inherent property and propose to mitigate its adverse effects by correcting models. In this paper, we seek to break this inherent property by generating data to complement the original dataset to fundamentally mitigate heterogeneity level. As a novel attempt from the perspective of data, we propose federated learning with consensus-oriented generation (FedCOG). FedCOG consists of two key components at the client side: complementary data generation, which generates data extracted from the shared global model to complement the original dataset, and knowledge-distillation-based model training, which distills knowledge from global model to local model based on the generated data to mitigate over-fitting the original heterogeneous dataset. FedCOG has two critical advantages: 1) it can be a plug-and-play module to further improve the performance of most existing FL methods, and 2) it is naturally compatible with standard FL protocols such as Secure Aggregation since it makes no modification in communication process. Extensive experiments on classical and real-world FL datasets show that FedCOG consistently outperforms state-of-the-art methods.


title: Optimizing the quality factor of InP nanobeam cavities using atomic layer deposition

abstract: Photonic crystal nanobeam cavities are valued for their small mode volume, CMOS compatibility, and high coupling efficiency crucial features for various low-power photonic applications and quantum information processing. However, despite their potential, nanobeam cavities often suffer from low quality factors due to fabrication imperfections that create surface states and optical absorption. In this work, we demonstrate InP nanobeam cavities with up to 140% higher quality factors by applying a coating of Al$_2$O$_3$ via atomic layer deposition to terminate dangling bonds and reduce surface absorption. Additionally, changing the deposition thickness allows precise tuning of the cavity mode wavelength without compromising the quality factor. This Al$_2$O$_3$ atomic layer deposition approach holds great promise for optimizing nanobeam cavities that are well-suited for integration with a wide range of photonic applications.


title: Jumpstarting Surgical Computer Vision

abstract: Purpose: General consensus amongst researchers and industry points to a lack of large, representative annotated datasets as the biggest obstacle to progress in the field of surgical data science. Self-supervised learning represents a solution to part of this problem, removing the reliance on annotations. However, the robustness of current self-supervised learning methods to domain shifts remains unclear, limiting our understanding of its utility for leveraging diverse sources of surgical data. Methods: In this work, we employ self-supervised learning to flexibly leverage diverse surgical datasets, thereby learning taskagnostic representations that can be used for various surgical downstream tasks. Based on this approach, to elucidate the impact of pre-training on downstream task performance, we explore 22 different pre-training dataset combinations by modulating three variables: source hospital, type of surgical procedure, and pre-training scale (number of videos). We then finetune the resulting model initializations on three diverse downstream tasks: namely, phase recognition and critical view of safety in laparoscopic cholecystectomy and phase recognition in laparoscopic hysterectomy. Results: Controlled experimentation highlights sizable boosts in performance across various tasks, datasets, and labeling budgets. However, this performance is intricately linked to the composition of the pre-training dataset, robustly proven through several study stages. Conclusion: The composition of pre-training datasets can severely affect the effectiveness of SSL methods for various downstream tasks and should critically inform future data collection efforts to scale the application of SSL methodologies. Keywords: Self-Supervised Learning, Transfer Learning, Surgical Computer Vision, Endoscopic Videos, Critical View of Safety, Phase Recognition


title: A note on forcing triples with no forcing pairs

abstract: Chung, Graham and Wilson defined a set of graphs $\mathcal{H}$ to be forcing, if any sequence of graphs $\{G_n\}_{n \geq 0}$ with $|G_n| = n$ must be quasirandom, whenever $hom(H, G_n)= (p^{|E(H)|}+o(1))n^{|V(H)|}$ for every $H \in \mathcal{H}$ and some constant $p \in (0, 1)$. Answering a question of Horn, attributed to Graham, a forcing set of three graphs is constructed such that no two of the three graphs are forcing as a pair.


title: Spin fractionalization and zero modes in the spin-$\frac{1}{2}$ XXZ chain with boundary fields

abstract: In this work we argue that the antiferromagnetic spin $\frac{1}{2}$ XXZ chain in the gapped phase with boundary magnetic fields hosts fractional spin $\frac{1}{4}$ at its edges. Using a combination of Bethe ansatz and the density matrix renormalization group we show that these fractional spins are sharp quantum observables in both the ground and the first excited state as the associated fractional spin operators have zero variance. In the limit of zero edge fields, we argue that these fractional spin operators once projected onto the low energy subspace spanned by the ground state and the first excited state, identify with the strong zero energy mode discovered by P. Fendley \cite{Fendley}.


title: A unified repository for pre-processed climate data weighted by gridded economic activity

abstract: Although high-resolution gridded climate variables are provided by multiple sources, the need for country and region-specific climate data weighted by indicators of economic activity is becoming increasingly common in environmental and economic research. We process available information from different climate data sources to provide spatially aggregated data with global coverage for both countries (GADM0 resolution) and regions (GADM1 resolution) and for a variety of climate indicators (average precipitations, average temperatures, average SPEI). We weigh gridded climate data by population density or by night light intensity -- both proxies of economic activity -- before aggregation. Climate variables are measured daily, monthly, and annually, covering (depending on the data source) a time window from 1900 (at the earliest) to 2023. We pipeline all the preprocessing procedures in a unified framework, which we share in the open-access Weighted Climate Data Repository web app. Finally, we validate our data through a systematic comparison with those employed in leading climate impact studies.


title: Activating Frequency and ViT for 3D Point Cloud Quality Assessment without Reference

abstract: Deep learning-based quality assessments have significantly enhanced perceptual multimedia quality assessment, however it is still in the early stages for 3D visual data such as 3D point clouds (PCs). Due to the high volume of 3D-PCs, such quantities are frequently compressed for transmission and viewing, which may affect perceived quality. Therefore, we propose no-reference quality metric of a given 3D-PC. Comparing to existing methods that mostly focus on geometry or color aspects, we propose integrating frequency magnitudes as indicator of spatial degradation patterns caused by the compression. To map the input attributes to quality score, we use a light-weight hybrid deep model; combined of Deformable Convolutional Network (DCN) and Vision Transformers (ViT). Experiments are carried out on ICIP20 [1], PointXR [2] dataset, and a new big dataset called BASICS [3]. The results show that our approach outperforms state-of-the-art NR-PCQA measures and even some FR-PCQA on PointXR. The implementation code can be found at: https://github.com/o-messai/3D-PCQA


title: Risk measures based on weak optimal transport

abstract: In this paper, we study convex risk measures with weak optimal transport penalties. In a first step, we show that these risk measures allow for an explicit representation via a nonlinear transform of the loss function. In a second step, we discuss computational aspects related to the nonlinear transform as well as approximations of the risk measures using, for example, neural networks. Our setup comprises a variety of examples, such as classical optimal transport penalties, parametric families of models, uncertainty on path spaces, moment constrains, and martingale constraints. In a last step, we show how to use the theoretical results for the numerical computation of worst-case losses in an insurance context and no-arbitrage prices of European contingent claims after quoted maturities in a model-free setting.


title: Learning the Causal Structure of Networked Dynamical Systems under Latent Nodes and Structured Noise

abstract: This paper considers learning the hidden causal network of a linear networked dynamical system (NDS) from the time series data at some of its nodes -- partial observability. The dynamics of the NDS are driven by colored noise that generates spurious associations across pairs of nodes, rendering the problem much harder. To address the challenge of noise correlation and partial observability, we assign to each pair of nodes a feature vector computed from the time series data of observed nodes. The feature embedding is engineered to yield structural consistency: there exists an affine hyperplane that consistently partitions the set of features, separating the feature vectors corresponding to connected pairs of nodes from those corresponding to disconnected pairs. The causal inference problem is thus addressed via clustering the designed features. We demonstrate with simple baseline supervised methods the competitive performance of the proposed causal inference mechanism under broad connectivity regimes and noise correlation levels, including a real world network. Further, we devise novel technical guarantees of structural consistency for linear NDS under the considered regime.


title: FM-G-CAM: A Holistic Approach for Explainable AI in Computer Vision

abstract: Explainability is an aspect of modern AI that is vital for impact and usability in the real world. The main objective of this paper is to emphasise the need to understand the predictions of Computer Vision models, specifically Convolutional Neural Network (CNN) based models. Existing methods of explaining CNN predictions are mostly based on Gradient-weighted Class Activation Maps (Grad-CAM) and solely focus on a single target class. We show that from the point of the target class selection, we make an assumption on the prediction process, hence neglecting a large portion of the predictor CNN model's thinking process. In this paper, we present an exhaustive methodology called Fused Multi-class Gradient-weighted Class Activation Map (FM-G-CAM) that considers multiple top predicted classes, which provides a holistic explanation of the predictor CNN's thinking rationale. We also provide a detailed and comprehensive mathematical and algorithmic description of our method. Furthermore, along with a concise comparison of existing methods, we compare FM-G-CAM with Grad-CAM, highlighting its benefits through real-world practical use cases. Finally, we present an open-source Python library with FM-G-CAM implementation to conveniently generate saliency maps for CNN-based model predictions.


title: A Representative Study on Human Detection of Artificially Generated Media Across Countries

abstract: AI-generated media has become a threat to our digital society as we know it. These forgeries can be created automatically and on a large scale based on publicly available technology. Recognizing this challenge, academics and practitioners have proposed a multitude of automatic detection strategies to detect such artificial media. However, in contrast to these technical advances, the human perception of generated media has not been thoroughly studied yet. In this paper, we aim at closing this research gap. We perform the first comprehensive survey into people's ability to detect generated media, spanning three countries (USA, Germany, and China) with 3,002 participants across audio, image, and text media. Our results indicate that state-of-the-art forgeries are almost indistinguishable from "real" media, with the majority of participants simply guessing when asked to rate them as human- or machine-generated. In addition, AI-generated media receive is voted more human like across all media types and all countries. To further understand which factors influence people's ability to detect generated media, we include personal variables, chosen based on a literature review in the domains of deepfake and fake news research. In a regression analysis, we found that generalized trust, cognitive reflection, and self-reported familiarity with deepfakes significantly influence participant's decision across all media categories.


title: A Rank-Dependent Theory for Decision under Risk and Ambiguity

abstract: This paper axiomatizes, in a two-stage setup, a new theory for decision under risk and ambiguity. The axiomatized preference relation $\succeq$ on the space $\tilde{V}$ of random variables induces an ambiguity index $c$ on the space $\Delta$ of probabilities, a probability weighting function $\psi$, generating the measure $\nu_{\psi}$ by transforming an objective probability measure, and a utility function $\phi$, such that, for all $\tilde{v},\tilde{u}\in\tilde{V}$, \begin{align*} \tilde{v}\succeq\tilde{u} \Leftrightarrow \min_{Q \in \Delta} \left\{\mathbb{E}_Q\left[\int\phi\left(\tilde{v}^{\centerdot}\right)\,\mathrm{d}\nu_{\psi}\right]+c(Q)\right\} \geq \min_{Q \in \Delta} \left\{\mathbb{E}_Q\left[\int\phi\left(\tilde{u}^{\centerdot}\right)\,\mathrm{d}\nu_{\psi}\right]+c(Q)\right\}. \end{align*} Our theory extends the rank-dependent utility model of Quiggin (1982) for decision under risk to risk and ambiguity, reduces to the variational preferences model when $\psi$ is the identity, and is dual to variational preferences when $\phi$ is affine in the same way as the theory of Yaari (1987) is dual to expected utility. As a special case, we obtain a preference axiomatization of a decision theory that is a rank-dependent generalization of the popular maxmin expected utility theory. We characterize ambiguity aversion in our theory.


title: Neural Architecture Codesign for Fast Bragg Peak Analysis

abstract: We develop an automated pipeline to streamline neural architecture codesign for fast, real-time Bragg peak analysis in high-energy diffraction microscopy. Traditional approaches, notably pseudo-Voigt fitting, demand significant computational resources, prompting interest in deep learning models for more efficient solutions. Our method employs neural architecture search and AutoML to enhance these models, including hardware costs, leading to the discovery of more hardware-efficient neural architectures. Our results match the performance, while achieving a 13$\times$ reduction in bit operations compared to the previous state-of-the-art. We show further speedup through model compression techniques such as quantization-aware-training and neural network pruning. Additionally, our hierarchical search space provides greater flexibility in optimization, which can easily extend to other tasks and domains.


title: NovaCOMET: Open Commonsense Foundation Models with Symbolic Knowledge Distillation

abstract: We present NovaCOMET, an open commonsense knowledge model, that combines the best aspects of knowledge and general task models. Compared to previous knowledge models, NovaCOMET allows open-format relations enabling direct application to reasoning tasks; compared to general task models like Flan-T5, it explicitly centers knowledge, enabling superior performance for commonsense reasoning. NovaCOMET leverages the knowledge of opaque proprietary models to create an open knowledge pipeline. First, knowledge is symbolically distilled into NovATOMIC, a publicly-released discrete knowledge graph which can be audited, critiqued, and filtered. Next, we train NovaCOMET on NovATOMIC by fine-tuning an open-source pretrained model. NovaCOMET uses an open-format training objective, replacing the fixed relation sets of past knowledge models, enabling arbitrary structures within the data to serve as inputs or outputs. The resulting generation model, optionally augmented with human annotation, matches or exceeds comparable open task models like Flan-T5 on a range of commonsense generation tasks. NovaCOMET serves as a counterexample to the contemporary focus on instruction tuning only, demonstrating a distinct advantage to explicitly modeling commonsense knowledge as well.


title: Maximum flow-based formulation for the optimal location of electric vehicle charging stations

abstract: With the increasing effects of climate change, the urgency to step away from fossil fuels is greater than ever before. Electric vehicles (EVs) are one way to diminish these effects, but their widespread adoption is often limited by the insufficient availability of charging stations. In this work, our goal is to expand the infrastructure of EV charging stations, in order to provide a better quality of service in terms of user satisfaction (and availability of charging stations). Specifically, our focus is directed towards urban areas. We first propose a model for the assignment of EV charging demand to stations, framing it as a maximum flow problem. This model is the basis for the evaluation of user satisfaction with a given charging infrastructure. Secondly, we incorporate the maximum flow model into a mixed-integer linear program, where decisions on the opening of new stations and on the expansion of their capacity through additional outlets is accounted for. We showcase our methodology for the city of Montreal, demonstrating the scalability of our approach to handle real-world scenarios. We conclude that considering both spacial and temporal variations in charging demand is meaningful when solving realistic instances.


title: Stellar Metallicities and Gradients in the Isolated, Quenched Low-Mass Galaxy Tucana

abstract: We measure the metallicities of 374 red giant branch (RGB) stars in the isolated, quenched dwarf galaxy Tucana using Hubble Space Telescope (HST) narrow-band (F395N) Calcium H & K (CaHK) imaging. Our sample is a factor of $\sim7$ larger than what is published. Our main findings are: (i) A global metallicity distribution function (MDF) with $\langle \mbox{[Fe/H]} \rangle = -1.55 \pm 0.04$ and $\sigma_{\mbox{[Fe/H]}}=0.54\pm0.03$; (ii) A metallicity gradient of $-0.54 \pm 0.07$ dex $R_e^{-1}$ ($-2.1 \pm 0.3$ dex kpc$^{-1}$) over the extent of our imaging ($\sim 2.5 R_e$), which is steeper than literature measurements. Our finding is consistent with predicted gradients from the publicly-available FIRE-2 simulations, in which bursty star formation creates stellar population gradients and dark matter cores; (iii) Tucana's bifurcated RGB has distinct metallicities: a blue RGB with $\langle \mbox{[Fe/H]} \rangle = -1.78 \pm 0.06$ and $\sigma_{\mbox{[Fe/H]}}=0.44^{+0.07}_{-0.06}$, and a red RGB with $\langle \mbox{[Fe/H]} \rangle = -1.08 \pm 0.07$ and $\sigma_{\mbox{[Fe/H]}}=0.42 \pm 0.06$; (iv) At fixed stellar mass, Tucana is more MR than MW satellites by $\sim 0.4$ dex, but its blue RGB is chemically comparable to the satellites. Tucana's MDF appears consistent with star-forming isolated dwarfs, though MDFs of the latter are not as well-populated; (v) $\sim2$% of Tucana's stars have $\mbox{[Fe/H]} < -3$ and 20% $\mbox{[Fe/H]} > -1$. We provide a catalog for community spectroscopic follow-up.


title: Building up a model family for inflammations

abstract: The paper presents an approach for overcoming modeling problems of typical life science applications with partly unknown mechanisms and lacking quantitative data: A model family of reaction diffusion equations is built up on a mesoscopic scale and uses classes of feasible functions for reaction and taxis terms. The classes are found by translating biological knowledge into mathematical conditions and the analysis of the models further constrains the classes. Numerical simulations allow comparing single models out of the model family with available qualitative information on the solutions from observations. The method provides insight into a hierarchical order of the mechanisms. The method is applied to the clinics for liver inflammation such as metabolic dysfunction-associated steatohepatitis (MASH) or viral hepatitis where reasons for the chronification of disease are still unclear and time- and space-dependent data is unavailable.


title: Properties of an interplanetary shock observed at 0.07 and 0.7 Astronomical Units by Parker Solar Probe and Solar Orbiter

abstract: The Parker Solar Probe (PSP) and Solar Orbiter (SolO) missions opened a new observational window in the inner heliosphere, which is finally accessible to direct measurements. On September 05, 2022, a coronal mass ejection (CME)-driven interplanetary (IP) shock has been observed as close as 0.07 au by PSP. The CME then reached SolO, which was well radially-aligned at 0.7 au, thus providing us with the opportunity to study the shock properties at so different heliocentric distances. We characterize the shock, investigate its typical parameters and compare its small-scale features at both locations. Using the PSP observations, we investigate how magnetic switchbacks and ion cyclotron waves are processed upon shock crossing. We find that switchbacks preserve their V--B correlation while compressed upon the shock passage, and that the signature of ion cyclotron waves disappears downstream of the shock. By contrast, the SolO observations reveal a very structured shock transition, with a population of shock-accelerated protons of up to about 2 MeV, showing irregularities in the shock downstream, which we correlate with solar wind structures propagating across the shock. At SolO, we also report the presence of low-energy ($\sim$ 100 eV) electrons scattering due to upstream shocklets. This study elucidates how the local features of IP shocks and their environments can be very different as they propagate through the heliosphere.


title: Accurate Differential Operators for Hybrid Neural Fields

abstract: Neural fields have become widely used in various fields, from shape representation to neural rendering, and for solving partial differential equations (PDEs). With the advent of hybrid neural field representations like Instant NGP that leverage small MLPs and explicit representations, these models train quickly and can fit large scenes. Yet in many applications like rendering and simulation, hybrid neural fields can cause noticeable and unreasonable artifacts. This is because they do not yield accurate spatial derivatives needed for these downstream applications. In this work, we propose two ways to circumvent these challenges. Our first approach is a post hoc operator that uses local polynomial-fitting to obtain more accurate derivatives from pre-trained hybrid neural fields. Additionally, we also propose a self-supervised fine-tuning approach that refines the neural field to yield accurate derivatives directly while preserving the initial signal. We show the application of our method on rendering, collision simulation, and solving PDEs. We observe that using our approach yields more accurate derivatives, reducing artifacts and leading to more accurate simulations in downstream applications.


title: Fused Extended Two-Way Fixed Effects for Difference-in-Differences with Staggered Adoptions

abstract: To address the bias of the canonical two-way fixed effects estimator for difference-in-differences under staggered adoptions, Wooldridge (2021) proposed the extended two-way fixed effects estimator, which adds many parameters. However, this reduces efficiency. Restricting some of these parameters to be equal (for example, subsequent treatment effects within a cohort) helps, but ad hoc restrictions may reintroduce bias. We propose a machine learning estimator with a single tuning parameter, fused extended two-way fixed effects (FETWFE), that enables automatic data-driven selection of these restrictions. We prove that under an appropriate sparsity assumption FETWFE identifies the correct restrictions with probability tending to one, which improves efficiency. We also prove the consistency, oracle property, and asymptotic normality of FETWFE for several classes of heterogeneous marginal treatment effect estimators under either conditional or marginal parallel trends, and we prove the same results for conditional average treatment effects under conditional parallel trends. We demonstrate FETWFE in simulation studies and an empirical application.


title: Reconstruction of Cortical Surfaces with Spherical Topology from Infant Brain MRI via Recurrent Deformation Learning

abstract: Cortical surface reconstruction (CSR) from MRI is key to investigating brain structure and function. While recent deep learning approaches have significantly improved the speed of CSR, a substantial amount of runtime is still needed to map the cortex to a topologically-correct spherical manifold to facilitate downstream geometric analyses. Moreover, this mapping is possible only if the topology of the surface mesh is homotopic to a sphere. Here, we present a method for simultaneous CSR and spherical mapping efficiently within seconds. Our approach seamlessly connects two sub-networks for white and pial surface generation. Residual diffeomorphic deformations are learned iteratively to gradually warp a spherical template mesh to the white and pial surfaces while preserving mesh topology and uniformity. The one-to-one vertex correspondence between the template sphere and the cortical surfaces allows easy and direct mapping of geometric features like convexity and curvature to the sphere for visualization and downstream processing. We demonstrate the efficacy of our approach on infant brain MRI, which poses significant challenges to CSR due to tissue contrast changes associated with rapid brain development during the first postnatal year. Performance evaluation based on a dataset of infants from 0 to 12 months demonstrates that our method substantially enhances mesh regularity and reduces geometric errors, outperforming state-of-the-art deep learning approaches, all while maintaining high computational efficiency.


title: Delaunay Triangulations in the Hilbert Metric

abstract: The Hilbert metric is a distance function defined for points lying within the interior of a convex body. It arises in the analysis and processing of convex bodies, machine learning, and quantum information theory. In this paper, we show how to adapt the Euclidean Delaunay triangulation to the Hilbert geometry defined by a convex polygon in the plane. We analyze the geometric properties of the Hilbert Delaunay triangulation, which has some notable differences with respect to the Euclidean case, including the fact that the triangulation does not necessarily cover the convex hull of the point set. We also introduce the notion of a Hilbert ball at infinity, which is a Hilbert metric ball centered on the boundary of the convex polygon. We present a simple randomized incremental algorithm that computes the Hilbert Delaunay triangulation for a set of $n$ points in the Hilbert geometry defined by a convex $m$-gon. The algorithm runs in $O(n (\log n + \log^3 m))$ expected time. In addition we introduce the notion of the Hilbert hull of a set of points, which we define to be the region covered by their Hilbert Delaunay triangulation. We present an algorithm for computing the Hilbert hull in time $O(n h \log^2 m)$, where $h$ is the number of points on the hull's boundary.


title: Natural Interaction Modalities for Human-CPS Interaction in Construction Progress Monitoring

abstract: This article explores natural interaction modalities for human-cyber-physical systems (CPS) interaction in construction. CPS has been applied in construction for many purposes with the promise of improving the safety and productivity of construction operations. However, there is little research on human-CPS interaction in construction. This study proposes two methodologies for human-CPS interactions for construction progress monitoring - a) hand gesture interaction using transfer learning, and b) voice command interaction using natural language processing. User studies with thirty-two users validated the generalizability of the proposed methodologies. The proposed hand gesture recognition method achieved higher accuracy (99.69% vs 87.72%) and speed (36.05ms vs 578.91ms) than the proposed voice command recognition method, though users performed the progress monitoring task more correctly with voice commands than hand gestures (88% vs 66.1%). The main contribution of the study is the development of an ML pipeline and computational framework to recognize hand gestures and voice commands without the need for a large training dataset for human-CPS interaction.


title: A Note on the Convergence of Denoising Diffusion Probabilistic Models

abstract: Diffusion models are one of the most important families of deep generative models. In this note, we derive a quantitative upper bound on the Wasserstein distance between the data-generating distribution and the distribution learned by a diffusion model. Unlike previous works in this field, our result does not make assumptions on the learned score function. Moreover, our bound holds for arbitrary data-generating distributions on bounded instance spaces, even those without a density w.r.t. the Lebesgue measure, and the upper bound does not suffer from exponential dependencies. Our main result builds upon the recent work of Mbacke et al. (2023) and our proofs are elementary.


title: Constructing Vec-tionaries to Extract Message Features from Texts: A Case Study of Moral Appeals

abstract: While researchers often study message features like moral content in text, such as party manifestos and social media, their quantification remains a challenge. Conventional human coding struggles with scalability and intercoder reliability. While dictionary-based methods are cost-effective and computationally efficient, they often lack contextual sensitivity and are limited by the vocabularies developed for the original applications. In this paper, we present an approach to construct vec-tionary measurement tools that boost validated dictionaries with word embeddings through nonlinear optimization. By harnessing semantic relationships encoded by embeddings, vec-tionaries improve the measurement of message features from text, especially those in short format, by expanding the applicability of original vocabularies to other contexts. Importantly, a vec-tionary can produce additional metrics to capture the valence and ambivalence of a message feature beyond its strength in texts. Using moral content in tweets as a case study, we illustrate the steps to construct the moral foundations vec-tionary, showcasing its ability to process texts missed by conventional dictionaries and word embedding methods and to produce measurements better aligned with crowdsourced human assessments. Furthermore, additional metrics from the vec-tionary unveiled unique insights that facilitated predicting outcomes such as message retransmission.


title: Modifying RL Policies with Imagined Actions: How Predictable Policies Can Enable Users to Perform Novel Tasks

abstract: It is crucial that users are empowered to use the functionalities of a robot to creatively solve problems on the fly. A user who has access to a Reinforcement Learning (RL) based robot may want to use the robot's autonomy and their knowledge of its behavior to complete new tasks. One way is for the user to take control of some of the robot's action space through teleoperation while the RL policy simultaneously controls the rest. However, an out-of-the-box RL policy may not readily facilitate this. For example, a user's control may bring the robot into a failure state from the policy's perspective, causing it to act in a way the user is not familiar with, hindering the success of the user's desired task. In this work, we formalize this problem and present Imaginary Out-of-Distribution Actions, IODA, an initial algorithm for addressing that problem and empowering user's to leverage their expectation of a robot's behavior to accomplish new tasks.


title: Probing the Interactions of Axion-Like Particles with Electroweak Bosons and the Higgs Boson in the High Energy Regime at LHC

abstract: We study the interactions of Axion-Like Particles (ALPs) with the Standard Model particles, aiming to probe their phenomenology via non-resonant searches at the LHC. These interactions are mediated by higher dimensional effective operators within two possible frameworks of linearly and non-linearly realised electroweak symmetry breaking. We consider the ALPs to be light enough to be produced on-shell and exploit their derivative couplings with the SM Higgs boson and the gauge bosons. We will use the high momentum transfer processes, namely $hZ, Z\gamma, WW$ and $WW\gamma$ production from $pp$ collisions. We derive upper limits on the gauge-invariant interactions of ALPs with the electroweak bosons and/or Higgs boson that contribute to these processes, from the re-interpretation of the latest Run 2 available LHC data. The constraints we obtain are strong for ALP masses below 100 GeV. These allowed effective interactions in the ALP parameter space yield better significance at HL-LHC and thus, offer promising avenues for subsequent studies. Furthermore, we augment our cut-based analysis with gradient-boosted decision trees, which improve the statistical significance distinctly across these interaction channels. We briefly compare the results with the complementary probe of these couplings via direct production of ALPs in association with the Higgs boson or a vector boson.


title: FastPart: Over-Parameterized Stochastic Gradient Descent for Sparse optimisation on Measures

abstract: This paper presents a novel algorithm that leverages Stochastic Gradient Descent strategies in conjunction with Random Features to augment the scalability of Conic Particle Gradient Descent (CPGD) specifically tailored for solving sparse optimisation problems on measures. By formulating the CPGD steps within a variational framework, we provide rigorous mathematical proofs demonstrating the following key findings: (i) The total variation norms of the solution measures along the descent trajectory remain bounded, ensuring stability and preventing undesirable divergence; (ii) We establish a global convergence guarantee with a convergence rate of $\mathcal{O}(\log(K)/\sqrt{K})$ over $K$ iterations, showcasing the efficiency and effectiveness of our algorithm; (iii) Additionally, we analyze and establish local control over the first-order condition discrepancy, contributing to a deeper understanding of the algorithm's behavior and reliability in practical applications.


title: mir_ref: A Representation Evaluation Framework for Music Information Retrieval Tasks

abstract: Music Information Retrieval (MIR) research is increasingly leveraging representation learning to obtain more compact, powerful music audio representations for various downstream MIR tasks. However, current representation evaluation methods are fragmented due to discrepancies in audio and label preprocessing, downstream model and metric implementations, data availability, and computational resources, often leading to inconsistent and limited results. In this work, we introduce mir_ref, an MIR Representation Evaluation Framework focused on seamless, transparent, local-first experiment orchestration to support representation development. It features implementations of a variety of components such as MIR datasets, tasks, embedding models, and tools for result analysis and visualization, while facilitating the implementation of custom components. To demonstrate its utility, we use it to conduct an extensive evaluation of several embedding models across various tasks and datasets, including evaluating their robustness to various audio perturbations and the ease of extracting relevant information from them.


title: From Correspondences to Pose: Non-minimal Certifiably Optimal Relative Pose without Disambiguation

abstract: Estimating the relative camera pose from $n \geq 5$ correspondences between two calibrated views is a fundamental task in computer vision. This process typically involves two stages: 1) estimating the essential matrix between the views, and 2) disambiguating among the four candidate relative poses that satisfy the epipolar geometry. In this paper, we demonstrate a novel approach that, for the first time, bypasses the second stage. Specifically, we show that it is possible to directly estimate the correct relative camera pose from correspondences without needing a post-processing step to enforce the cheirality constraint on the correspondences. Building on recent advances in certifiable non-minimal optimization, we frame the relative pose estimation as a Quadratically Constrained Quadratic Program (QCQP). By applying the appropriate constraints, we ensure the estimation of a camera pose that corresponds to a valid 3D geometry and that is globally optimal when certified. We validate our method through exhaustive synthetic and real-world experiments, confirming the efficacy, efficiency and accuracy of the proposed approach. Code is available at https://github.com/javrtg/C2P.


title: Achieving Fairness and Accuracy in Regressive Property Taxation

abstract: Regressivity in property taxation, or the disproportionate overassessment of lower-valued properties compared to higher-valued ones, results in an unfair taxation burden for Americans living in poverty. To address regressivity and enhance both the accuracy and fairness of property assessments, we introduce a scalable property valuation model called the $K$-segment model. Our study formulates a mathematical framework for the $K$-segment model, which divides a single model into $K$ segments and employs submodels for each segment. Smoothing methods are incorporated to balance and smooth the multiple submodels within the overall model. To assess the fairness of our proposed model, we introduce two innovative fairness measures for property evaluation and taxation, focusing on group-level fairness and extreme sales price portions where unfairness typically arises. Compared to the model employed currently in practice, our study demonstrates that the $K$-segment model effectively improves fairness based on the proposed measures. Furthermore, we investigate the accuracy--fairness trade-off in property assessments and illustrate how the $K$-segment model balances high accuracy with fairness for all properties. Our work uncovers the practical impacts of the $K$-segment models in addressing regressivity in property taxation, offering a tangible solution for policymakers and property owners. By implementing this model, we pave the way for a fairer taxation system, ensuring a more equitable distribution of tax burdens.


title: Bijection between positive clusters and projectively signed exceptional sequences

abstract: In 2017, Igusa and Todorov gave a bijection between signed exceptional sequences and ordered partial clusters. In this paper, we show that every term in an exceptional sequence is either relatively projective or relatively injective or both and we refine this bijection to one between projectively signed exceptional sequences and ordered partial positive clusters by assigning signs to objects that are not relatively injective. We also give a characterization of relatively projective/injective objects in terms of supports of the objects in the exceptional sequence.


title: Analytical Insights into Constant-Roll Condition: Extending the Paradigm to Non-Canonical Models

abstract: In this work, we explore the prospect of generalizing the constant-roll condition in canonical inflationary model to non-canonical models. To find a natural generalization, we focus on three manifestations of this condition and construct constant-roll models corresponding to each manifestation. These models are not equivalent but reduce to the familiar constant-roll model in canonical limit. To showcase the applicability of our generalized mechanism, we examine a specific class of non-canonical models, which can be viewed as extensions of k/G inflation. In these models sound speed is constant. We conduct a comparative study, and with an analytical examination of the model, specify instances when our constant-roll conditions yield dissimilar outcomes and when they exhibit analogies. We also apply our findings to scrutinize another kinetically driven inflationary model with varying sound speed. We demonstrate that each of our constant-roll conditions leads to a unique set of solutions. Afterward, we construct a four-stage constant-roll kinetically driven inflation that complies with CMB constraints, it sustains for a sufficiently long period of time, and finally gracefully exits. In this model the spectrum of curvature perturbations is enhanced in a brief phase of non-slow-roll inflationary evolution. Employing numerical methods, we analyse this scenario to elucidate how altering the constant-roll condition impacts the power spectrum and the model's dynamics.


title: On common zeros of entire functions of exponential growth

abstract: For systems of equations with an infinite set of roots, one can sometimes obtain Kushnirenko-Bernstein-Khovanskii type theorem if replace the number of roots by their asymptotic density. We consider systems of entire functions with exponential growth in the space $\mathbb C^n$, and calculate the asymptotic distribution of their common zeros in terms of the geometry of convex sets in the space $\mathbb C^n$.


title: The bouncing barrier revisited: Impact on key planet formation processes and observational signatures

abstract: Context. A leading paradigm in planet formation is currently the streaming instability and pebble accretion scenario. For this scenario, dust must grow into sizes in a specific regime of Stokes numbers in order to make these processes viable and sufficiently effective. The dust growth models currently in use do not implement some of the growth barriers suggested to be relevant in the literature. Aims. We want to investigate if the bouncing barrier, when effective, has impact on the time scales and efficiencies of processes like the streaming instability and pebble accretion, as well as on the observational appearance of planet-forming disks. Methods. We implement a formalism for the bouncing barrier into the publicly available dust growth model DustPy and run a series of models to understand the impact. Results. We find that the bouncing barrier has significant effect on the dust evolution in planet-forming disks. It reduces in many cases the size of the typical or largest particles available in the disk, it produces a very narrow, almost mono-disperse size distribution and removes most micrometer-sized grains in the process, with impact on scattered light images. It modifies the settling and therefore the effectiveness of and timescales for the streaming instability and for pebble accretion. An active bouncing barrier may well have observational consequences. It may reduce the strength if signatures of small particles (e.g. the 10 micron silicate feature), and it may create additional shadowed regions visible in scattered light images. Conclusions. Modeling of planet formation leaning heavily on the streaming instability and on pebble accretion should take the bouncing barrier into account. The complete removal of small grains in our model is not consistent with observations. However, this could be resolved by incomplete vertical mixing or some level of erosion in collisions.


title: The SyGuS Language Standard Version 2.1

abstract: The classical formulation of the program-synthesis problem is to find a program that meets a correctness specification given as a logical formula. Syntax-guided synthesis (SyGuS) is a standardized format for specifying the correctness specification with a syntactic template that constrains the space of allowed implementations. The input to SyGuS consists of a background theory, a semantic correctness specification for the desired program given by a logical formula, and a syntactic set of candidate implementations given by a grammar. The computational problem then is to find an implementation from the set of candidate expressions that satisfies the specification in the given theory. The formulation of the problem builds on SMT-LIB. This document defines the SyGuS 2.1 standard, which is intended to be used as the standard input and output language for solvers targeting the syntax-guided synthesis problem. It borrows many concepts and language constructs from the standard format for Satisfiability Modulo Theories (SMT) solvers, the SMT-LIB 2.6 standard.


title: Large Language Models on Lexical Semantic Change Detection: An Evaluation

abstract: Lexical Semantic Change Detection stands out as one of the few areas where Large Language Models (LLMs) have not been extensively involved. Traditional methods like PPMI, and SGNS remain prevalent in research, alongside newer BERT-based approaches. Despite the comprehensive coverage of various natural language processing domains by LLMs, there is a notable scarcity of literature concerning their application in this specific realm. In this work, we seek to bridge this gap by introducing LLMs into the domain of Lexical Semantic Change Detection. Our work presents novel prompting solutions and a comprehensive evaluation that spans all three generations of language models, contributing to the exploration of LLMs in this research area.


title: Algebraic and symplectic curves of degree 8

abstract: We study the existence of some irreducible projective plane curves of degree~$8$ with some prescribed topological type of singularities in the algebraic and symplectic worlds.


title: Multiplier Optimization via E-Graph Rewriting

abstract: Multiplier circuits account for significant resource usage in datapath-dominated circuit designs, and RTL designers continue to build bespoke hand-crafted multiplication arrays for their particular application. The construction of an optimized multiplier presents trade-offs between pre-processing to generate a smaller array and array reduction. A data structure known as an e-graph has recently been applied to datapath optimization, where the e-graph's ability to efficiently explore trade-offs has been shown to be crucial. We propose an e-graph based rewriting framework to construct optimized multiplier circuits. Such a framework can express alternative multiplier representations and generate customized circuit designs. We demonstrate that the proposed tool, which we call OptiMult, can reduce the latency of a squarer by up to 46% and reduce the latency of a standard multiplier by up to 9% when compared against logic synthesis instantiated components.


title: Software issues report for bug fixing process: An empirical study of machine-learning libraries

abstract: Issue resolution and bug-fixing processes are essential in the development of machine-learning libraries, similar to software development, to ensure well-optimized functions. Understanding the issue resolution and bug-fixing process of machine-learning libraries can help developers identify areas for improvement and optimize their strategies for issue resolution and bug-fixing. However, detailed studies on this topic are lacking. Therefore, we investigated the effectiveness of issue resolution for bug-fixing processes in six machine-learning libraries: Tensorflow, Keras, Theano, Pytorch, Caffe, and Scikit-learn. We addressed seven research questions (RQs) using 16,921 issues extracted from the GitHub repository via the GitHub Rest API. We employed several quantitative methods of data analysis, including correlation, OLS regression, percentage and frequency count, and heatmap to analyze the RQs. We found the following through our empirical investigation: (1) The most common categories of issues that arise in machine-learning libraries are bugs, documentation, optimization, crashes, enhancement, new feature requests, build/CI, support, and performance. (2) Effective strategies for addressing these problems include fixing critical bugs, optimizing performance, and improving documentation. (3) These categorized issues are related to testing and runtime and are common among all six machine-learning libraries. (4) Monitoring the total number of comments on issues can provide insights into the duration of the issues. (5) It is crucial to strike a balance between prioritizing critical issues and addressing other issues in a timely manner. Therefore, this study concludes that efficient issue-tracking processes, effective communication, and collaboration are vital for effective resolution of issues and bug fixing processes in machine-learning libraries.


title: Grain Boundary Grooving in a Bicrystal with Passivation Coating

abstract: We use the sixth order linear parabolic equation \begin{equation} \frac{\partial y}{\partial t}=B\left(\alpha\frac{\partial^{6}y}{\partial x^{6}}-\frac{\partial^{4}y}{\partial x^{4}}\right),\ x\in \mathbb{R}_{+},\ t>0,\nonumber \end{equation} proposed by Rabkin and describing the evolution of a solid surface covered with a thin, inert and fully elastic passivation layer, to analyze the grain boundary groove formation on initially flat surface. We derive the corresponding boundary conditions and construct an asymptotic representation of the solution to this initial boundary value problem when $\alpha$ is small, by applying the theory of singular perturbation. We illustrate the effect of passivation film near and far from a grain boundary groove.


title: X-ray luminosity versus orbital period of AM CVn systems

abstract: AM CVn systems are a rare type of cataclysmic variable star consisting of a w hite dwarf accreting material from a low-mass, hydrogen-poor donor star. These helium-rich systems usually have orbital periods that are less than 65 minutes an d are predicted to be sources of gravitational waves. We have analyzed the catalogued X-ray data from the Chandra, XMM-Newton, and the Neil Gehrels Swift Observatory (hereafter referred to as 'Swift') to investigate the relationship between X-ray luminosity and the orbital period of AM CVn systems. We find that the high accretion-rate systems which are likely to have optically thick boundary laye rs are sub-luminous in X-rays relative to theoretical model predictions for the boundary layer luminosity, while the longer orbital period, lower bolometric luminosity systems match fairly well to the model predictions, with the exception of an overluminous system which has already been suggested to show magnetic accretion.


title: Guardians of Trust: Navigating Data Security in AIOps through Vendor Partnerships

abstract: Artificial Intelligence for IT Operations (AIOps) is a rapidly growing field that applies artificial intelligence and machine learning to automate and optimize IT operations. AIOps vendors provide services that ingest end-to-end logs, traces, and metrics to offer a full stack observability of IT systems. However, these data sources may contain sensitive information such as internal IP addresses, hostnames, HTTP headers, SQLs, method/argument return values, URLs, personal identifiable information (PII), or confidential business data. Therefore, data security is a crucial concern when working with AIOps vendors. In this article, we will discuss the security features offered by different vendors and how we can adopt best practices to ensure data protection and privacy.


title: Accelerated parameter estimation in Bilby with relative binning

abstract: We describe an implementation of the relative binning technique to speed up parameter estimation of gravitational-wave signals. We first give a pedagogical overview of relative binning, discussing also the expressions for the likelihood marginalized over phase and distance. Then, we describe the details of the code in \texttt{Bilby}, an open-source software package commonly used for parameter estimation of gravitational-wave sources. Our code is able to reproduce the parameters of GW170817 in 14 hours on a single-core CPU, performs well on simulated signals, and passes the percentile-percentile (p-p) tests. We also illustrate that relative binning is an ideal technique to estimate the parameters of signals in next-generation gravitational wave detectors.


title: A Practical Survey on Emerging Threats from AI-driven Voice Attacks: How Vulnerable are Commercial Voice Control Systems?

abstract: The emergence of Artificial Intelligence (AI)-driven audio attacks has revealed new security vulnerabilities in voice control systems. While researchers have introduced a multitude of attack strategies targeting voice control systems (VCS), the continual advancements of VCS have diminished the impact of many such attacks. Recognizing this dynamic landscape, our study endeavors to comprehensively assess the resilience of commercial voice control systems against a spectrum of malicious audio attacks. Through extensive experimentation, we evaluate six prominent attack techniques across a collection of voice control interfaces and devices. Contrary to prevailing narratives, our results suggest that commercial voice control systems exhibit enhanced resistance to existing threats. Particularly, our research highlights the ineffectiveness of white-box attacks in black-box scenarios. Furthermore, the adversaries encounter substantial obstacles in obtaining precise gradient estimations during query-based interactions with commercial systems, such as Apple Siri and Samsung Bixby. Meanwhile, we find that current defense strategies are not completely immune to advanced attacks. Our findings contribute valuable insights for enhancing defense mechanisms in VCS. Through this survey, we aim to raise awareness within the academic community about the security concerns of VCS and advocate for continued research in this crucial area.


title: Superconductivity in correlated carbon nanotubes under pressure: A Bogoliubov-de Gennes study

abstract: In contrast to most microscopic theories of superconductivity based on the reciprocal space, the Bogoliubov-de Gennes (BdG) formalism provides a real-space alternative for addressing inhomogeneous systems. In this article, we study the superconducting states in correlated single-walled carbon nanotubes (SWNTs) with curvature and spin-orbit corrections, as well as the inter-tube interaction through a connecting molecule using an attractive Hubbard model. The results reveal a close relationship between the on-site superconducting gap and the single-electron local density of states. For the limiting case of independent large-diameter nanotubes, the BdG equations can be reduced to the standard Bardeen-Cooper-Schrieffer one with analytical solutions. Moreover, an optimal separation between nanotubes is found, which leads to a maximal superconducting critical temperature. This finding has a remarkable accordance with the experimental data obtained from Buckypapers built of boron doped SWNTs under external pressure.


title: On Correlations of Liouville-like Functions

abstract: Let $\mathcal{A}$ be a set of mutually coprime positive integers, satisfying \begin{align*} \sum\limits_{a\in\mathcal{A}}\frac{1}{a} = \infty. \end{align*} Define the (possibly non-multiplicative) "Liouville-like" functions \begin{align*} \lambda_{\mathcal{A}}(n) = (-1)^{\#\{a:a|n, a \in \mathcal{A}\}} \text{ or } (-1)^{\#\{a:a^\nu\parallel n, a \in \mathcal{A}, \nu \in \mathbb{N}\}}. \end{align*} We show that \begin{align*} \lim\limits_{x\to\infty}\frac{1}{x}\sum\limits_{n \leq x} \lambda_\mathcal{A}(n) = 0 \end{align*} holds, answering a question of de la Rue.


title: Minimal free resolution of generalized repunit algebras

abstract: Let $\Bbbk$ be an arbitrary field and let $b > 1, n > 1$ and $a$ be three positive integers. In this paper we explicitly describe a minimal $S-$graded free resolution of the semigroup algebra $\Bbbk[S]$ when $S$ is a generalized repunit numerical semigroup, that is, when $S$ is the submonoid of $\mathbb{N}$ generated by $\{a_1, a_2, \ldots, a_n\}$ where $a_1 = \sum_{j=0}^{n-1} b^j$ and $a_i - a_{i-1} = a\, b^{i-2},\ i = 2, \ldots, n$, with $\gcd(a,a_1) = 1$.


title: Linear Quadratic Dual Control

abstract: This is a draft paper originally posted on Arxiv as a documentation of a plenary lecture at CDC2023. The core material has been accepted for publication at L4DC 2024. Certainty equivalence adaptive controllers are analysed using a ``data-driven Riccati equation'', corresponding to the model-free Bellman equation used in Q-learning. The equation depends quadratically on data correlation matrices. This makes it possible to derive simple sufficient conditions for stability and robustness to unmodeled dynamics in adaptive systems. The paper is concluded by short remarks on how the bounds can be used to quantify the interplay between excitation levels and robustness.


title: Speeding up astrochemical reaction networks with autoencoders and neural ODEs

abstract: In astrophysics, solving complex chemical reaction networks is essential but computationally demanding due to the high dimensionality and stiffness of the ODE systems. Traditional approaches for reducing computational load are often specialized to specific chemical networks and require expert knowledge. This paper introduces a machine learning-based solution employing autoencoders for dimensionality reduction and a latent space neural ODE solver to accelerate astrochemical reaction network computations. Additionally, we propose a cost-effective latent space linear function solver as an alternative to neural ODEs. These methods are assessed on a dataset comprising 29 chemical species and 224 reactions. Our findings demonstrate that the neural ODE achieves a 55x speedup over the baseline model while maintaining significantly higher accuracy by up to two orders of magnitude reduction in relative error. Furthermore, the linear latent model enhances accuracy and achieves a speedup of up to 4000x compared to standard methods.


title: GAMMA: Galactic Attributes of Mass, Metallicity, and Age Dataset

abstract: We introduce the GAMMA (Galactic Attributes of Mass, Metallicity, and Age) dataset, a comprehensive collection of galaxy data tailored for Machine Learning applications. This dataset offers detailed 2D maps and 3D cubes of 11 727 galaxies, capturing essential attributes: stellar age, metallicity, and mass. Together with the dataset, we publish our code to extract any other stellar or gaseous property from the raw simulation suite to extend the dataset beyond these initial properties, ensuring versatility for various computational tasks. Ideal for feature extraction, clustering, and regression tasks, GAMMA offers a unique lens to explore galactic structures using computational methods and is a bridge between astrophysical simulations and the field of scientific machine learning (ML). As a first benchmark, we applied Principal Component Analysis (PCA) to this dataset. We find that PCA effectively captures the key morphological features of galaxies with a small number of components. We achieve a dimensionality reduction by a factor of approximately 200 (3650) for 2D images (3D cubes) with a reconstruction accuracy below 5%.


title: GalacticFlow: Learning a Generalized Representation of Galaxies with Normalizing Flows

abstract: State-of-the-art galaxy formation simulations generate data within weeks or months. Their results consist of a random sub-sample of possible galaxies with a fixed number of stars. We propose a ML based method, GalacticFlow, that generalizes such results. We use normalizing flows to learn the extended distribution function of galaxies conditioned on global galactic parameters. GalacticFlow then provides a continuized and condensed representation of the ensemble of galaxies in the data. Thus, essentially compressing large amounts of explicit simulation data into a small implicit generative model. Our model is able to evaluate any galaxy eDF given by a set of global parameters and allows generating arbitrarily many stars from it. We show that we can learn such a representation, embodying the entire mass range from dwarf to Milky Way mass, from only 90 galaxies in $\sim18$ hours on a single RTX 2080Ti and generate a new galaxy of one million stars within a few seconds.


title: A Multivariate Polya Tree Model for Meta-Analysis with Event Time Distributions

abstract: We develop a non-parametric Bayesian prior for a family of random probability measures by extending the Polya tree ($PT$) prior to a joint prior for a set of probability measures $G_1,\dots,G_n$, suitable for meta-analysis with event time outcomes. In the application to meta-analysis $G_i$ is the event time distribution specific to study $i$. The proposed model defines a regression on study-specific covariates by introducing increased correlation for any pair of studies with similar characteristics. The desired multivariate $PT$ model is constructed by introducing a hierarchical prior on the conditional splitting probabilities in the $PT$ construction for each of the $G_i$. The hierarchical prior replaces the independent beta priors for the splitting probability in the $PT$ construction with a Gaussian process prior for corresponding (logit) splitting probabilities across all studies. The Gaussian process is indexed by study-specific covariates, introducing the desired dependence with increased correlation for similar studies. The main feature of the proposed construction is (conditionally) conjugate posterior updating with commonly reported inference summaries for event time data. The construction is motivated by a meta-analysis over cancer immunotherapy studies.


title: On the relativistic quantum mechanics of a photon between two electrons in 1+1 dimensions

abstract: A Lorentz-covariant system of wave equations is formulated for a quantum-mechanical three-body system in one space dimension, comprised of one photon and two identical massive spin one-half Dirac particles, which can be thought of as two electrons (or alternatively, two positrons). Manifest covariance is achieved using Dirac's formalism of multi-time wave functions, i.e, wave functions $\Psi(\textbf{x}_{\text{ph}},\textbf{x}_{\text{e}_1},\textbf{x}_{\text{e}_2})$ where $\textbf{x}_{\text{ph}},\textbf{x}_{\text{e}_1},\textbf{x}_{\text{e}_2}$ are generic spacetime events of the photon and two electrons respectively. Their interaction is implemented via a Lorentz-invariant no-crossing-of-paths boundary condition at the coincidence submanifolds $\{\textbf{x}_{\text{ph}}=\textbf{x}_{\text{e}_1}\}$ and $\{\textbf{x}_{\text{ph}}=\textbf{x}_{\text{e}_2}\}$ compatible with conservation of probability current. The corresponding initial-boundary value problem is shown to be well-posed under the additional assumption of anti-symmetry given by the Pauli exclusion principle, and a closed-form solution to the ensuing coupled system of Klein-Gordon and transport equations is given.


title: ZWCL 1856.8 : A rare double radio relic system captured within NuSTAR and Chandra field of view

abstract: Observations of galaxy cluster mergers provide insights on the particle acceleration and heating mechanisms taking place within the intracluster medium. Mergers form shocks that propagate through the plasma, which result in shock/cold fronts in the X-ray, and radio halos and/or relics in the radio regime. The connection between these tracers and the mechanisms driving non-thermal processes, such as inverse Compton, are not well understood. ZWCL 1856.8 is one of the few known double radio relic systems that originate from nearly head-on collisions observed close to the plane of the sky. For the first time, we study NuSTAR and Chandra observations of such a system that contains both relics within their field of view. The spectro-imaging analyses results of the system suggest weak shock fronts with $\mathcal{M}$ numbers within 2$\sigma$ of the radio derived values, and provide evidence of inverse Compton emission at both relic sites. Our findings have great uncertainties due to the shallow exposure times available. Deeper NuSTAR and Chandra data are crucial for studying the connection of the radio and X-ray emission features and for constraining the thermal vs. non-thermal emission contributions in this system. We also present methods and approaches on how to investigate X-ray properties of double relic systems by taking full advantage of the complementary properties of NuSTAR and Chandra missions.


title: GenDepth: Generalizing Monocular Depth Estimation for Arbitrary Camera Parameters via Ground Plane Embedding

abstract: Learning-based monocular depth estimation leverages geometric priors present in the training data to enable metric depth perception from a single image, a traditionally ill-posed problem. However, these priors are often specific to a particular domain, leading to limited generalization performance on unseen data. Apart from the well studied environmental domain gap, monocular depth estimation is also sensitive to the domain gap induced by varying camera parameters, an aspect that is often overlooked in current state-of-the-art approaches. This issue is particularly evident in autonomous driving scenarios, where datasets are typically collected with a single vehicle-camera setup, leading to a bias in the training data due to a fixed perspective geometry. In this paper, we challenge this trend and introduce GenDepth, a novel model capable of performing metric depth estimation for arbitrary vehicle-camera setups. To address the lack of data with sufficiently diverse camera parameters, we first create a bespoke synthetic dataset collected with different vehicle-camera systems. Then, we design GenDepth to simultaneously optimize two objectives: (i) equivariance to the camera parameter variations on synthetic data, (ii) transferring the learned equivariance to real-world environmental features using a single real-world dataset with a fixed vehicle-camera system. To achieve this, we propose a novel embedding of camera parameters as the ground plane depth and present a novel architecture that integrates these embeddings with adversarial domain alignment. We validate GenDepth on several autonomous driving datasets, demonstrating its state-of-the-art generalization capability for different vehicle-camera systems.


title: Exploiting Representation Bias for Data Distillation in Abstractive Text Summarization

abstract: Abstractive text summarization is surging with the number of training samples to cater to the needs of the deep learning models. These models tend to exploit the training data representations to attain superior performance by improving the quantitative element of the resultant summary. However, increasing the size of the training set may not always be the ideal solution to maximize the performance, and therefore, a need to revisit the quality of training samples and the learning protocol of deep learning models is a must. In this paper, we aim to discretize the vector space of the abstractive text summarization models to understand the characteristics learned between the input embedding space and the models' encoder space. We show that deep models fail to capture the diversity of the input space. Further, the distribution of data points on the encoder space indicates that an unchecked increase in the training samples does not add value; rather, a tear-down of data samples is highly needed to make the models focus on variability and faithfulness. We employ clustering techniques to learn the diversity of a model's sample space and how data points are mapped from the embedding space to the encoder space and vice versa. Further, we devise a metric to filter out redundant data points to make the model more robust and less data hungry. We benchmark our proposed method using quantitative metrics, such as Rouge, and qualitative metrics, such as BERTScore, FEQA and Pyramid score. We also quantify the reasons that inhibit the models from learning the diversity from the varied input samples.


title: Loop group factorization method for the magnetic and thermostatic nonabelian ray transforms

abstract: We study the injectivity of the matrix attenuated and nonabelian ray transforms on compact surfaces with boundary for nontrapping $\lambda$-geodesic flows and the general linear group of invertible complex matrices. We generalize the loop group factorization argument of Paternain and Salo to reduce to the setting of the unitary group when $\lambda$ has the vertical Fourier degree at most $1$. This covers the magnetic and thermostatic flows as special cases. Our article settles the general injectivity question of the nonabelian ray transform for the simple magnetic geodesic flows in combination with an earlier result by Ainsworth. We stress that the injectivity question in the unitary case for simple Gaussian thermostats remains open. Furthermore, we observe that the loop group argument does not apply when $\lambda$ has higher Fourier modes.


title: Thinking Assistants: LLM-Based Conversational Assistants that Help Users Think By Asking rather than Answering

abstract: We introduce the concept of "thinking assistants", an approach that encourages users to engage in deep reflection and critical thinking through brainstorming and thought-provoking queries. We instantiate one such thinking assistant, Gradschool.chat, as a virtual assistant tailored to assist prospective graduate students. We posit that thinking assistants are particularly relevant to situations like applying to graduate school, a phase often characterized by the challenges of academic preparation and the development of a unique research identity. In such situations, students often lack direct mentorship from professors, or may feel hesitant to approach faculty with their queries, making thinking assistants particularly useful. Leveraging a Large Language Model (LLM), Gradschool.chat is a demonstration system built as a thinking assistant for working with specific professors in the field of human-computer interaction (HCI). It was designed through training on information specific to these professors and a validation processes in collaboration with these academics. This technical report delineates the system's architecture and offers a preliminary analysis of our deployment study. Additionally, this report covers the spectrum of questions posed to our chatbots by users. The system recorded 223 conversations, with participants responding positively to approximately 65% of responses. Our findings indicate that users who discuss and brainstorm their research interests with Gradschool.chat engage more deeply, often interacting with the chatbot twice as long compared to those who only pose questions about professors.


title: Stress Management Using Virtual Reality-Based Attention Training

abstract: In this research, we are concerned with the applicability of virtual reality-based attention training as a tool for stress management. Mental stress is a worldwide challenge that is still far from being fully managed. This has maintained a remarkable research attention on developing and validating tools for detecting and managing stress. Technology-based tools have been at the heart of these endeavors, including virtual reality (VR) technology. Nevertheless, the potential of VR lies, to a large part, in the nature of the content being consumed through such technology. In this study, we investigate the impact of a special type of content, namely, attention training, on the feasibility of using VR for stress management. On a group of fourteen undergraduate engineering students, we conducted a study in which the participants got exposed twice to a stress inducer while their EEG signals were being recorded. The first iteration involved VR-based attention training before starting the stress task while the second time did not. Using multiple features and various machine learning models, we show that VR-based attention training has consistently resulted in reducing the number of recognized stress instances in the recorded EEG signals. This research gives preliminary insights on adopting VR-based attention training for managing stress, and future studies are required to replicate the results in larger samples.


title: Non-rigidity of the absolutely continuous part of $\mathcal{A}$-free measures

abstract: We generalize a result by Alberti, showing that, if a first-order linear differential operator $\mathcal{A}$ belongs to a certain class, then any $L^1$ function is the absolutely continuous part of a measure $\mu$ satisfying $\mathcal{A}\mu=0$. When $\mathcal{A}$ is scalar valued, we provide a necessary and sufficient condition for the above property to hold true and we prove dimensional estimates on the singular part of $\mu$. Finally, we show that operators in the above class satisfy a Lusin-type property.


title: Extending Global Fits of 4D Composite Higgs Models with Partially Composite Leptons

abstract: We perform the first convergent Bayesian global fits of 4D Composite Higgs Models with partially-composite third generation quarks and leptons based on the minimal $SO(5) \rightarrow SO(4)$ symmetry breaking pattern. We consider two models with the $\tau$ lepton and its associated neutrino in different representations of $SO(5)$. Fitting each model with a wide array of experimental constraints allows us to analyse the Bayesian evidence and currently-observed fine-tuning of each model by calculating the Kullback-Leibler divergence between their respective priors and posteriors. Both models are found to be capable of satisfying all constraints simultaneously at the $3\sigma$ level at scales of $< 5$ TeV, although the model with leptons in the $\mathbf{14}$ and $\mathbf{10}$ representations is strongly preferred over those in the $\mathbf{5}$ representation from a Bayesian viewpoint. Finally, we consider the experimental signatures for the preferred parameters in these models, including lepton partner decay signatures and gluon-fusion produced Higgs signal strengths, and discuss their potential phenomenology at future high-luminosity LHC runs.


title: Rejoinder to Discussion of "A Tale of Two Datasets: Representativeness and Generalisability of Inference for Samples of Networks''

abstract: This rejoinder responds to discussions by of Caimo, Niezink, and Schweinberger and Fritz of ''A Tale of Two Datasets: Representativeness and Generalisability of Inference for Samples of Networks'' by Krivitsky, Coletti, and Hens, all published in the Journal of the American Statistical Association in 2023.


title: Fast Classification of Large Time Series Datasets

abstract: Time series classification (TSC) is the most import task in time series mining as it has several applications in medicine, meteorology, finance cyber security, and many others. With the ever increasing size of time series datasets, several traditional TSC methods are no longer efficient enough to perform this task on such very large datasets. Yet, most recent papers on TSC focus mainly on accuracy by using methods that apply deep learning, for instance, which require extensive computational resources that cannot be applied efficiently to very large datasets. The method we introduce in this paper focuses on these very large time series datasets with the main objective being efficiency. We achieve this through a simplified representation of the time series. This in turn is enhanced by a distance measure that considers only some of the values of the represented time series. The result of this combination is a very efficient representation method for TSC. This has been tested experimentally against another time series method that is particularly popular for its efficiency. The experiments show that our method is not only 4 times faster, on average, but it is also superior in terms of classification accuracy, as it gives better results on 24 out of the 29 tested time series datasets. .


title: Fixed-flux Rayleigh-B\'enard convection in doubly periodic domains: generation of large-scale shear

abstract: This work studies two-dimensional fixed-flux Rayleigh-B\'enard convection with periodic boundary conditions in both horizontal and vertical directions and analyzes its dynamics using numerical continuation, secondary instability analysis and direct numerical simulation. The fixed-flux constraint leads to time-independent elevator modes with a well-defined amplitude. Secondary instability of these modes leads to tilted elevator modes accompanied by horizontal shear flow. For $Pr$=1, where $Pr$ is the Prandtl number, a subsequent subcritical Hopf bifurcation leads to hysteresis behavior between this state and a time-dependent direction-reversing state, followed by a global bifurcation leading to modulated traveling waves without flow reversal. Single-mode equations reproduce this moderate Rayleigh number behavior well. At high Rayleigh numbers, chaotic behavior dominated by modulated traveling waves appears. These transitions are characteristic of high wavenumber elevator modes since the vertical wavenumber of the secondary instability is linearly proportional to the horizontal wavenumber of the elevator mode. At a low $Pr$, relaxation oscillations between the conduction state and the elevator mode appear, followed by quasiperiodic and chaotic behavior as the Rayleigh number increases. In the high $Pr$ regime, the large-scale shear weakens, and the flow shows bursting behavior that can lead to significantly increased heat transport or even intermittent stable stratification.


title: The PHANGS-AstroSat Atlas of Nearby Star Forming Galaxies

abstract: We present the Physics at High Angular resolution in Nearby GalaxieS (PHANGS)-AstroSat atlas, which contains ultraviolet imaging of 31 nearby star-forming galaxies captured by the Ultraviolet Imaging Telescope (UVIT) on the AstroSat satellite. The atlas provides a homogeneous data set of far- and near-ultraviolet maps of galaxies within a distance of 22 Mpc and a median angular resolution of 1.4 arcseconds (corresponding to a physical scale between 25 and 160 pc). After subtracting a uniform ultraviolet background and accounting for Milky Way extinction, we compare our estimated flux densities to GALEX observations, finding good agreement. We find candidate extended UV disks around the galaxies NGC 6744 and IC 5332. We present the first statistical measurements of the clumping of the UV emission and compare it to the clumping of molecular gas traced with ALMA. We find that bars and spiral arms exhibit the highest degree of clumping, and the molecular gas is even more clumped than the FUV emission in galaxies. We investigate the variation of the ratio of observed FUV to H$\alpha$ in different galactic environments and kpc-sized apertures. We report that $\sim 65 \%$ varation of the $\log_{10}$(FUV/H$\alpha$) can be described through a combination of dust attenuation with star formation history parameters. The PHANGS-AstroSat atlas enhances the multi-wavelength coverage of our sample, offering a detailed perspective on star formation. When integrated with PHANGS data sets from ALMA, VLT-MUSE, HST and JWST, it develops our comprehensive understanding of attenuation curves and dust attenuation in star-forming galaxies.


title: Evaluating the Utility of Model Explanations for Model Development

abstract: One of the motivations for explainable AI is to allow humans to make better and more informed decisions regarding the use and deployment of AI models. But careful evaluations are needed to assess whether this expectation has been fulfilled. Current evaluations mainly focus on algorithmic properties of explanations, and those that involve human subjects often employ subjective questions to test human's perception of explanation usefulness, without being grounded in objective metrics and measurements. In this work, we evaluate whether explanations can improve human decision-making in practical scenarios of machine learning model development. We conduct a mixed-methods user study involving image data to evaluate saliency maps generated by SmoothGrad, GradCAM, and an oracle explanation on two tasks: model selection and counterfactual simulation. To our surprise, we did not find evidence of significant improvement on these tasks when users were provided with any of the saliency maps, even the synthetic oracle explanation designed to be simple to understand and highly indicative of the answer. Nonetheless, explanations did help users more accurately describe the models. These findings suggest caution regarding the usefulness and potential for misunderstanding in saliency-based explanations.


title: Study of Multiuser Multiple-Antenna Wireless Communications Systems Based on Super-Resolution Arrays

abstract: This work studies multiple-antenna wireless communication systems based on super-resolution arrays (SRAs). We consider the uplink of a multiple-antenna system in which users communicate with a multiple-antenna base station equipped with SRAs. In particular, we develop linear minimum mean-square error (MMSE) receive filters along with linear and successive interference cancellation receivers for processing signals with the difference co-array originating from the SRAs. We then derive analytical expressions to assess the achievable sum-rates associated with the proposed multiple-antenna systems with SRAs. Simulations show that the proposed multiple-antenna systems with SRAs outperform existing systems with standard arrays that have a larger number of antenna elements.


title: Modeling Uncertainty in Personalized Emotion Prediction with Normalizing Flows

abstract: Designing predictive models for subjective problems in natural language processing (NLP) remains challenging. This is mainly due to its non-deterministic nature and different perceptions of the content by different humans. It may be solved by Personalized Natural Language Processing (PNLP), where the model exploits additional information about the reader to make more accurate predictions. However, current approaches require complete information about the recipients to be straight embedded. Besides, the recent methods focus on deterministic inference or simple frequency-based estimations of the probabilities. In this work, we overcome this limitation by proposing a novel approach to capture the uncertainty of the forecast using conditional Normalizing Flows. This allows us to model complex multimodal distributions and to compare various models using negative log-likelihood (NLL). In addition, the new solution allows for various interpretations of possible reader perception thanks to the available sampling function. We validated our method on three challenging, subjective NLP tasks, including emotion recognition and hate speech. The comparative analysis of generalized and personalized approaches revealed that our personalized solutions significantly outperform the baseline and provide more precise uncertainty estimates. The impact on the text interpretability and uncertainty studies are presented as well. The information brought by the developed methods makes it possible to build hybrid models whose effectiveness surpasses classic solutions. In addition, an analysis and visualization of the probabilities of the given decisions for texts with high entropy of annotations and annotators with mixed views were carried out.


title: Photodynamical Modeling of the Compact, Multiply Eclipsing Systems KIC 5255552, KIC 7668648, KIC 10319590, EPIC 220204960

abstract: We present photodynamical models of four eclipsing binary systems that are members of higher-order multiple systems. We provide some radial velocities measurements and use recent TESS data for three of the systems. KIC 7668648 consists of an eclipsing binary (P=27.8 d) with late-type stars that has a low-mass star on a roughly coplanar outer orbit (P=208 d). There are eclipse events involving the third star that allow for the precise determination of the system parameters. KIC 10319590 consists of a binary (P=21.3 d) with late-type stars that stopped eclipsing about a third of the way into the Kepler mission. We show that the third star in this system is a Sun-like star on an inclined outer orbit (P=456 d). We present the first comprehensive solution for KIC 5255552 and demonstrate that it is a 2 + 2 system consisting of an eclipsing binary (P_1 = 32.5 d) with late-type stars paired with a non-eclipsing binary (P_2 = 33.7 d) with lower-mass stars. The two binaries have nearly coplanar orbits and a roughly aligned outer orbit (P=878 d). There are extra eclipses involving the component stars of the non-eclipsing binary, which leads to relatively small uncertainties in the system parameters. EPIC 220204960 consists of a pair of eclipsing binaries that both consist of two low-mass stars with a poorly determined outer orbit. Because of the relatively short time span of the observations, the masses and radii of the component stars can only be determined with accuracies of ~10% and ~5%, respectively. We show that the most likely period of the outer orbit is 957 days, with a 1-sigma range of 595 to 1674 days. We can only place weak constraints on the mutual inclinations of the orbital planes, and additional radial velocity measurements and/or additional eclipse observations would allow for much tighter constraints on the properties of the outer orbit.


title: AI Competitions and Benchmarks: towards impactful challenges with post-challenge papers, benchmarks and other dissemination actions

abstract: Organising an AI challenge does not end with the final event. The long-lasting impact also needs to be organised. This chapter covers the various activities after the challenge is formally finished. The target audience of different post-challenge activities is identified. The various outputs of the challenge are listed with the means to collect them. The main part of the chapter is a template for a typical post-challenge paper, including possible graphs as well as advice on how to turn the challenge into a long-lasting benchmark.


title: Multimodality of AI for Education: Towards Artificial General Intelligence

abstract: This paper presents a comprehensive examination of how multimodal artificial intelligence (AI) approaches are paving the way towards the realization of Artificial General Intelligence (AGI) in educational contexts. It scrutinizes the evolution and integration of AI in educational systems, emphasizing the crucial role of multimodality, which encompasses auditory, visual, kinesthetic, and linguistic modes of learning. This research delves deeply into the key facets of AGI, including cognitive frameworks, advanced knowledge representation, adaptive learning mechanisms, strategic planning, sophisticated language processing, and the integration of diverse multimodal data sources. It critically assesses AGI's transformative potential in reshaping educational paradigms, focusing on enhancing teaching and learning effectiveness, filling gaps in existing methodologies, and addressing ethical considerations and responsible usage of AGI in educational settings. The paper also discusses the implications of multimodal AI's role in education, offering insights into future directions and challenges in AGI development. This exploration aims to provide a nuanced understanding of the intersection between AI, multimodality, and education, setting a foundation for future research and development in AGI.


title: Correcting Diffusion Generation through Resampling

abstract: Despite diffusion models' superior capabilities in modeling complex distributions, there are still non-trivial distributional discrepancies between generated and ground-truth images, which has resulted in several notable problems in image generation, including missing object errors in text-to-image generation and low image quality. Existing methods that attempt to address these problems mostly do not tend to address the fundamental cause behind these problems, which is the distributional discrepancies, and hence achieve sub-optimal results. In this paper, we propose a particle filtering framework that can effectively address both problems by explicitly reducing the distributional discrepancies. Specifically, our method relies on a set of external guidance, including a small set of real images and a pre-trained object detector, to gauge the distribution gap, and then design the resampling weight accordingly to correct the gap. Experiments show that our methods can effectively correct missing object errors and improve image quality in various image generation tasks. Notably, our method outperforms the existing strongest baseline by 5% in object occurrence and 1.0 in FID on MS-COCO. Our code is publicly available at https://github.com/UCSB-NLP-Chang/diffusion_resampling.git.


title: Singularly Perturbed Layered Control of Deformable Bodies

abstract: Variable curvature modeling tools provide an accurate means of controlling infinite degrees-of-freedom deformable bodies and structures. However, their forward and inverse Newton-Euler dynamics are fraught with high computational costs. Assuming piecewise constant strains across discretized Cosserat rods imposed on the soft material, a composite two time-scale singularly perturbed nonlinear backstepping control scheme is here introduced. This is to alleviate the long computational times of the recursive Newton-Euler dynamics for soft structures. Our contribution is three-pronged: (i) we decompose the system's Newton-Euler dynamics to a two coupled sub-dynamics by introducing a perturbation parameter; (ii) we then prescribe a set of stabilizing controllers for regulating each subsystem's dynamics; and (iii) we study the interconnected singularly perturbed system and analyze its stability.


title: Search for charged-lepton flavor violation in the production and decay of top quarks using trilepton final states

abstract: This document describes a search for charged-lepton flavor violation (CLFV) in the production and decay of top quarks using 138 fb$^{-1}$ of data collected by the CMS experiment at a center-of-mass energy of 13 TeV. Events are selected for analysis if they contain an opposite-sign electron-muon pair, a third charged lepton (electron or muon), at least one jet, and at most one jet associated with a bottom quark. The analysis utilizes boosted decision trees to separate background processes from a possible signal. The data were found to be consistent with the standard model expectation. Exclusion limits were placed on different CLFV interactions, constituting the most stringent limits to date on these processes.