title: Self-Supervised Contrastive Pre-Training for Multivariate Point Processes

abstract: Self-supervision is one of the hallmarks of representation learning in the increasingly popular suite of foundation models including large language models such as BERT and GPT-3, but it has not been pursued in the context of multivariate event streams, to the best of our knowledge. We introduce a new paradigm for self-supervised learning for multivariate point processes using a transformer encoder. Specifically, we design a novel pre-training strategy for the encoder where we not only mask random event epochs but also insert randomly sampled "void" epochs where an event does not occur; this differs from the typical discrete-time pretext tasks such as word-masking in BERT but expands the effectiveness of masking to better capture continuous-time dynamics. To improve downstream tasks, we introduce a contrasting module that compares real events to simulated void instances. The pre-trained model can subsequently be fine-tuned on a potentially much smaller event dataset, similar conceptually to the typical transfer of popular pre-trained language models. We demonstrate the effectiveness of our proposed paradigm on the next-event prediction task using synthetic datasets and 3 real applications, observing a relative performance boost of as high as up to 20% compared to state-of-the-art models.


title: Normal incidence sound insulation provided by Sonic Crystal Acoustic Screens made from rigid scatterers, assessment of different simulation methods

abstract: Sonic crystal acoustic screens have been in progressive research and development in the last two decades as a technical solution for mitigating traffic noise. Their behaviour is quite different from that observed in classical barriers, with the latter being based on physically blocking the direct sound propagation path (only allowing diffracted noise to reach sensible receivers), and sonic crystals providing attenuation efficiency based on the creation of band-gaps at specific frequency ranges, due to the Bragg's interference phenomenon. The distinct physical mechanisms of these two types of noise barriers complicates the use of classical simplified or even numerical models developed for traditional barriers to simulate and predict the attenuation performance of a sonic crystal, and alternative methods become thus required. In the acoustics scientific literature, several authors have proposed estimation and simulation methods based on different numerical tools to predict the sound insulation provided by these new noise abatement solutions. This paper presents a comparative evaluation of some of these methods, with emphasis to the assessment of their accuracy versus memory usage in order to determine which one is the most suitable for optimization methodologies in the design of new devices with improved acoustic performance.


title: YOLinO++: Single-Shot Estimation of Generic Polylines for Mapless Automated Diving

abstract: In automated driving, highly accurate maps are commonly used to support and complement perception. These maps are costly to create and quickly become outdated as the traffic world is permanently changing. In order to support or replace the map of an automated system with detections from sensor data, a perception module must be able to detect the map features. We propose a neural network that follows the one shot philosophy of YOLO but is designed for detection of 1D structures in images, such as lane boundaries. We extend previous ideas by a midpoint based line representation and anchor definitions. This representation can be used to describe lane borders, markings, but also implicit features such as centerlines of lanes. The broad applicability of the approach is shown with the detection performance on lane centerlines, lane borders as well as the markings both on highways and in urban areas. Versatile lane boundaries are detected and can be inherently classified as dashed or solid lines, curb, road boundaries, or implicit delimitation.


title: Criteria for dynamic stall onset and vortex shedding in low Reynolds number flows

abstract: Dynamic stall at low Reynolds numbers, $\mathit{Re} \sim \mathcal{O}(10^4)$, exhibits complex flow physics with co-existing laminar, transitional, and turbulent flow regions. Current state-of-the-art stall onset criteria use parameters that rely on flow properties integrated around the leading edge. These include the leading edge suction parameter or $\mathit{LESP}$ (Ramesh et al., 2014) and boundary enstrophy flux or $\mathit{BEF}$ (Sudharsan et al., 2022)), which have been found to be effective for stall onset at moderate to high $\mathit{Re}$. However, low $\mathit{Re}$ flows feature strong vortex shedding events occurring across the entire airfoil surface, including regions away from the leading edge, altering the flow field and influencing the onset of stall. In the present work, the ability of these stall criteria to effectively capture and localize these vortex shedding events in space and time is investigated. High-resolution large-eddy simulations for an SD7003 airfoil undergoing a constant-rate, pitch-up motion at two $\mathit{Re}$ (10, 000 and 60, 000) and two pitch rates reveal a rich variety of unsteady flow phenomena, including instabilities, transition, vortex formation, merging, and shedding, which are described in detail. While stall onset is reflected in both $\mathit{LESP}$ and $\mathit{BEF}$, local vortex-shedding events are identified only by the $\mathit{BEF}$. Furthermore, these events can be localized in space and time by considering the contributions to the $\mathit{BEF}$ from different airfoil sections, which holds significant promise for effective flow control.


title: On 3-matrix factorizations of polynomials

abstract: Let $R=K[x_{1},x_{2},\cdots, x_{m}]$ and $S=$ $K[y_{1},y_{2},\cdots, y_{m}]$ where $K$ is a field. %commutative ring with unity. In this paper, we propose a method showing how to obtain $3$-matrix factors for a given polynomial using either the Doolittle or the Crout decomposition techniques that we apply to matrices whose entries are not real numbers but polynomials. We also define the category of $3$-matrix factorizations of a polynomial $f$ whose objects are $3$-matrix factorizations of $f$, that is triplets $(P,Q,T)$ of $m\times m $ matrices such that $PQT=fI_{m}$. Moreover, we construct a bifunctorial operation $\bar{\otimes}_{3}$ which is such that if $X$ (respectively $Y$) is a $3-$matrix factorization of $f\in R$ (respectively $g\in S$), then $X\bar{\otimes}_{3} Y$ is a $3-$matrix factorization of $fg\in K[x_{1},x_{2},\cdots, x_{m},y_{1},y_{2},\cdots, y_{m}]$. We call $\bar{\otimes}_{3}$ the multiplicative tensor product of $3-$matrix factorizations. Finally, we give some properties of the operation $\bar{\otimes}_{3}$.


title: Routing Model for Multicommodity Freight in an Intermodal Network under Disruptions

abstract: This paper presents a mathematical model for the routing of multicommodity freight in an intermodal network under disruptions. A stochastic mixed-integer program was formulated to minimize not only operational costs of various modes and transfer costs at terminals but also penalty costs associated with unsatisfied demands. The sample average approximation algorithm was used to solve this challenging problem. The developed model was then applied to two networks-a hypothetical 15-node network and an actual intermodal network in the Gulf Coast, Southeastern, and Mid-Atlantic regions of the United States-to demonstrate its applicability with explicit consideration of disruptions at links, nodes, and terminals. The model results indicated that during disruptions, goods in the study region should be shipped by road-rail intermodal network because of the built-in redundancy of the freight transport network. Additionally, the routes generated by the model were found to be more robust than those typically used by freight carriers.


title: Compressed image quality assessment using stacking

abstract: It is well-known that there is no universal metric for image quality evaluation. In this case, distortion-specific metrics can be more reliable. The artifact imposed by image compression can be considered as a combination of various distortions. Depending on the image context, this combination can be different. As a result, Generalization can be regarded as the major challenge in compressed image quality assessment. In this approach, stacking is employed to provide a reliable method. Both semantic and low-level information are employed in the presented IQA to predict the human visual system. Moreover, the results of the Full-Reference (FR) and No-Reference (NR) models are aggregated to improve the proposed Full-Reference method for compressed image quality evaluation. The accuracy of the quality benchmark of the clic2024 perceptual image challenge was achieved 79.6\%, which illustrates the effectiveness of the proposed fusion-based approach.


title: A Cost-Efficient Approach for Creating Virtual Fitting Room using Generative Adversarial Networks (GANs)

abstract: Customers all over the world want to see how the clothes fit them or not before purchasing. Therefore, customers by nature prefer brick-and-mortar clothes shopping so they can try on products before purchasing them. But after the Pandemic of COVID19 many sellers either shifted to online shopping or closed their fitting rooms which made the shopping process hesitant and doubtful. The fact that the clothes may not be suitable for their buyers after purchase led us to think about using new AI technologies to create an online platform or a virtual fitting room (VFR) in the form of a mobile application and a deployed model using a webpage that can be embedded later to any online store where they can try on any number of cloth items without physically trying them. Besides, it will save much searching time for their needs. Furthermore, it will reduce the crowding and headache in the physical shops by applying the same technology using a special type of mirror that will enable customers to try on faster. On the other hand, from business owners' perspective, this project will highly increase their online sales, besides, it will save the quality of the products by avoiding physical trials issues. The main approach used in this work is applying Generative Adversarial Networks (GANs) combined with image processing techniques to generate one output image from two input images which are the person image and the cloth image. This work achieved results that outperformed the state-of-the-art approaches found in literature.


title: Joint Devices and IRSs Association for Terahertz Communications in Industrial IoT Networks

abstract: The Industrial Internet of Things (IIoT) enables industries to build large interconnected systems utilizing various technologies that require high data rates. Terahertz (THz) communication is envisioned as a candidate technology for achieving data rates of several terabits-per-second (Tbps). Despite this, establishing a reliable communication link at THz frequencies remains a challenge due to high pathloss and molecular absorption. To overcome these limitations, this paper proposes using intelligent reconfigurable surfaces (IRSs) with THz communications to enable future smart factories for the IIoT. In this paper, we formulate the power allocation and joint IIoT device and IRS association (JIIA) problem, which is a mixed-integer nonlinear programming (MINLP) problem. {Furthermore, the JIIA problem aims to maximize the sum rate with imperfect channel state information (CSI).} To address this non-deterministic polynomial-time hard (NP-hard) problem, we decompose the problem into multiple sub-problems, which we solve iteratively. Specifically, we propose a Gale-Shapley algorithm-based JIIA solution to obtain stable matching between uplink and downlink IRSs. {We validate the proposed solution by comparing the Gale-Shapley-based JIIA algorithm with exhaustive search (ES), greedy search (GS), and random association (RA) with imperfect CSI.} The complexity analysis shows that our algorithm is more efficient than the ES.


title: mmID: High-Resolution mmWave Imaging for Human Identification

abstract: Achieving accurate human identification through RF imaging has been a persistent challenge, primarily attributed to the limited aperture size and its consequent impact on imaging resolution. The existing imaging solution enables tasks such as pose estimation, activity recognition, and human tracking based on deep neural networks by estimating skeleton joints. In contrast to estimating joints, this paper proposes to improve imaging resolution by estimating the human figure as a whole using conditional generative adversarial networks (cGAN). In order to reduce training complexity, we use an estimated spatial spectrum using the MUltiple SIgnal Classification (MUSIC) algorithm as input to the cGAN. Our system generates environmentally independent, high-resolution images that can extract unique physical features useful for human identification. We use a simple convolution layers-based classification network to obtain the final identification result. From the experimental results, we show that resolution of the image produced by our trained generator is high enough to enable human identification. Our finding indicates high-resolution accuracy with 5% mean silhouette difference to the Kinect device. Extensive experiments in different environments on multiple testers demonstrate that our system can achieve 93% overall test accuracy in unseen environments for static human target identification.


title: Hitting probability for Reflected Brownian Motion at Small Target

abstract: We derive the asymptotic behavior of hitting probability at small target of size $O(\epsilon)$ for reflected Brownian motion in domains with suitable smooth boundary conditions, where the boundary of domain contains both reflecting part, absorbing part and target. In this case the domain could be localized near the target and explicit computations are possible. The asymptotic behavior is only related to $\epsilon$ up to some multiplicative constants that depends on the domain and boundary conditions.


title: Recent Advances on Uniqueness of Competitive Equilibrium

abstract: This article reviews the recent advances in the uniqueness and multiplicity of competitive equilibria in models arising in mathematical economics, finance, macroeconomics, and trade.


title: RDNF Oriented Analytics to Random Boolean Functions

abstract: Dominant areas of computer science and computation systems are intensively linked to the hypercube-related studies and interpretations. This article presents some transformations and analytics for some example algorithms and Boolean domain problems. Our focus is on the methodology of complexity evaluation and integration of several types of postulations concerning special hypercube structures. Our primary goal is to demonstrate the usual formulas and analytics in this area, giving the necessary set of common formulas often used for complexity estimations and approximations. The basic example under considered is the Boolean minimization problem, in terms of the average complexity of the so-called reduced disjunctive normal form (also referred to as complete, prime irredundant, or Blake canonical form). In fact, combinatorial counterparts of the disjunctive normal form complexities are investigated in terms of sets of their maximal intervals. The results obtained compose the basis of logical separation classification algorithmic technology of pattern recognition. In fact, these considerations are not only general tools of minimization investigations of Boolean functions, but they also prove useful structures, models, and analytics for constraint logic programming, machine learning, decision policy optimization and other domains of computer science.


title: Multivariate Probabilistic Time Series Forecasting with Correlated Errors

abstract: Accurately modeling the correlation structure of errors is essential for reliable uncertainty quantification in probabilistic time series forecasting. Recent deep learning models for multivariate time series have developed efficient parameterizations for time-varying contemporaneous covariance, but they often assume temporal independence of errors for simplicity. However, real-world data frequently exhibit significant error autocorrelation and cross-lag correlation due to factors such as missing covariates. In this paper, we present a plug-and-play method that learns the covariance structure of errors over multiple steps for autoregressive models with Gaussian-distributed errors. To achieve scalable inference and computational efficiency, we model the contemporaneous covariance using a low-rank-plus-diagonal parameterization and characterize cross-covariance through a group of independent latent temporal processes. The learned covariance matrix can be used to calibrate predictions based on observed residuals. We evaluate our method on probabilistic models built on RNN and Transformer architectures, and the results confirm the effectiveness of our approach in enhancing predictive accuracy and uncertainty quantification without significantly increasing the parameter size.


title: Ensuring Data Privacy in AC Optimal Power Flow with a Distributed Co-Simulation Framework

abstract: During the energy transition, the significance of collaborative management among institutions is rising, confronting challenges posed by data privacy concerns. Prevailing research on distributed approaches, as an alternative to centralized management, often lacks numerical convergence guarantees or is limited to single-machine numerical simulation. To address this, we present a distributed approach for solving AC Optimal Power Flow (OPF) problems within a geographically distributed environment. This involves integrating the energy system Co-Simulation (eCoSim) module in the eASiMOV framework with the convergence-guaranteed distributed optimization algorithm, i.e., the Augmented Lagrangian based Alternating Direction Inexact Newton method (ALADIN). Comprehensive evaluations across multiple system scenarios reveal a marginal performance slowdown compared to the centralized approach and the distributed approach executed on single machines -- a justified trade-off for enhanced data privacy. This investigation serves as empirical validation of the successful execution of distributed AC OPF within a geographically distributed environment, highlighting potential directions for future research.


title: AI-generated faces influence gender stereotypes and racial homogenization

abstract: Text-to-image generative AI models such as Stable Diffusion are used daily by millions worldwide. However, the extent to which these models exhibit racial and gender stereotypes is not yet fully understood. Here, we document significant biases in Stable Diffusion across six races, two genders, 32 professions, and eight attributes. Additionally, we examine the degree to which Stable Diffusion depicts individuals of the same race as being similar to one another. This analysis reveals significant racial homogenization, e.g., depicting nearly all middle eastern men as dark-skinned, bearded, and wearing a traditional headdress. We then propose novel debiasing solutions that address the above stereotypes. Finally, using a preregistered experiment, we show that being presented with inclusive AI-generated faces reduces people's racial and gender biases, while being presented with non-inclusive ones increases such biases. This persists regardless of whether the images are labeled as AI-generated. Taken together, our findings emphasize the need to address biases and stereotypes in AI-generated content.


title: Practical challenges in mediation analysis: A guide for applied researchers

abstract: Mediation analysis is a statistical approach that can provide insights regarding the intermediary processes by which an intervention or exposure affects a given outcome. Mediation analyses rose to prominence, particularly in social science research, with the publication of the seminal paper by Baron and Kenny and is now commonly applied in many research disciplines, including health services research. Despite the growth in popularity, applied researchers may still encounter challenges in terms of conducting mediation analyses in practice. In this paper, we provide an overview of conceptual and methodological challenges that researchers face when conducting mediation analyses. Specifically, we discuss the following key challenges: (1) Conceptually differentiating mediators from other third variables, (2) Extending beyond the single mediator context, (3) Identifying appropriate datasets in which measurement and temporal ordering supports the hypothesized mediation model, (4) Selecting mediation effects that reflect the scientific question of interest, (5) Assessing the validity of underlying assumptions of no omitted confounders, (6) Addressing measurement error regarding the mediator, and (7) Clearly reporting results from mediation analyses. We discuss each challenge and highlight ways in which the applied researcher can approach these challenges.


title: Edge mappings of graphs: Ramsey type parameters

abstract: In this paper, we address problems related to parameters concerning edge mappings of graphs. Inspired by Ramsey's Theorem, the quantity $m(G, H)$ is defined to be the minimum number $n$ such that for every $f: E(K_n) \rightarrow E(K_n)$ either there is a fixed copy of $G$ with $f ( e) = e$ for all $e\in E(G)$, or a free copy of $H$ with $f( e) \notin E(H)$ for all $e\in E(H)$. We extend many old results from the 80's as well as proving many new results. We also consider several new interesting parameters with the same spirit.


title: The prices of renewable commodities: A robust stationarity analysis

abstract: This paper addresses the problem of testing for persistence in the effects of the shocks affecting the prices of renewable commodities, which have potential implications on stabilization policies and economic forecasting, among other areas. A robust methodology is employed that enables the determination of the potential presence and number of instant/gradual structural changes in the series, stationarity testing conditional on the number of changes detected, and the detection of change points. This procedure is applied to the annual real prices of eighteen renewable commodities over the period of 1900-2018. Results indicate that most of the series display non-linear features, including quadratic patterns and regime transitions that often coincide with well-known political and economic episodes. The conclusions of stationarity testing suggest that roughly half of the series are integrated. Stationarity fails to be rejected for grains, whereas most livestock and textile commodities do reject stationarity. Evidence is mixed in all soft commodities and tropical crops, where stationarity can be rejected in approximately half of the cases. The implication would be that for these commodities, stabilization schemes would not be recommended.


title: Edge mappings of graphs: Tur\'an type parameters

abstract: In this paper, we address problems related to parameters concerning edge mappings of graphs. The quantity $h(n,G)$ is defined to be the maximum number of edges in an $n$-vertex graph $H$ such that there exists a mapping $f: E(H)\rightarrow E(H)$ with $f(e)\neq e$ for all $e\in E$ and further in all copies $G'$ of $G$ in $H$ there exists $e\in E(G')$ with $f(e)\in E(G')$. Among other results, we determine $h(n, G)$ when $G$ is a matching and $n$ is large enough. As a related concept, we say that $H$ is unavoidable for $G$ if for any mapping $f: E(H)\rightarrow E(H)$ with $f(e)\neq e$ there exists a copy $G'$ of $G$ in $H$ such that $f(e)\notin E(G')$ for all $e\in E(G)$. The set of minimal unavoidable graphs for $G$ is denoted by $\mathcal{M}(G)$. We prove that if $F$ is a forest, then $\mathcal{M}(F)$ is finite if and only if $F$ is a matching, and we conjecture that for all non-forest graphs $G$, the set $\mathcal{M}(G)$ is infinite. Several other parameters are defined with basic results proved. Lots of open problems remain.


title: Municipal cyber risk modeling using cryptographic computing to inform cyber policymaking

abstract: Municipalities are vulnerable to cyberattacks with devastating consequences, but they lack key information to evaluate their own risk and compare their security posture to peers. Using data from 83 municipalities collected via a cryptographically secure computation platform about their security posture, incidents, security control failures, and losses, we build data-driven cyber risk models and cyber security benchmarks for municipalities. We produce benchmarks of the security posture in a sector, the frequency of cyber incidents, forecasted annual losses for organizations based on their defensive posture, and a weighting of cyber controls based on their individual failure rates and associated losses. Combined, these four items can help guide cyber policymaking by quantifying the cyber risk in a sector, identifying gaps that need to be addressed, prioritizing policy interventions, and tracking progress of those interventions over time. In the case of the municipalities, these newly derived risk measures highlight the need for continuous measured improvement of cybersecurity readiness, show clear areas of weakness and strength, and provide governments with some early targets for policy focus such as security education, incident response, and focusing efforts first on municipalities at the lowest security levels that have the highest risk reduction per security dollar invested.


title: CF4J: Collaborative Filtering for Java

abstract: Recommender Systems (RS) provide a relevant tool to mitigate the information overload problem. A large number of researchers have published hundreds of papers to improve different RS features. It is advisable to use RS frameworks that simplify RS researchers: a) to design and implement recommendations methods and, b) to speed up the execution time of the experiments. In this paper, we present CF4J, a Java library designed to carry out Collaborative Filtering based RS research experiments. CF4J has been designed from researchers to researchers. It allows: a) RS datasets reading, b) full and easy access to data and intermediate or final results, c) to extend their main functionalities, d) to concurrently execute the implemented methods, and e) to provide a thorough evaluation for the implementations by quality measures. In summary, CF4J serves as a library specifically designed for the research trial and error process.


title: Compositional Expected Cost Analysis of Functional Probabilistic Programs

abstract: Reasoning about resources used during the execution of programs, such as time, is one of the fundamental questions in computer science. When programming with probabilistic primitives, however, different samples may result in different resource usage, making the cost of a program not a single number but a distribution instead. The expected cost is an important metric used to quantify the efficiency of probabilistic programs. In this work we introduce $\mathbf{cert}$, a call-by-push-value (CBPV) metalanguage extended with primitives for probability, cost and unbounded recursion, and give it denotational semantics for reasoning about the average cost of programs. We justify the validity of the semantics by presenting case-studies ranging from randomized algorithms to stochastic processes and showing how the semantics captures their intended cost.


title: A generalized essentially non-hourglass total Lagrangian SPH solid dynamics

abstract: In this paper, we tackle a persistent numerical instability within the total Lagrangian smoothed particle hydrodynamics (TLSPH) solid dynamics. Specifically, we address the hourglass modes that may grow and eventually deteriorate the reliability of simulation, particularly in the scenarios characterized by large deformations. We propose a generalized essentially non-hourglass formulation based on volumetric-deviatoric stress decomposition, offering a general solution for elasticity, plasticity, anisotropy, and other material models. Comparing the standard SPH formulation with the original non-nested Laplacian operator applied in our previous work \cite{wu2023essentially} to handle the hourglass issues in standard elasticity, we introduce a correction for the discretization of shear stress that relies on the discrepancy produced by a tracing-back prediction of the initial inter-particle direction from the current deformation gradient. The present formulation, when applied to standard elastic materials, is able to recover the original Laplacian operator. Due to the dimensionless nature of the correction, this formulation handles complex material models in a very straightforward way. Furthermore, a magnitude limiter is introduced to minimize the correction in domains where the discrepancy is less pronounced. The present formulation is validated, with a single set of modeling parameters, through a series of benchmark cases, confirming good stability and accuracy across elastic, plastic, and anisotropic materials. To showcase its potential, the formulation is employed to simulate a complex problem involving viscous plastic Oobleck material, contacts, and very large deformation.


title: Ruling Out Low-rank Matrix Multiplication Tensor Decompositions with Symmetries via SAT

abstract: We analyze rank decompositions of the $3\times 3$ matrix multiplication tensor over $\mathbb{Z}/2\mathbb{Z}$. We restrict our attention to decompositions of rank $\le 21$, as only those decompositions will yield an asymptotically faster algorithm for matrix multiplication than Strassen's algorithm. To reduce search space, we also require decompositions to have certain symmetries. Using Boolean SAT solvers, we show that under certain symmetries, such decompositions do not exist.


title: algoXSSF: Detection and analysis of cross-site request forgery (XSRF) and cross-site scripting (XSS) attacks via Machine learning algorithms

abstract: The global rise of online users and online devices has ultimately given rise to the global internet population apart from several cybercrimes and cyberattacks. The combination of emerging new technology and powerful algorithms (of Artificial Intelligence, Deep Learning, and Machine Learning) is needed to counter defense web security including attacks on several search engines and websites. The unprecedented increase rate of cybercrime and website attacks urged for new technology consideration to protect data and information online. There have been recent and continuous cyberattacks on websites, web domains with ongoing data breaches including - GitHub account hack, data leaks on Twitter, malware in WordPress plugins, vulnerability in Tomcat server to name just a few. We have investigated with an in-depth study apart from the detection and analysis of two major cyberattacks (although there are many more types): cross-site request forgery (XSRF) and cross-site scripting (XSS) attacks. The easy identification of cyber trends and patterns with continuous improvement is possible within the edge of machine learning and AI algorithms. The use of machine learning algorithms would be extremely helpful to counter (apart from detection) the XSRF and XSS attacks. We have developed the algorithm and cyber defense framework - algoXSSF with machine learning algorithms embedded to combat malicious attacks (including Man-in-the-Middle attacks) on websites for detection and analysis.


title: Quantum Multiple Eigenvalue Gaussian filtered Search: an efficient and versatile quantum phase estimation method

abstract: Quantum phase estimation is one of the most powerful quantum primitives. This work proposes a new approach for the problem of multiple eigenvalue estimation: Quantum Multiple Eigenvalue Gaussian filtered Search (QMEGS). QMEGS leverages the Hadamard test circuit structure and only requires simple classical postprocessing. QMEGS is the first algorithm to simultaneously satisfy the following two properties: (1) It can achieve the Heisenberg-limited scaling without relying on any spectral gap assumption. (2) With a positive energy gap and additional assumptions on the initial state, QMEGS can estimate all dominant eigenvalues to $\epsilon$ accuracy utilizing a significantly reduced circuit depth compared to the standard quantum phase estimation algorithm. In the most favorable scenario, the maximal runtime can be reduced to as low as $\log(1/\epsilon)$. This implies that QMEGS serves as an efficient and versatile approach, achieving the best-known results for both gapped and gapless systems. Numerical results validate the efficiency of our proposed algorithm in various regimes.


title: Tubes in Complex Hyperbolic Manifolds

abstract: We prove a tubular neighborhood theorem for an embedded complex geodesic surface in a complex hyperbolic 2-manifold where the width of the tube depends only on the Euler characteristic of the embedded surface. We give an explicit estimate for this width. We supply two applications of the tubular neighborhood theorem, the first is a lower volume bound for such manifolds. The second is an upper bound on the first eigenvalue of the Laplacian in terms of the geometry of the manifold. Finally, we prove a geometric combination theorem for two Fuchsian subgroups of PU(2,1). Using this combination theorem, we asymptotically bound (from above and below) the optimal width size of a tube about an embedded complex geodesic surface.


title: An optimal advertising model with carryover effect and mean field terms

abstract: We consider a class of optimal advertising problems under uncertainty for the introduction of a new product into the market, on the line of the seminal papers of Vidale and Wolfe, 1957, and Nerlove and Arrow, 1962. The main features of our model are that, on one side, we assume a carryover effect (i.e. the advertisement spending affects the goodwill with some delay); on the other side we introduce, in the state equation and in the objective, some mean field terms which take into account the presence of other agents. We take the point of view of a planner who optimizes the average profit of all agents, hence we fall into the family of the so-called "Mean Field Control" problems. The simultaneous presence of the carryover effect makes the problem infinite dimensional hence belonging to a family of problems which are very difficult in general and whose study started only very recently, see Cosso et Al, 2023. Here we consider, as a first step, a simple version of the problem providing the solutions in a simple case through a suitable auxiliary problem.


title: Gauge-Invariant Quantum Fields

abstract: Gauge-invariant quantum fields are constructed in an Abelian power-counting renormalizable gauge theory with both scalar, vector and fermionic matter content. This extends previous results already obtained for the gauge-invariant description of the Higgs mode via a propagating gauge-invariant field. The renormalization of the model is studied in the Algebraic Renormalization approach. The decomposition of Slavnov-Taylor identities into separately invariant sectors is analyzed. We also comment on some non-renormalizable extensions of the model whose 1-PI Green's functions are the flows of certain differential equations of the homogeneous Euler type, exactly resumming the dependence on a certain set of dim. 6 and dim. 8 derivative operators. The latter are identified uniquely by the condition that they span the mass and kinetic terms in the gauge-invariant dynamical fields. The construction can be extended to non-Abelian gauge groups.


title: Legendre Expansion for Scattering Anisotropy in Analytical 1D Multigroup $S_N$ Equations

abstract: We demonstrate the scattering anisotropy treatment of the previously developed analytical solution for 1D multigroup $S_N$ equations.


title: HR-MultiWOZ: A Task Oriented Dialogue (TOD) Dataset for HR LLM Agent

abstract: Recent advancements in Large Language Models (LLMs) have been reshaping Natural Language Processing (NLP) task in several domains. Their use in the field of Human Resources (HR) has still room for expansions and could be beneficial for several time consuming tasks. Examples such as time-off submissions, medical claims filing, and access requests are noteworthy, but they are by no means the sole instances. However, the aforementioned developments must grapple with the pivotal challenge of constructing a high-quality training dataset. On one hand, most conversation datasets are solving problems for customers not employees. On the other hand, gathering conversations with HR could raise privacy concerns. To solve it, we introduce HR-Multiwoz, a fully-labeled dataset of 550 conversations spanning 10 HR domains to evaluate LLM Agent. Our work has the following contributions: (1) It is the first labeled open-sourced conversation dataset in the HR domain for NLP research. (2) It provides a detailed recipe for the data generation procedure along with data analysis and human evaluations. The data generation pipeline is transferable and can be easily adapted for labeled conversation data generation in other domains. (3) The proposed data-collection pipeline is mostly based on LLMs with minimal human involvement for annotation, which is time and cost-efficient.


title: Domain-Independent Deception: A New Taxonomy and Linguistic Analysis

abstract: Internet-based economies and societies are drowning in deceptive attacks. These attacks take many forms, such as fake news, phishing, and job scams, which we call ``domains of deception.'' Machine-learning and natural-language-processing researchers have been attempting to ameliorate this precarious situation by designing domain-specific detectors. Only a few recent works have considered domain-independent deception. We collect these disparate threads of research and investigate domain-independent deception. First, we provide a new computational definition of deception and break down deception into a new taxonomy. Then, we analyze the debate on linguistic cues for deception and supply guidelines for systematic reviews. Finally, we investigate common linguistic features and give evidence for knowledge transfer across different forms of deception.


title: Quantifying analogy of concepts via ologs and wiring diagrams

abstract: We build on the theory of ontology logs (ologs) created by Spivak and Kent, and define a notion of wiring diagrams. In this article, a wiring diagram is a finite directed labelled graph. The labels correspond to types in an olog; they can also be interpreted as readings of sensors in an autonomous system. As such, wiring diagrams can be used as a framework for an autonomous system to form abstract concepts. We show that the graphs underlying skeleton wiring diagrams form a category. This allows skeleton wiring diagrams to be compared and manipulated using techniques from both graph theory and category theory. We also extend the usual definition of graph edit distance to the case of wiring diagrams by using operations only available to wiring diagrams, leading to a metric on the set of all skeleton wiring diagrams. In the end, we give an extended example on calculating the distance between two concepts represented by wiring diagrams, and explain how to apply our framework to any application domain.


title: Towards Understanding the Challenges of Bug Localization in Deep Learning Systems

abstract: Software bugs cost the global economy billions of dollars annually and claim ~50\% of the programming time from software developers. Locating these bugs is crucial for their resolution but challenging. It is even more challenging in deep-learning systems due to their black-box nature. Bugs in these systems are also hidden not only in the code but also in the models and training data, which might make traditional debugging methods less effective. In this article, we conduct a large-scale empirical study to better understand the challenges of localizing bugs in deep-learning systems. First, we determine the bug localization performance of four existing techniques using 2,365 bugs from deep-learning systems and 2,913 from traditional software. We found these techniques significantly underperform in localizing deep-learning system bugs. Second, we evaluate how different bug types in deep learning systems impact bug localization. We found that the effectiveness of localization techniques varies with bug type due to their unique challenges. For example, tensor bugs were more accessible to locate due to their structural nature, while all techniques struggled with GPU bugs due to their external dependencies. Third, we investigate the impact of bugs' extrinsic nature on localization in deep-learning systems. We found that deep learning bugs are often extrinsic and thus connected to artifacts other than source code (e.g., GPU, training data), contributing to the poor performance of existing localization methods.


title: Real rank of some multiplier algebras

abstract: We show that there exists a separable, nuclear C*-algebra with real rank zero and trivial K-theory such that its multiplier and corona algebra have real rank one. This disproves two conjectures of Brown and Pedersen. We also compute the real rank of the stable multiplier algebra and the stable corona algebra of countably decomposable type $\mathrm{I}_\infty$ and type $\mathrm{II}_\infty$ factors. Together with results of Zhang this completes the computation of the real rank for stable multiplier and corona algebras of countably decomposable factors.


title: Stability for some classes of degenerate nonlinear hyperbolic equations with time delay

abstract: We consider several classes of degenerate hyperbolic equations involving delay terms and suitable nonlinearities. The idea is to rewrite the problems in an abstract way and, using semigroup theory and energy method, we study well posedness and stability. Moreover, some illustrative examples are given.


title: On the BER vs. Bandwidth-Efficiency Trade-offs in Windowed OTSM Dispensing with Zero-Padding

abstract: An orthogonal time sequency multiplexing (OTSM) scheme using practical signaling functions is proposed under strong phase noise (PHN) scenarios. By utilizing the transform relationships between the delay-sequency (DS), time-frequency (TF) and time-domains, we first conceive the DS-domain input-output relationship of our OTSM system, where the conventional zero-padding is discarded to increase the spectral efficiency. Then, the unconditional pairwise error probability is derived, followed by deriving the bit error ratio (BER) upper bound in closed-form. Moreover, we compare the BER performance of our OTSM system based on several practical signaling functions. Our simulation results demonstrate that the upper bound derived accurately predicts the BER performance in the case of moderate to high signal-to-noise ratios (SNRs), while harnessing practical window functions is capable of attaining an attractive out-of-band emission (OOBE) vs. BER trade-off.


title: Graph-based Clustering for Detecting Semantic Change Across Time and Languages

abstract: Despite the predominance of contextualized embeddings in NLP, approaches to detect semantic change relying on these embeddings and clustering methods underperform simpler counterparts based on static word embeddings. This stems from the poor quality of the clustering methods to produce sense clusters -- which struggle to capture word senses, especially those with low frequency. This issue hinders the next step in examining how changes in word senses in one language influence another. To address this issue, we propose a graph-based clustering approach to capture nuanced changes in both high- and low-frequency word senses across time and languages, including the acquisition and loss of these senses over time. Our experimental results show that our approach substantially surpasses previous approaches in the SemEval2020 binary classification task across four languages. Moreover, we showcase the ability of our approach as a versatile visualization tool to detect semantic changes in both intra-language and inter-language setups. We make our code and data publicly available.


title: Bispectrum Analysis of Noninvasive EEG Signals Discriminates Complex and Natural Grasp Types

abstract: The bispectrum stands out as a revolutionary tool in frequency domain analysis, leaping the usual power spectrum by capturing crucial phase information between frequency components. In our innovative study, we have utilized the bispectrum to analyze and decode complex grasping movements, gathering EEG data from five human subjects. We put this data through its paces with three classifiers, focusing on both magnitude and phase-related features. The results highlight the bispectrum's incredible ability to delve into neural activity and differentiate between various grasping motions with the Support Vector Machine (SVM) classifier emerging as a standout performer. In binary classification, it achieved a remarkable 97\% accuracy in identifying power grasp, and in the more complex multiclass tasks, it maintained an impressive 94.93\% accuracy. This finding not only underscores the bispectrum's analytical strength but also showcases the SVM's exceptional capability in classification, opening new doors in our understanding of movement and neural dynamics.


title: The MESA physics program

abstract: In the recent past, a comprehensive experimental program has been worked out at the Mainz Energy-Recovery Superconducting Accelerator, MESA, at the Institute of Nuclear Physics in Mainz. MESA is a high-intensity, low-energy electron accelerator presently under construction and will thereby provide great opportunities to perform a new generation of high-precision scattering experiments. The versatile MAGIX experiment will use MESA's innovative energy recovery technique, with a science focus on the study of hadron structure and few-body systems, dark sector searches, and investigations into reactions pertinent to nuclear astrophysics. An external beam line will supply spin-polarized electrons to the P2 experiment, enabling the performance of sensitive tests of the Standard Model through parity-violating electron scattering. The DarkMESA beam dump experiment, situated behind P2, is dedicated to the search for light dark matter particles.


title: Directed graphs without rainbow stars

abstract: In a rainbow version of the classical Tur\'an problem one considers multiple graphs on a common vertex set, thinking of each graph as edges in a distinct color, and wants to determine the minimum number of edges in each color which guarantees existence of a rainbow copy (having at most one edge from each graph) of a given graph. Here, we prove an optimal solution for this problem for any directed star and any number of colors.


title: Response Theory via Generative Score Modeling

abstract: We introduce an approach for analyzing the responses of dynamical systems to external perturbations that combines score-based generative modeling with the Fluctuation-Dissipation Theorem (FDT). The methodology enables accurate estimation of system responses, especially for systems with non-Gaussian statistics, often encountered in dynamical systems far from equilibrium. Such cases often present limitations for conventional approximate methods. We numerically validate our approach using time-series data from a stochastic partial differential equation where the score function is available analytically. Furthermore, we demonstrate the improved accuracy of our methodology over conventional methods and its potential as a versatile tool for understanding complex dynamical systems. Applications span disciplines from climate science and finance to neuroscience.


title: Executable Code Actions Elicit Better LLM Agents

abstract: Large Language Model (LLM) agents, capable of performing a broad range of actions, such as invoking tools and controlling robots, show great potential in tackling real-world challenges. LLM agents are typically prompted to produce actions by generating JSON or text in a pre-defined format, which is usually limited by constrained action space (e.g., the scope of pre-defined tools) and restricted flexibility (e.g., inability to compose multiple tools). This work proposes to use executable Python code to consolidate LLM agents' actions into a unified action space (CodeAct). Integrated with a Python interpreter, CodeAct can execute code actions and dynamically revise prior actions or emit new actions upon new observations through multi-turn interactions. Our extensive analysis of 17 LLMs on API-Bank and a newly curated benchmark shows that CodeAct outperforms widely used alternatives (up to 20% higher success rate). The encouraging performance of CodeAct motivates us to build an open-source LLM agent that interacts with environments by executing interpretable code and collaborates with users using natural language. To this end, we collect an instruction-tuning dataset CodeActInstruct that consists of 7k multi-turn interactions using CodeAct. We show that it can be used with existing data to improve models in agent-oriented tasks without compromising their general capability. CodeActAgent, finetuned from Llama2 and Mistral, is integrated with Python interpreter and uniquely tailored to perform sophisticated tasks (e.g., model training) using existing libraries and autonomously self-debug.


title: MRAnnotator: A Multi-Anatomy Deep Learning Model for MRI Segmentation

abstract: Purpose To develop a deep learning model for multi-anatomy and many-class segmentation of diverse anatomic structures on MRI imaging. Materials and Methods In this retrospective study, two datasets were curated and annotated for model development and evaluation. An internal dataset of 1022 MRI sequences from various clinical sites within a health system and an external dataset of 264 MRI sequences from an independent imaging center were collected. In both datasets, 49 anatomic structures were annotated as the ground truth. The internal dataset was divided into training, validation, and test sets and used to train and evaluate an nnU-Net model. The external dataset was used to evaluate nnU-Net model generalizability and performance in all classes on independent imaging data. Dice scores were calculated to evaluate model segmentation performance. Results The model achieved an average Dice score of 0.801 on the internal test set, and an average score of 0.814 on the complete external dataset across 49 classes. Conclusion The developed model achieves robust and generalizable segmentation of 49 anatomic structures on MRI imaging. A future direction is focused on the incorporation of additional anatomic regions and structures into the datasets and model.


title: Repeat After Me: Transformers are Better than State Space Models at Copying

abstract: Transformers are the dominant architecture for sequence modeling, but there is growing interest in models that use a fixed-size latent state that does not depend on the sequence length, which we refer to as "generalized state space models" (GSSMs). In this paper we show that while GSSMs are promising in terms of inference-time efficiency, they are limited compared to transformer models on tasks that require copying from the input context. We start with a theoretical analysis of the simple task of string copying and prove that a two layer transformer can copy strings of exponential length while GSSMs are fundamentally limited by their fixed-size latent state. Empirically, we find that transformers outperform GSSMs in terms of efficiency and generalization on synthetic tasks that require copying the context. Finally, we evaluate pretrained large language models and find that transformer models dramatically outperform state space models at copying and retrieving information from context. Taken together, these results suggest a fundamental gap between transformers and GSSMs on tasks of practical interest.


title: End-to-End Deep Learning for TDD MIMO Systems in the 6G Upper Midbands

abstract: This paper proposes and analyzes novel deep learning methods for downlink (DL) single-user multiple-input multiple-output (SU-MIMO) and multi-user MIMO (MU-MIMO) systems operating in time division duplex (TDD) mode. A motivating application is the 6G upper midbands (7-24 GHz), where the base station (BS) antenna arrays are large, user equipment (UE) array sizes are moderate, and theoretically optimal approaches are practically infeasible for several reasons. To deal with uplink (UL) pilot overhead and low signal power issues, we introduce the channel-adaptive pilot, as part of an analog channel state information feedback mechanism. Deep neural network (DNN)-generated pilots are used to linearly transform the UL channel matrix into lower-dimensional latent vectors. Meanwhile, the BS employs a second DNN that processes the received UL pilots to directly generate near-optimal DL precoders. The training is end-to-end which exploits synergies between the two DNNs. For MU-MIMO precoding, we propose a DNN structure inspired by theoretically optimum linear precoding. The proposed methods are evaluated against genie-aided upper bounds and conventional approaches, using realistic upper midband datasets. Numerical results demonstrate the potential of our approach to achieve significantly increased sum-rate, particularly at moderate to high signal-to-noise ratio (SNR) and when UL pilot overhead is constrained.


title: VISION-MAE: A Foundation Model for Medical Image Segmentation and Classification

abstract: Artificial Intelligence (AI) has the potential to revolutionize diagnosis and segmentation in medical imaging. However, development and clinical implementation face multiple challenges including limited data availability, lack of generalizability, and the necessity to incorporate multi-modal data effectively. A foundation model, which is a large-scale pre-trained AI model, offers a versatile base that can be adapted to a variety of specific tasks and contexts. Here, we present a novel foundation model, VISION-MAE, specifically designed for medical imaging. Specifically, VISION-MAE is trained on a dataset of 2.5 million unlabeled images from various modalities (CT, MR, PET, X-rays, and ultrasound), using self-supervised learning techniques. It is then adapted to classification and segmentation tasks using explicit labels. VISION-MAE has high label efficiency, outperforming several benchmark models in both in-domain and out-of-domain applications, and achieves high performance even with reduced availability of labeled data. This model represents a significant advancement in medical imaging AI, offering a generalizable and robust solution for improving segmentation and classification tasks while reducing the data annotation workload.


title: Getting the most out of your tokenizer for pre-training and domain adaptation

abstract: Tokenization is an understudied and often neglected component of modern LLMs. Most published works use a single tokenizer for all experiments, often borrowed from another model, without performing ablations or analysis to optimize tokenization. Moreover, the tokenizer is generally kept unchanged when fine-tuning a base model. In this paper, we show that the size, pre-tokenization regular expression, and training data of a tokenizer can significantly impact the model's generation speed, effective context size, memory usage, and downstream performance. We train specialized Byte-Pair Encoding code tokenizers, and conduct extensive ablations on the impact of tokenizer design on the performance of LLMs for code generation tasks such as HumanEval and MBPP, and provide recommendations for tokenizer hyper-parameters selection and switching the tokenizer in a pre-trained LLM. We perform our experiments on models trained from scratch and from pre-trained models, verifying their applicability to a wide range of use-cases. We find that when fine-tuning on more than 50 billion tokens, we can specialize the tokenizer of a pre-trained LLM to obtain large gains in generation speed and effective context size.


title: Fisher information dissipation for time inhomogeneous stochastic differential equations

abstract: We provide a Lyapunov convergence analysis for time-inhomogeneous variable coefficient stochastic differential equations (SDEs). Three typical examples include overdamped, irreversible drift, and underdamped Langevin dynamics. We first formula the probability transition equation of Langevin dynamics as a modified gradient flow of the Kullback-Leibler divergence in the probability space with respect to time-dependent optimal transport metrics. This formulation contains both gradient and non-gradient directions depending on a class of time-dependent target distribution. We then select a time-dependent relative Fisher information functional as a Lyapunov functional. We develop a time-dependent Hessian matrix condition, which guarantees the convergence of the probability density function of the SDE. We verify the proposed conditions for several time-inhomogeneous Langevin dynamics. For the overdamped Langevin dynamics, we prove the $O(t^{-1/2})$ convergence in $L^1$ distance for the simulated annealing dynamics with a strongly convex potential function. For the irreversible drift Langevin dynamics, we prove an improved convergence towards the target distribution in an asymptotic regime. We also verify the convergence condition for the underdamped Langevin dynamics. Numerical examples demonstrate the convergence results for the time-dependent Langevin dynamics.


title: Wireless Information Surveillance via STAR-RIS

abstract: We explore the potential of a simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS) to enhance the performance of wireless surveillance systems. The STAR-RIS is deployed between a full-duplex (FD) multi-antenna legitimate eavesdropper (E) and a suspicious communication pair. It reflects the suspicious signal towards the suspicious receiver (SR), while simultaneously transmitting the same signal to E for interception purposes. Additionally, it enables the forwarding of a jamming signal from E to SR, which is located on the back side of the STAR-RIS. To enhance the eavesdropping non-outage probability, we formulate a non-convex joint optimization problem to design the beamforming vectors at E and reflection/transmission phase shift matrices at the STAR-RIS. We adopt the block coordinate descent (BCD) algorithm and propose an approach, mainly based on semi-definite relaxation (SDR) and successive convex approximation (SCA), for solving the resulting decoupled sub-problems. Finally, we compare the performance of the proposed design against low-complexity zero-forcing (ZF)-based beamforming designs.


title: Improved regularity and analyticity of Cannone-Karch solutions of the three-dimensional Navier-Stokes equations on the torus

abstract: We consider the three-dimensional Navier-Stokes equations, with initial data having second derivatives in the space of pseudomeasures. Solutions of this system with such data have been shown to exist previously by Cannone and Karch. As the Navier-Stokes equations are a parabolic system, the solutions gain regularity at positive times. We demonstrate an improved gain of regularity at positive times as compared to that demonstrated by Cannone and Karch. We further demonstrate that the solutions are analytic at all positive times, with lower bounds given for the radius of analyticity.


title: Meron-Cluster Algorithms for Quantum Link Models

abstract: State-of-the-art algorithms for simulating fermions coupled to gauge fields often rely on integrating fermion degrees of freedom. While successful in simulating QCD at zero chemical potential, at finite density these approaches are hindered by the sign problem. We discuss the simulation of lattice gauge theories in the Hamiltonian formalism and present a generalized meron-cluster algorithm for the simulation of the $U\left(1\right)$ Quantum Link Model for spin $1/2$. This enables the study of models directly relevant to current quantum simulators and is a promising first step toward constructing new efficient algorithms for more complicated gauge theories.


title: Everyday Uses of Music Listening and Music Technologies by Caregivers and People with Dementia: Survey and Focus Group Study

abstract: Music is a valuable non-pharmacological tool that provides benefits for people with dementia, and there is interest in designing technologies to support music use in dementia care. To ensure music technologies are appropriately designed for supporting caregivers and people living with dementia, there remains a need to better understand how music is currently used in everyday care at home. We aimed to understand how people with dementia and their caregivers use music technologies in everyday caring, as well as challenges they experience using music and technology. This study used a mixed methods design. A survey was completed by 77 caregivers and people with dementia to understand their use of music and technology. Of these, 18 survey respondents (12 family caregivers, 6 people living with dementia) participated in focus groups about their experiences of using music and technology in care. Transcripts were analysed with reflexive thematic analysis. Most survey respondents used music often in their daily lives, reporting a range of music technologies such as CDs, radio, and streaming. Focus groups highlighted benefits and challenges of music technologies in everyday care. Participants used music and music technologies to regulate mood, provide joy, facilitate social connection, encourage reminiscence, provide continuity before and after diagnosis, and to make caregiving easier. Challenges of using music technology in care included difficulties staying up to date with evolving technology, and low self-efficacy for technology use expressed by people living with dementia. Evidently, people living with dementia and their caregivers use music technologies to support their everyday care needs. Results suggest opportunities to design technologies enabling easier access to music and supporting people living with dementia with recreational and therapeutic music listening and music-based activities.


title: Unirationality of the universal moduli space of semistable bundles over smooth curves

abstract: We construct explicit dominant, rational morphisms from projective bundles over rational varieties to relevant moduli spaces, showing their unirationality. These constructions work for $U_{r,d,g}$; for all ranks, degrees and genus $2\leq g \leq 9$. Furthermore, the arguments presented also show that a similar conclusion can be made for $U_{r, \mathcal{L}, g}$ for all $r,d$ and unirational $M_g$


title: Nonlinear electrodynamics for the vacuum of Dirac materials. Photon magnetic properties and radiation pressures

abstract: We investigate the magnetic properties of photons propagating through Dirac materials in a magnetic field, considering both vacuum and medium contributions. Photon propagation properties are obtained through a second-order expansion of non-linear Euler-Heisenberg electrodynamics at finite density and temperature considering Dirac material parameters (Dirac fine structure constant, band gap and Fermi velocity). Total magnetization (including electrons and photon contributions) and photon-effective magnetic moment are computed. Observables such as photon energy density, radiation pressure, and Poynting vector are obtained by an average of components of the energy-momentum tensor. All quantities are expressed in terms of Lagrangian derivatives. Those related to the vacuum are valid for any value of the external magnetic field, and both the weak and strong field limits are recovered. We discuss some ideas of experiments that may contribute to testing in Dirac materials the phenomenology of the strong magnetic field in the quantum electrodynamic vacuum and how non-linear corrections on the magnetization, radiation pressure, and birefringence, are amplified up to $10^3$ times QED corrections.


title: Blackbody radiation and thermal effects on chemical reactions and phase transitions in cavities

abstract: An important question in polariton chemistry is whether reacting molecules are in thermal equilibrium with their surroundings. If not, can experimental changes observed in reaction rates of molecules in a cavity (even without optical pumping) be attributed to a higher/lower temperature inside the cavity? In this work, we address this question by computing temperature differences between reacting molecules inside a cavity and the air outside. We find this temperature difference to be negligible for most reactions. On the other hand, for phase transitions inside cavities, as the temperature of the material is actively maintained by a heating/cooling source in experiments, we show cavities can modify observed transition temperatures when mirrors and cavity windows are ideal (non-absorbing); however, this modification vanishes when real mirrors and windows are used. Finally, we find substantial differences in blackbody spectral energy density between free space and infrared cavities, which reveal resonance effects and could potentially play a role in explaining changes in chemical reactivity in the dark.


title: Diffraction as a unitary representation and the orthogonality of measures with respect to the reflected Eberlein convolution

abstract: We discuss how the diffraction theory of a single translation bounded measure or a family of such measures can be understood within the framework of unitary group representations. This allows us to prove an orthogonality feature of measures whose diffractions are mutually singular. We apply this to study dynamical systems, the refined Eberlein decomposition and validity of a Bombieri--Taylor type result in a rather general context. Along the way we also use our approach to (re)prove various characterisations of pure point diffraction.


title: LatticeGraphNet: A two-scale graph neural operator for simulating lattice structures

abstract: This study introduces a two-scale Graph Neural Operator (GNO), namely, LatticeGraphNet (LGN), designed as a surrogate model for costly nonlinear finite-element simulations of three-dimensional latticed parts and structures. LGN has two networks: LGN-i, learning the reduced dynamics of lattices, and LGN-ii, learning the mapping from the reduced representation onto the tetrahedral mesh. LGN can predict deformation for arbitrary lattices, therefore the name operator. Our approach significantly reduces inference time while maintaining high accuracy for unseen simulations, establishing the use of GNOs as efficient surrogate models for evaluating mechanical responses of lattices and structures.


title: Towards the Application of Skewed Detailed Balance in Lattice Gauge Theories

abstract: State-of-the-art algorithms in lattice gauge theory typically rely heavily on detailed balance, which is an instrumental tool to prove the correct convergence of the Markov Chain Monte Carlo Algorithm. In this work, we investigate an alternative to detailed balance, skewed detailed balance, and the prospects of alleviating the topological freezing problem by studying the one-dimensional $O\left(2\right)$ model.


title: Ultra Fast Transformers on FPGAs for Particle Physics Experiments

abstract: This work introduces a highly efficient implementation of the transformer architecture on a Field-Programmable Gate Array (FPGA) by using the \texttt{hls4ml} tool. Given the demonstrated effectiveness of transformer models in addressing a wide range of problems, their application in experimental triggers within particle physics becomes a subject of significant interest. In this work, we have implemented critical components of a transformer model, such as multi-head attention and softmax layers. To evaluate the effectiveness of our implementation, we have focused on a particle physics jet flavor tagging problem, employing a public dataset. We recorded latency under 2 $\mu$s on the Xilinx UltraScale+ FPGA, which is compatible with hardware trigger requirements at the CERN Large Hadron Collider experiments.


title: Maximum energy achievable in supernova remnants: self-consistent simulations

abstract: It has been long believed that oblique and quasi-perpendicular configurations in supernova remnants (SNRs) were inefficient at injecting ions into diffusive shock acceleration (DSA), and that the highest energy Galactic cosmic rays (CRs) must come from parallel or quasi-parallel shocks. However, recent 3D kinetic simulations have shown that high-obliquity shocks can successfully energize particles and produce amplified magnetic fields in the upstream. We aim to investigate the maximum energy particles it is possible to produce in oblique and quasi-perpendicular shocks and whether they are capable of triggering the non-resonant hybrid instability (NRHI). We present a novel setup for hybrid simulations of non-relativistic shocks that use a "faux shock" boundary condition instead of a real shock to significantly reduce the computational cost and that can be run for long enough to study the late-time behaviors of these systems. Our results show that it may be possible for oblique and quasi-perpendicular shocks to transition from early periods of shock drift acceleration (SDA) into DSA at later times, giving particles a brief period of rapid acceleration followed by a long-duration, self-sustaining period of slower energy growth. Furthermore, we find evidence that the NRHI is triggered in the upstream at late times. Oblique and quasi-perpendicular shocks may be an important contributor to high energy CRs, potentially even responsible for the knee in the CR energy spectrum.


title: IMUGPT 2.0: Language-Based Cross Modality Transfer for Sensor-Based Human Activity Recognition

abstract: One of the primary challenges in the field of human activity recognition (HAR) is the lack of large labeled datasets. This hinders the development of robust and generalizable models. Recently, cross modality transfer approaches have been explored that can alleviate the problem of data scarcity. These approaches convert existing datasets from a source modality, such as video, to a target modality (IMU). With the emergence of generative AI models such as large language models (LLMs) and text-driven motion synthesis models, language has become a promising source data modality as well as shown in proof of concepts such as IMUGPT. In this work, we conduct a large-scale evaluation of language-based cross modality transfer to determine their effectiveness for HAR. Based on this study, we introduce two new extensions for IMUGPT that enhance its use for practical HAR application scenarios: a motion filter capable of filtering out irrelevant motion sequences to ensure the relevance of the generated virtual IMU data, and a set of metrics that measure the diversity of the generated data facilitating the determination of when to stop generating virtual IMU data for both effective and efficient processing. We demonstrate that our diversity metrics can reduce the effort needed for the generation of virtual IMU data by at least 50%, which open up IMUGPT for practical use cases beyond a mere proof of concept.


title: Distributed MCMC inference for Bayesian Non-Parametric Latent Block Model

abstract: In this paper, we introduce a novel Distributed Markov Chain Monte Carlo (MCMC) inference method for the Bayesian Non-Parametric Latent Block Model (DisNPLBM), employing the Master/Worker architecture. Our non-parametric co-clustering algorithm divides observations and features into partitions using latent multivariate Gaussian block distributions. The workload on rows is evenly distributed among workers, who exclusively communicate with the master and not among themselves. DisNPLBM demonstrates its impact on cluster labeling accuracy and execution times through experimental results. Moreover, we present a real-use case applying our approach to co-cluster gene expression data. The code source is publicly available at https://github.com/redakhoufache/Distributed-NPLBM.


title: Generation, Distillation and Evaluation of Motivational Interviewing-Style Reflections with a Foundational Language Model

abstract: Large Foundational Language Models are capable of performing many tasks at a high level but are difficult to deploy in many applications because of their size and proprietary ownership. Many will be motivated to distill specific capabilities of foundational models into smaller models that can be owned and controlled. In the development of a therapeutic chatbot, we wish to distill a capability known as reflective listening, in which a therapist produces reflections of client speech. These reflections either restate what a client has said, or connect what was said to a relevant observation, idea or guess that encourages and guides the client to continue contemplation. In this paper, we present a method for distilling the generation of reflections from a Foundational Language Model (GPT-4) into smaller models. We first show that GPT-4, using zero-shot prompting, can generate reflections at near 100% success rate, superior to all previous methods. Using reflections generated by GPT-4, we fine-tune different sizes of the GPT-2 family. The GPT-2-small model achieves 83% success on a hold-out test set and the GPT-2 XL achieves 90% success. We also show that GPT-4 can help in the labor-intensive task of evaluating the quality of the distilled models, using it as a zero-shot classifier. Using triple-human review as a guide, the classifier achieves a Cohen-Kappa of 0.66, a substantial inter-rater reliability figure.


title: Weakly Convex Regularisers for Inverse Problems: Convergence of Critical Points and Primal-Dual Optimisation

abstract: Variational regularisation is the primary method for solving inverse problems, and recently there has been considerable work leveraging deeply learned regularisation for enhanced performance. However, few results exist addressing the convergence of such regularisation, particularly within the context of critical points as opposed to global minimisers. In this paper, we present a generalised formulation of convergent regularisation in terms of critical points, and show that this is achieved by a class of weakly convex regularisers. We prove convergence of the primal-dual hybrid gradient method for the associated variational problem, and, given a Kurdyka-Lojasiewicz condition, an $\mathcal{O}(\log{k}/k)$ ergodic convergence rate. Finally, applying this theory to learned regularisation, we prove universal approximation for input weakly convex neural networks (IWCNN), and show empirically that IWCNNs can lead to improved performance of learned adversarial regularisers for computed tomography (CT) reconstruction.


title: Plan-Grounded Large Language Models for Dual Goal Conversational Settings

abstract: Training Large Language Models (LLMs) to follow user instructions has been shown to supply the LLM with ample capacity to converse fluently while being aligned with humans. Yet, it is not completely clear how an LLM can lead a plan-grounded conversation in mixed-initiative settings where instructions flow in both directions of the conversation, i.e. both the LLM and the user provide instructions to one another. In this paper, we tackle a dual goal mixed-initiative conversational setting where the LLM not only grounds the conversation on an arbitrary plan but also seeks to satisfy both a procedural plan and user instructions. The LLM is then responsible for guiding the user through the plan and, at the same time, adapting to new circumstances, answering questions, and activating safety guardrails when needed. We propose a novel LLM that grounds the dialogue on a procedural plan, can take the dialogue initiative, and enforces guardrails on the system's behavior, while also improving the LLM's responses to unexpected user behavior. Experiments in controlled settings and with real users show that the best-performing model, which we call PlanLLM, achieves a 2.1x improvement over a strong baseline. Moreover, experiments also show good generalization to unseen domains.


title: Unconditional Latent Diffusion Models Memorize Patient Imaging Data

abstract: Generative latent diffusion models hold a wide range of applications in the medical imaging domain. A noteworthy application is privacy-preserved open-data sharing by proposing synthetic data as surrogates of real patient data. Despite the promise, these models are susceptible to patient data memorization, where models generate patient data copies instead of novel synthetic samples. This undermines the whole purpose of preserving patient data and may even result in patient re-identification. Considering the importance of the problem, surprisingly it has received relatively little attention in the medical imaging community. To this end, we assess memorization in latent diffusion models for medical image synthesis. We train 2D and 3D latent diffusion models on CT, MR, and X-ray datasets for synthetic data generation. Afterwards, we examine the amount of training data memorized utilizing self-supervised models and further investigate various factors that can possibly lead to memorization by training models in different settings. We observe a surprisingly large amount of data memorization among all datasets, with up to 41.7%, 19.6%, and 32.6% of the training data memorized in CT, MRI, and X-ray datasets respectively. Further analyses reveal that increasing training data size and using data augmentation reduce memorization, while over-training enhances it. Overall, our results suggest a call for memorization-informed evaluation of synthetic data prior to open-data sharing.


title: Multiclass Learning from Noisy Labels for Non-decomposable Performance Measures

abstract: There has been much interest in recent years in learning good classifiers from data with noisy labels. Most work on learning from noisy labels has focused on standard loss-based performance measures. However, many machine learning problems require using non-decomposable performance measures which cannot be expressed as the expectation or sum of a loss on individual examples; these include for example the H-mean, Q-mean and G-mean in class imbalance settings, and the Micro $F_1$ in information retrieval. In this paper, we design algorithms to learn from noisy labels for two broad classes of multiclass non-decomposable performance measures, namely, monotonic convex and ratio-of-linear, which encompass all the above examples. Our work builds on the Frank-Wolfe and Bisection based methods of Narasimhan et al. (2015). In both cases, we develop noise-corrected versions of the algorithms under the widely studied family of class-conditional noise models. We provide regret (excess risk) bounds for our algorithms, establishing that even though they are trained on noisy data, they are Bayes consistent in the sense that their performance converges to the optimal performance w.r.t. the clean (non-noisy) distribution. Our experiments demonstrate the effectiveness of our algorithms in handling label noise.


title: Computational characterization of the role of an attention schema in controlling visuospatial attention

abstract: How does the brain control attention? The Attention Schema Theory suggests that the brain explicitly models its state of attention, termed an attention schema, for its control. However, it remains unclear under which circumstances an attention schema is computationally useful, and whether it can emerge in a learning system without hard-wiring. To address these questions, we trained a reinforcement learning agent with attention to track and catch a ball in a noisy environment. Crucially, the agent had additional resources that it could freely use. We asked under which conditions these additional resources develop an attention schema to track attention. We found that the more uncertain the agent was about the location of its attentional window, the more it benefited from these additional resources, which developed an attention schema. Together, these results indicate that an attention schema emerges in simple learning systems where attention is important and difficult to track.


title: Expert Proximity as Surrogate Rewards for Single Demonstration Imitation Learning

abstract: In this paper, we focus on single-demonstration imitation learning (IL), a practical approach for real-world applications where acquiring multiple expert demonstrations is costly or infeasible and the ground truth reward function is not available. In contrast to typical IL settings with multiple demonstrations, single-demonstration IL involves an agent having access to only one expert trajectory. We highlight the issue of sparse reward signals in this setting and propose to mitigate this issue through our proposed Transition Discriminator-based IL (TDIL) method. TDIL is an IRL method designed to address reward sparsity by introducing a denser surrogate reward function that considers environmental dynamics. This surrogate reward function encourages the agent to navigate towards states that are proximal to expert states. In practice, TDIL trains a transition discriminator to differentiate between valid and non-valid transitions in a given environment to compute the surrogate rewards. The experiments demonstrate that TDIL outperforms existing IL approaches and achieves expert-level performance in the single-demonstration IL setting across five widely adopted MuJoCo benchmarks as well as the "Adroit Door" robotic environment.


title: Towards an Algebraic Framework For Approximating Functions Using Neural Network Polynomials

abstract: We make the case for neural network objects and extend an already existing neural network calculus explained in detail in Chapter 2 on \cite{bigbook}. Our aim will be to show that, yes, indeed, it makes sense to talk about neural network polynomials, neural network exponentials, sine, and cosines in the sense that they do indeed approximate their real number counterparts subject to limitations on certain of their parameters, $q$, and $\varepsilon$. While doing this, we show that the parameter and depth growth are only polynomial on their desired accuracy (defined as a 1-norm difference over $\mathbb{R}$), thereby showing that this approach to approximating, where a neural network in some sense has the structural properties of the function it is approximating is not entire intractable.


title: Eco-driving under localization uncertainty for connected vehicles on Urban roads: Data-driven approach and Experiment verification

abstract: This paper addresses the eco-driving problem for connected vehicles on urban roads, considering localization uncertainty. Eco-driving is defined as longitudinal speed planning and control on roads with the presence of a sequence of traffic lights. We solve the problem by using a data-driven model predictive control (MPC) strategy. This approach involves learning a cost-to-go function and constraints from state-input data. The cost-to-go function represents the remaining energy-to-spend from the given state, and the constraints ensure that the controlled vehicle passes the upcoming traffic light timely while obeying traffic laws. The resulting convex optimization problem has a short horizon and is amenable for real-time implementations. We demonstrate the effectiveness of our approach through real-world vehicle experiments. Our method demonstrates $12\%$ improvement in energy efficiency compared to the traditional approaches, which plan longitudinal speed by solving a long-horizon optimal control problem and track the planned speed using another controller, as evidenced by vehicle experiments.


title: High-volume tunable resonator for axion searches above 7 GHz

abstract: We present results from the first experimental demonstration of a tunable thin-shell axion haloscope. This novel geometry decouples the overall volume of the cavity-based resonator from its resonant frequency, thereby evading the steep sensitivity degradation at high-frequencies. An aluminum $2.6$ L ($41$ $\lambda^3$) prototype which tunes from $7.1$ to $8.0$ GHz was fabricated and characterized at room temperature. An axion-sensitive, straightforwardly tunable $\mathrm{TM}$$_{010}$ mode is clearly identified with a room temperature quality factor, $Q$, of $\sim$$5,000$. The on-resonance $E$-field distribution is mapped and found to agree with numerical calculations. Anticipating future cryogenic operation, we develop an alignment protocol relying only on rf measurements of the cavity, maintaining a form factor of $0.57$ across the full tuning range. These measurements demonstrate the feasibility of cavity-based haloscopes with operating volume $V\gg\lambda^3$. We discuss plans for future development and the parameters required for a thin-shell haloscope exploring the post-inflationary axion parameter space ($\sim$$4$ to $\sim$$30$ GHz) at DFSZ sensitivity.


title: On the power of linear programming for K-means clustering

abstract: In [SIAM J. Optim., 2022], the authors introduced a new linear programming (LP) relaxation for K-means clustering. In this paper, we further investigate the theoretical properties of this relaxation. We focus on K-means clustering with two clusters, which is an NP-hard problem. As evident from our numerical experiments with both synthetic and real-world data sets, the proposed LP relaxation is almost always tight; i.e. its optimal solution is feasible for the original nonconvex problem. To better understand this unexpected behaviour, we obtain sufficient conditions under which the LP relaxation is tight. We further analyze the sufficient conditions when the input is generated according to a popular stochastic model and obtain recovery guarantees for the LP relaxation. Finally, we construct a family of inputs for which the LP relaxation is never tight.


title: Bio-Inspired Compensatory Strategies for Damage to Flapping Robotic Propulsors

abstract: To maintain full autonomy, autonomous robotic systems must have the ability to self-repair. Self-repairing via compensatory mechanisms appears in nature: for example, some fish can lose even 76% of their propulsive surface without loss of thrust by altering stroke mechanics. However, direct transference of these alterations from an organism to a robotic flapping propulsor may not be optimal due to irrelevant evolutionary pressures. We instead seek to determine what alterations to stroke mechanics are optimal for a damaged robotic system via artificial evolution. To determine whether natural and machine-learned optima differ, we employ a cyber-physical system using a Covariance Matrix Adaptation Evolutionary Strategy to seek the most efficient trajectory for a given force. We implement an online optimization with hardware-in-the-loop, performing experimental function evaluations with an actuated flexible flat plate. To recoup thrust production following partial amputation, the most efficient learned strategy was to increase amplitude, increase frequency, increase the amplitude of angle of attack, and phase shift the angle of attack by approximately 110 degrees. In fish, only an amplitude increase is reported by majority in the literature. To recoup side-force production, a more challenging optimization landscape is encountered. Nesting of optimal angle of attack traces is found in the resultant-based reference frame, but no clear trend in amplitude or frequency are exhibited -- in contrast to the increase in frequency reported in insect literature. These results suggest that how mechanical flapping propulsors most efficiently adjust to damage of a flapping propulsor may not align with natural swimmers and flyers.


title: Dracula's Chivito: discovery of a large edge-on protoplanetary disk with Pan-STARRS

abstract: We report the serendipitous discovery of a large edge-on protoplanetary disk associated with the infrared source IRAS 23077+6707. The disk's apparent size in the Pan-STARRS (PS1) images is ~11", making this one of the largest known disks on the sky. It is likely a young system, still surrounded by the envelope which is very faint but still visible in the PS1 images in the northern part (alternatively this structure could be filaments from the disk itself). We use the PS1 magnitudes and other available photometric data to construct the spectral energy distribution (SED) of the disk. An optical spectrum indicates that the obscured star is hot, most likely late A. We adopt a distance of 300 pc for this object based on Gaia DR3 extinctions. We model the system using the HOCHUNK3D radiative transfer software and find that the system is consistent with a hot star of effective temperature 8000 K surrounded by a disk of size 1650 AU and mass 0.2 M_solar at inclination 82 degrees.


title: Semantic-Aware and Goal-Oriented Communications for Object Detection in Wireless End-to-End Image Transmission

abstract: Semantic communication is focused on optimizing the exchange of information by transmitting only the most relevant data required to convey the intended message to the receiver and achieve the desired communication goal. For example, if we consider images as the information and the goal of the communication is object detection at the receiver side, the semantic of information would be the objects in each image. Therefore, by only transferring the semantics of images we can achieve the communication goal. In this paper, we propose a design framework for implementing semantic-aware and goal-oriented communication of images. To achieve this, we first define the baseline problem as a set of mathematical problems that can be optimized to improve the efficiency and effectiveness of the communication system. We consider two scenarios in which either the data rate or the error at the receiver is the limiting constraint. Our proposed system model and solution is inspired by the concept of auto-encoders, where the encoder and the decoder are respectively implemented at the transmitter and receiver to extract semantic information for specific object detection goals. Our numerical results validate the proposed design framework to achieve low error or near-optimal in a goal-oriented communication system while reducing the amount of data transfers.


title: Evaluation Methodology for Large Language Models for Multilingual Document Question and Answer

abstract: With the widespread adoption of Large Language Models (LLMs), in this paper we investigate the multilingual capability of these models. Our preliminary results show that, translating the native language context, question and answer into a high resource language produced the best results.


title: On the Hardness of Short and Sign-Compatible Circuit Walks

abstract: The circuits of a polyhedron are a superset of its edge directions. Circuit walks, a sequence of steps along circuits, generalize edge walks and are "short" if they have few steps or small total length. Both interpretations of short are relevant to the theory and application of linear programming. We study the hardness of several problems relating to the construction of short circuit walks. We establish that for a pair of vertices of a $0/1$-network-flow polytope, it is NP-complete to determine the length of a shortest circuit walk, even if we add the requirement that the walk must be sign-compatible. Our results also imply that determining the minimal number of circuits needed for a sign-compatible decomposition is NP-complete. Further, we show that it is NP-complete to determine the smallest total length (for $p$-norms $\lVert \cdot \rVert_p$, $1 < p \leq \infty$) of a circuit walk between a pair of vertices. One method to construct a short circuit walk is to pick up a correct facet at each step, which generalizes a non-revisiting walk. We prove that it is NP-complete to determine if there is a circuit direction that picks up a correct facet; in contrast, this problem can be solved in polynomial time for TU polyhedra.


title: Assessing Patient Eligibility for Inspire Therapy through Machine Learning and Deep Learning Models

abstract: Inspire therapy is an FDA-approved internal neurostimulation treatment for obstructive sleep apnea. However, not all patients respond to this therapy, posing a challenge even for experienced otolaryngologists to determine candidacy. This paper makes the first attempt to leverage both machine learning and deep learning techniques in discerning patient responsiveness to Inspire therapy using medical data and videos captured through Drug-Induced Sleep Endoscopy (DISE), an essential procedure for Inspire therapy. To achieve this, we gathered and annotated three datasets from 127 patients. Two of these datasets comprise endoscopic videos focused on the Base of the Tongue and Velopharynx. The third dataset composes the patient's clinical information. By utilizing these datasets, we benchmarked and compared the performance of six deep learning models and five classical machine learning algorithms. The results demonstrate the potential of employing machine learning and deep learning techniques to determine a patient's eligibility for Inspire therapy, paving the way for future advancements in this field.


title: Unbreakable and breakable quantum censorship

abstract: A protocol for regulating the distribution of quantum information between multiple parties is put forward. In order to prohibit the unrestricted distribution of quantum-resource states in a public quantum network, agents can apply a resource-destroying map to each sender's channel. Since resource-destroying maps only exist for affine quantum resource theories, censorship of a nonaffine resource theory is established on an operationally motivated subspace of free states. This is achieved by using what we name a resource-censoring map. The protocol is applied to censoring coherence, reference frames, and entanglement. Because of the local nature of the censorship protocol, it is, in principle, possible for collaborating parties to bypass censorship. Thus, we additionally derive necessary and sufficient conditions under which the censorship protocol is unbreakable.


title: Data-driven model selection within the matrix completion method for causal panel data models

abstract: Matrix completion estimators are employed in causal panel data models to regulate the rank of the underlying factor model using nuclear norm minimization. This convex optimization problem enables concurrent regularization of a potentially high-dimensional set of covariates to shrink the model size. For valid finite sample inference, we adopt a permutation-based approach and prove its validity for any treatment assignment mechanism. Simulations illustrate the consistency of the proposed estimator in parameter estimation and variable selection. An application to public health policies in Germany demonstrates the data-driven model selection feature on empirical data and finds no effect of travel restrictions on the containment of severe Covid-19 infections.


title: FedShift: Tackling Dual Heterogeneity Problem of Federated Learning via Weight Shift Aggregation

abstract: Federated Learning (FL) offers a compelling method for training machine learning models with a focus on preserving data privacy. The presence of system heterogeneity and statistical heterogeneity, recognized challenges in FL, arises from the diversity of client hardware, network, and dataset distribution. This diversity can critically affect the training pace and the performance of models. While many studies address either system or statistical heterogeneity by introducing communication-efficient or stable convergence algorithms, addressing these challenges in isolation often leads to compromises due to unaddressed heterogeneity. In response, this paper introduces FedShift, a novel algorithm designed to enhance both the training speed and the models' accuracy in a dual heterogeneity scenario. Our solution can improve client engagement through quantization and mitigate the adverse effects on performance typically associated with quantization by employing a shifting technique. This technique has proven to enhance accuracy by an average of 3.9% in diverse heterogeneity environments.


title: Chameleon: Foundation Models for Fairness-aware Multi-modal Data Augmentation to Enhance Coverage of Minorities

abstract: The potential harms of the under-representation of minorities in training data, particularly in multi-modal settings, is a well-recognized concern. While there has been extensive effort in detecting such under-representation, resolution has remained a challenge. With recent advancements in generative AI, large language models and foundation models have emerged as versatile tools across various domains. In this paper, we propose Chameleon, a system that efficiently utilizes these tools to augment a data set with a minimal addition of synthetically generated tuples, in order to enhance the coverage of the under-represented groups. Our system follows a rejection sampling approach to ensure the generated tuples have a high quality and follow the underlying distribution. In order to minimize the rejection chance of the generated tuples, we propose multiple strategies for providing a guide for the foundation model. Our experiment results, in addition to confirming the efficiency of our proposed algorithms, illustrate the effectiveness of our approach, as the unfairness of the model in a downstream task significantly dropped after data repair using Chameleon.


title: The influence of weakly $S\Phi$-supplemented subgroups on fusion systems of finite groups

abstract: Let $G$ be a finite group and $H$ be a subgroup of $G$. Then $H$ is called a weakly $S\Phi$-supplemented subgroup of $G$, if there exists a subgroup $T$ of $G$ such that $G =HT$ and $H \cap T \leq \Phi (H) H_{sG}$, where $H_{sG}$ denotes the subgroup of $H$ generated by all subgroups of $H$ which are $S$-permutable in $G$. Let $p$ be a prime, $S$ be a $p$-group and $\mathcal{F}$ be a saturated fusion system over $S$. Then $\mathcal{F}$ is said to be supersolvable, if there exists a series of $S$, namely $1 = S_0 \leq S_1 \leq \cdots \leq S_n = S$, such that $S_{i+1}/S_i$ is cyclic, $i=0,1,\cdots, n-1$, $S_i$ is strongly $\mathcal{F}$-closed, $i=0,1,\cdots,n$. In this paper, we investigate the structure of fusion system $\mathcal{F}_S (G)$ under the assumption that certain subgroups of $S$ are weakly $S\Phi$-supplemented in $G$, and obtain several new characterizations of supersolvability of $\mathcal{F}_S (G)$.