title: PhysAvatar: Learning the Physics of Dressed 3D Avatars from Visual Observations

abstract: Modeling and rendering photorealistic avatars is of crucial importance in many applications. Existing methods that build a 3D avatar from visual observations, however, struggle to reconstruct clothed humans. We introduce PhysAvatar, a novel framework that combines inverse rendering with inverse physics to automatically estimate the shape and appearance of a human from multi-view video data along with the physical parameters of the fabric of their clothes. For this purpose, we adopt a mesh-aligned 4D Gaussian technique for spatio-temporal mesh tracking as well as a physically based inverse renderer to estimate the intrinsic material properties. PhysAvatar integrates a physics simulator to estimate the physical parameters of the garments using gradient-based optimization in a principled manner. These novel capabilities enable PhysAvatar to create high-quality novel-view renderings of avatars dressed in loose-fitting clothes under motions and lighting conditions not seen in the training data. This marks a significant advancement towards modeling photorealistic digital humans using physically based inverse rendering with physics in the loop. Our project website is at: https://qingqing-zhao.github.io/PhysAvatar


title: Long-term variability in debris transiting white dwarfs

abstract: Combining archival photometric observations from multiple large-area surveys spanning the past 17 years, we detect long-term variability in the light curves of ZTFJ032833.52-121945.27 (ZTFJ0328-1219), ZTFJ092311.41+423634.16 (ZTFJ0923+4236) and WD1145+017, all known to exhibit transits from planetary debris. ZTFJ0328-1219 showed an overall fading in brightness from 2011 through to 2015, with a maximum dimming of ~0.3 mag, and still remains ~0.1 mag fainter compared to 2006. We complement the analysis of the long-term behaviour of these systems with high-speed photometry. In the case of ZTFJ0923+4236 and WD1145+017, the time-series photometry exhibits vast variations in the level of transit activity, both in terms of numbers of transits, as well as their shapes and depths, and these variations correlate with the overall brightness of the systems. Inspecting the current known sample of white dwarfs with transiting debris, we estimate that similar photometric signatures may be detectable in one in a few hundred of all white dwarfs. Accounting for the highly aligned geometry required to detect transits, our estimates imply that a substantial fraction of all white dwarfs exhibiting photospheric metal pollution from accreted debris host close-in planetesimals that are currently undergoing disintegration.


title: Estimating the Energy Threshold of Phonon-mediated Superconducting Qubit Detectors Operated in an Energy-Relaxation Sensing Scheme

abstract: In recent years, the lack of a conclusive detection of WIMP dark matter at the 10 GeV/c$^{2}$ mass scale and above has encouraged development of low-threshold detector technology aimed at probing lighter dark matter candidates. Detectors based on Cooper-pair-breaking sensors have emerged as a promising avenue for this detection due to the low (meV-scale) energy required for breaking a Cooper pair in most superconductors. Among them, devices based on superconducting qubits are interesting candidates for sensing due to their observed sensitivity to broken Cooper pairs. We have developed an end-to-end G4CMP-based simulation framework and have used it to evaluate performance metrics of qubit-based devices operating in a gate-based "energy relaxation" readout scheme, akin to those used in recent studies of qubit sensitivity to ionizing radiation. We find that for this readout scheme, the qubit acts as a phonon sensor with an energy threshold ranging down to $\simeq$0.4 eV for near-term performance parameters.


title: Algorithmic Fairness and Social Welfare

abstract: Algorithms are increasingly used to guide high-stakes decisions about individuals. Consequently, substantial interest has developed around defining and measuring the ``fairness'' of these algorithms. These definitions of fair algorithms share two features: First, they prioritize the role of a pre-defined group identity (e.g., race or gender) by focusing on how the algorithm's impact differs systematically across groups. Second, they are statistical in nature; for example, comparing false positive rates, or assessing whether group identity is independent of the decision (where both are viewed as random variables). These notions are facially distinct from a social welfare approach to fairness, in particular one based on ``veil of ignorance'' thought experiments in which individuals choose how to structure society prior to the realization of their social identity. In this paper, we seek to understand and organize the relationship between these different approaches to fairness. Can the optimization criteria proposed in the algorithmic fairness literature also be motivated as the choices of someone from behind the veil of ignorance? If not, what properties distinguish either approach to fairness?


title: Bayesian Additive Regression Networks

abstract: We apply Bayesian Additive Regression Tree (BART) principles to training an ensemble of small neural networks for regression tasks. Using Markov Chain Monte Carlo, we sample from the posterior distribution of neural networks that have a single hidden layer. To create an ensemble of these, we apply Gibbs sampling to update each network against the residual target value (i.e. subtracting the effect of the other networks). We demonstrate the effectiveness of this technique on several benchmark regression problems, comparing it to equivalent shallow neural networks, BART, and ordinary least squares. Our Bayesian Additive Regression Networks (BARN) provide more consistent and often more accurate results. On test data benchmarks, BARN averaged between 5 to 20 percent lower root mean square error. This error performance does come at the cost, however, of greater computation time. BARN sometimes takes on the order of a minute where competing methods take a second or less. But, BARN without cross-validated hyperparameter tuning takes about the same amount of computation time as tuned other methods. Yet BARN is still typically more accurate.


title: Petersson norms of Borcherds theta lifts to O(1, 8n+1) with applications to injectivity and sup-norm bounds

abstract: We give an explicit formula for the Petersson norms of theta lifts from Maass cusp forms of level one to cusp forms on orthogonal groups O(1,8n+1). Our formula explicitly determines archimedean local factors of the norms. As an application, we obtain the injectivity of the lifting of Maass forms and bounds on the sup-norm of cusp forms on these orthogonal groups in terms of their Laplace eigenvalues.


title: A comprehensive liver CT landmark pair dataset for evaluating deformable image registration algorithms

abstract: Purpose: Evaluating deformable image registration (DIR) algorithms is vital for enhancing algorithm performance and gaining clinical acceptance. However, there's a notable lack of dependable DIR benchmark datasets for assessing DIR performance except for lung images. To address this gap, we aim to introduce our comprehensive liver computed tomography (CT) DIR landmark dataset library. Acquisition and Validation Methods: Thirty CT liver image pairs were acquired from several publicly available image archives as well as authors' institutions under institutional review board approval. The images were processed with a semi-automatic procedure to generate landmark pairs: 1) for each case, liver vessels were automatically segmented on one image; 2) landmarks were automatically detected at vessel bifurcations; 3) corresponding landmarks in the second image were placed using the deformable image registration method; 4) manual validation was applied to reject outliers and confirm the landmarks' positional accuracy. This workflow resulted in an average of ~68 landmark pairs per image pair, in a total of 2028 landmarks for all 30 cases. The general landmarking accuracy of this procedure was evaluated using digital phantoms. Estimates of the mean and standard deviation of landmark pair target registration errors (TRE) on digital phantoms were 0.64 and 0.40 mm. 99% of landmark pairs had TREs below 2 mm. Data Format and Usage Notes: All data are publicly available at Zenodo. Instructions for using our data and MATLAB code can be found on our GitHub page. Potential Applications: The landmark dataset generated in this work is the first collection of large-scale liver CT DIR landmarks prepared on real patient images. This dataset can provide researchers with a dense set of ground truth benchmarks for the quantitative evaluation of DIR algorithms within the liver.


title: Optimisation models for the design of multiple self-consumption loops in semi-rural areas

abstract: Collective electricity self-consumption gains increasing interest in a context where localised consumption of energy is a lever of sustainable development. While easing energy distribution networks, collective self-consumption requires complementary prosumers' profiles. Before determining the proper energy exchanges happening between these prosumers, one must ensure their compatibility in the context of collective self-consumption. Motivated by real use cases from a solar power producer, this article proposes network flow-based linear models to solve both the design aspect of the problem and the attribution of distribution flows between the involved prosumers. Two main models are proposed, handling (i) single collective self-consumption loop creation and (ii) multiple loop creation. One of the objectives of this work is to provide models that can be applied at a strategic level which implies their extension to large time scale and large spatial scale. To do so, associated Benders and Dantzig-Wolfe decompositions are proposed to ensure model scalability along temporal and spatial dimensions. The proposed models are tested on realistic use cases to assess their performances.


title: Physics-Informed Machine Learning for Battery Degradation Diagnostics: A Comparison of State-of-the-Art Methods

abstract: Monitoring the health of lithium-ion batteries' internal components as they age is crucial for optimizing cell design and usage control strategies. However, quantifying component-level degradation typically involves aging many cells and destructively analyzing them throughout the aging test, limiting the scope of quantifiable degradation to the test conditions and duration. Fortunately, recent advances in physics-informed machine learning (PIML) for modeling and predicting the battery state of health demonstrate the feasibility of building models to predict the long-term degradation of a lithium-ion battery cell's major components using only short-term aging test data by leveraging physics. In this paper, we present four approaches for building physics-informed machine learning models and comprehensively compare them, considering accuracy, complexity, ease-of-implementation, and their ability to extrapolate to untested conditions. We delve into the details of each physics-informed machine learning method, providing insights specific to implementing them on small battery aging datasets. Our study utilizes long-term cycle aging data from 24 implantable-grade lithium-ion cells subjected to varying temperatures and C-rates over four years. This paper aims to facilitate the selection of an appropriate physics-informed machine learning method for predicting long-term degradation in lithium-ion batteries, using short-term aging data while also providing insights about when to choose which method for general predictive purposes.


title: PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videos

abstract: While current methods have shown promising progress on estimating 3D human motion from monocular videos, their motion estimates are often physically unrealistic because they mainly consider kinematics. In this paper, we introduce Physics-aware Pretrained Transformer (PhysPT), which improves kinematics-based motion estimates and infers motion forces. PhysPT exploits a Transformer encoder-decoder backbone to effectively learn human dynamics in a self-supervised manner. Moreover, it incorporates physics principles governing human motion. Specifically, we build a physics-based body representation and contact force model. We leverage them to impose novel physics-inspired training losses (i.e., force loss, contact loss, and Euler-Lagrange loss), enabling PhysPT to capture physical properties of the human body and the forces it experiences. Experiments demonstrate that, once trained, PhysPT can be directly applied to kinematics-based estimates to significantly enhance their physical plausibility and generate favourable motion forces. Furthermore, we show that these physically meaningful quantities translate into improved accuracy of an important downstream task: human action recognition.


title: Contact-based molecular dynamics of structured and disordered proteins in a coarse-grained model: fixed contacts, switchable contacts and those described by pseudo-improper-dihedral angles

abstract: We present a coarse-grained C$\alpha$-based protein model that can be used to simulate structured, intrinsically disordered and partially disordered proteins. We use a Go-like potential for the structured parts and two different variants of a transferable potential for the disordered parts. The first variant uses dynamic structure-based (DSB) contacts that form and disappear quasi-adiabatically during the simulation. By using specific structural criteria we distinguish sidechain-sidechain, sidechain-backbone and backbone-backbone contacts. The second variant is a non-radial multi-body pseudo-improper-dihedral (PID) potential that does not include time-dependent terms but requires more computational resources. Our model can simulate in reasonable time thousands of residues on millisecond time scales.


title: Size Ramsey numbers of small graphs versus fans or paths

abstract: For two graphs $G_1$ and $G_2$, the size Ramsey number $\hat{r}(G_1,G_2)$ is the smallest positive integer $m$ for which there exists a graph $G$ of size $m$ such that for any red-blue edge-coloring of the graph $G$, $G$ contains either a red subgraph isomorphic to $G_1$, or a blue subgraph isomorphic to $G_2$. Let $P_n$ be a path with $n$ vertices, $nK_2$ a matching with $n$ edges, and $F_n$ a graph with $n$ triangles sharing exactly one vertex. If $G_1$ is a small fixed graph and $G_2$ denotes any graph from a graph class, one can sometimes completely determine $\hat{r}(G_1,G_2)$. Faudree and Sheehan confirmed all size Ramsey numbers of $P_3$ versus complete graphs in 1983. The next year Erd\H{o}s and Faudree confirmed that of $2K_2$ versus complete graphs and complete bipartite graphs. We obtain three more Ramsey results of this type. For $n\ge 3$, we prove that $\hat{r}(P_3,F_n)=4n+4$ if $n$ is odd, and $\hat{r}(P_3,F_n)=4n+5$ if $n$ is even. This result refutes a conjecture proposed by Baskoro et al. We also show that $\hat{r}(2K_2,F_2)=12$ and $\hat{r}(2K_2,F_n)=5n+3$ for $n\ge 3$. In addition, we prove that $\hat{r}(2K_2,nP_m)=\min\{nm+1, (n+1)(m-1)\}$. This result verifies a conjecture posed by Vito and Silaban.


title: Dalton's law of partial optical thermodynamic pressures in highly multimoded nonlinear photonic systems

abstract: We show that in highly multimoded nonlinear photonic systems, the optical thermodynamic pressures emerging from different species of the optical field obey Dalton's law of partial pressures. In multimode settings, the optical thermodynamic pressure is defined as the conjugate to the extensive variable associated with the system's total number of modes and is directly related to the actual electrodynamic radiation forces exerted at the physical boundaries of the system. Here, we extend this notion to photonic configuration supporting different species of the optical field. Under thermal equilibrium conditions, we formally derive an equation that establishes a direct link between the partial thermodynamic pressures and the electrodynamic radiation pressures exerted by each polarization species. Our theoretical framework provides a straightforward approach for quantifying the total radiation pressures through the system's thermodynamics variables without invoking the Maxwell stress tensor formalism. In essence, we show that the total electrodynamic pressure in such arrangements can be obtained in an effortless manner from initial excitation conditions, thus avoiding time-consuming simulations of the utterly complex multimode dynamics. To illustrate the validity of our results, we carry out numerical simulations in multimoded nonlinear optical structures supporting two polarization species and demonstrate excellent agreement with the Maxwell stress tensor method.


title: Robust Few-Shot Ensemble Learning with Focal Diversity-Based Pruning

abstract: This paper presents FusionShot, a focal diversity optimized few-shot ensemble learning approach for boosting the robustness and generalization performance of pre-trained few-shot models. The paper makes three original contributions. First, we explore the unique characteristics of few-shot learning to ensemble multiple few-shot (FS) models by creating three alternative fusion channels. Second, we introduce the concept of focal error diversity to learn the most efficient ensemble teaming strategy, rather than assuming that an ensemble of a larger number of base models will outperform those sub-ensembles of smaller size. We develop a focal-diversity ensemble pruning method to effectively prune out the candidate ensembles with low ensemble error diversity and recommend top-$K$ FS ensembles with the highest focal error diversity. Finally, we capture the complex non-linear patterns of ensemble few-shot predictions by designing the learn-to-combine algorithm, which can learn the diverse weight assignments for robust ensemble fusion over different member models. Extensive experiments on representative few-shot benchmarks show that the top-K ensembles recommended by FusionShot can outperform the representative SOTA few-shot models on novel tasks (different distributions and unknown at training), and can prevail over existing few-shot learners in both cross-domain settings and adversarial settings. For reproducibility purposes, FusionShot trained models, results, and code are made available at https://github.com/sftekin/fusionshot


title: The Stellar Content of the Young Open Cluster Berkeley 50 (IC 1310)

abstract: We observed the Galactic open cluster Berkeley 50 in order to determine its stellar content, distance, and age. We obtained UBV photometry of 1145 stars in a 12.3' $\times$ 12.3' field, and used Gaia proper motions and parallaxes to identify 64 members, of which we obtained spectra of the 17 brightest members. The majority of the observed population we classified as B dwarfs, with the exception of a newly identified red supergiant star, which our spectroscopy shows has a B-type companion. Our study establishes the distance as 3.8 kpc, with an average color-excess $E(B-V)=0.9$. Comparison of the physical properties of the cluster with the Geneva evolutionary tracks places the age of the cluster as 50-60 Myr, with its most massive members being $\sim7M_\odot$.


title: AI Knowledge and Reasoning: Emulating Expert Creativity in Scientific Research

abstract: We investigate whether modern AI can emulate expert creativity in complex scientific endeavors. We introduce novel methodology that utilizes original research articles published after the AI's training cutoff, ensuring no prior exposure, mitigating concerns of rote memorization and prior training. The AI are tasked with redacting findings, predicting outcomes from redacted research, and assessing prediction accuracy against reported results. Analysis on 589 published studies in four leading psychology journals over a 28-month period, showcase the AI's proficiency in understanding specialized research, deductive reasoning, and evaluating evidentiary alignment--cognitive hallmarks of human subject matter expertise and creativity. These findings suggest the potential of general-purpose AI to transform academia, with roles requiring knowledge-based creativity become increasingly susceptible to technological substitution.


title: Constraining free-free emission and photoevaporative mass loss rates for known proplyds and new VLA-identified candidate proplyds in NGC 1977

abstract: We present Karl G. Jansky Very Large Array observations covering the NGC 1977 region at 3.0, 6.4, and 15.0 GHz. We search for compact radio sources and detect continuum emission from 34 NGC 1977 cluster members and 37 background objects. Of the 34 radio-detected cluster members, 3 are associated with known proplyds in NGC 1977, 22 are associated with additional young stellar objects in NGC 1977, and 9 are newly-identified cluster members. We examine the radio spectral energy distributions, circular polarization, and variability of the detected NGC 1977 sources, and identify 10 new candidate proplyds whose radio fluxes are dominated by optically thin free-free emission. We use measurements of free-free emission to calculate the mass-loss rates of known proplyds and new candidate proplyds in NGC 1977, and find values $\sim10^{-9}-10^{-8}$ M$_{\odot}$ yr$^{-1}$, which are lower than the mass-loss rates measured towards proplyds in the Orion Nebula Cluster, but consistent with the mass-loss rates predicted by external photoevaporation models for spatially-extended disks that are irradiated by the typical external UV fields encountered in NGC 1977. Finally, we show that photoevaporative disk winds in NGC 1977 may be illuminated by internal or external sources of ionization, depending on their positions within the cluster. This study provides new constraints on disk properties in a clustered star-forming region with a weaker UV environment than the Orion Nebula Cluster, but a stronger UV environment than low-mass star-forming regions like Taurus. Such intermediate UV environments represent the typical conditions of Galactic star and planet formation.


title: Stable Blockchain Sharding under Adversarial Transaction Generation

abstract: Sharding is used to improve the scalability and performance of blockchain systems. We investigate the stability of blockchain sharding, where transactions are continuously generated by an adversarial model. The system consists of $n$ processing nodes that are divided into $s$ shards. Following the paradigm of classical adversarial queuing theory, transactions are continuously received at injection rate $\rho \leq 1$ and burstiness $b > 0$. We give an absolute upper bound $\max\{ \frac{2}{k+1}, \frac{2}{ \left\lfloor\sqrt{2s}\right\rfloor}\}$ on the maximum injection rate for which any scheduler could guarantee bounded queues and latency of transactions, where $k$ is the number of shards that each transaction accesses. We next give a basic distributed scheduling algorithm for uniform systems where shards are equally close to each other. To guarantee stability, the injection rate is limited to $\rho \leq \max\{ \frac{1}{18k}, \frac{1}{\lceil 18 \sqrt{s} \rceil} \}$. We then provide a fully distributed scheduling algorithm for non-uniform systems where shards are arbitrarily far from each other. By using a hierarchical clustering of the shards, stability is guaranteed with injection rate $\rho \leq \frac{1}{c_1d \log^2 s} \cdot \max\{ \frac{1}{k}, \frac{1}{\sqrt{s}} \}$, where $d$ is the worst distance of any transaction to the shards it will access, and $c_1$ is some positive constant. We also conduct simulations to evaluate the algorithms and measure the average queue sizes and latency throughout the system. To our knowledge, this is the first adversarial stability analysis of sharded blockchain systems.


title: Rethinking Non-Negative Matrix Factorization with Implicit Neural Representations

abstract: Non-negative Matrix Factorization (NMF) is a powerful technique for analyzing regularly-sampled data, i.e., data that can be stored in a matrix. For audio, this has led to numerous applications using time-frequency (TF) representations like the Short-Time Fourier Transform. However extending these applications to irregularly-spaced TF representations, like the Constant-Q transform, wavelets, or sinusoidal analysis models, has not been possible since these representations cannot be directly stored in matrix form. In this paper, we formulate NMF in terms of continuous functions (instead of fixed vectors) and show that NMF can be extended to a wider variety of signal classes that need not be regularly sampled.


title: Magnetoroton in a two-dimensional Bose-Bose mixture

abstract: We extend our theory of slow magnons in a two-component Bose-Einstein condensate to the case of two spatial dimensions (2D). We provide a detailed discussion of polaronic corrections to the magnon branch of the elementary excitation spectrum in a weakly- and strongly-interacting regimes. In a dilute system, the latter may be achieved by adjusting inter-species attraction such as to obtain a resonance in the $p$-wave scattering channel. Resonantly enhanced $p$-wave attraction results in the self-localization of magnons and formation of a magnetoroton. The nature of a ground state beyond the magnetoroton instability remains to be explored. We suggest a dilute p-wave crystal of alternating polarization as a possible candidate. In contrast to three dimensions (3D), the required strength of the attractive potential in the $s$-wave channel here corresponds to tight binding, and we suggest a potential realization of our model with excitons in 2D semiconductors.


title: Evaluation of Programming Models and Performance for Stencil Computation on Current GPU Architectures

abstract: Accelerated computing is widely used in high-performance computing. Therefore, it is crucial to experiment and discover how to better utilize GPUGPUs latest generations on relevant applications. In this paper, we present results and share insights about highly tuned stencil-based kernels for NVIDIA Ampere (A100) and Hopper (GH200) architectures. Performance results yield useful insights into the behavior of this type of algorithms for these new accelerators. This knowledge can be leveraged by many scientific applications which involve stencils computations. Further, evaluation of three different programming models: CUDA, OpenACC, and OpenMP target offloading is conducted on aforementioned accelerators. We extensively study the performance and portability of various kernels under each programming model and provide corresponding optimization recommendations. Furthermore, we compare the performance of different programming models on the mentioned architectures. Up to 58% performance improvement was achieved against the previous GPGPU's architecture generation for an highly optimized kernel of the same class, and up to 42% for all classes. In terms of programming models, and keeping portability in mind, optimized OpenACC implementation outperforms OpenMP implementation by 33%. If portability is not a factor, our best tuned CUDA implementation outperforms the optimized OpenACC one by 2.1x.


title: Exploring Autonomous Agents through the Lens of Large Language Models: A Review

abstract: Large Language Models (LLMs) are transforming artificial intelligence, enabling autonomous agents to perform diverse tasks across various domains. These agents, proficient in human-like text comprehension and generation, have the potential to revolutionize sectors from customer service to healthcare. However, they face challenges such as multimodality, human value alignment, hallucinations, and evaluation. Techniques like prompting, reasoning, tool utilization, and in-context learning are being explored to enhance their capabilities. Evaluation platforms like AgentBench, WebArena, and ToolLLM provide robust methods for assessing these agents in complex scenarios. These advancements are leading to the development of more resilient and capable autonomous agents, anticipated to become integral in our digital lives, assisting in tasks from email responses to disease diagnosis. The future of AI, with LLMs at the forefront, is promising.


title: A Novel Terabit Grid-of-Beam Optical Wireless Multi-User Access Network With Beam Clustering

abstract: In this paper, we put forward a proof of concept for sixth generation (6G) Terabit infrared (IR) laser-based indoor optical wireless networks. We propose a novel double-tier access point (AP) architecture based on an array of arrays of vertical cavity surface emitting lasers (VCSELs) to provide a seamless grid-of-beam coverage with multi-Gb/s per beam. We present systematic design and thorough analytical modeling of the AP architecture, which are then applied to downlink system modeling using non-imaging angle diversity receivers (ADRs). We propose static beam clustering with coordinated multi-beam joint transmission (CoMB-JT) for network interference management and devise various clustering strategies to address inter-beam interference (IBI) and inter-cluster interference (ICI). Non-orthogonal multiple access (NOMA) and orthogonal frequency division multiple access (OFDMA) schemes are also adopted to handle intra-cluster interference, and the resulting signal-to-interference-plus-noise ratio (SINR) and achievable data rate are derived. The network performance is studied in terms of spatial distributions and statistics of the downlink SINR and data rate through extensive computer simulations. The results demonstrate that data rates up to 15 Gb/s are achieved within the coverage area and a properly devised clustering strikes a balance between the sum rate and fairness depending on the number of users.


title: HIV Client Perspectives on Digital Health in Malawi

abstract: eHealth has strong potential to advance HIV care in low- and middle-income countries. Given the sensitivity of HIV-related information and the risks associated with unintended HIV status disclosure, clients' privacy perceptions towards eHealth applications should be examined to develop client-centered technologies. Through focus group discussions with antiretroviral therapy (ART) clients from Lighthouse Trust, Malawi's public HIV care program, we explored perceptions of data security and privacy, including their understanding of data flow and their concerns about data confidentiality across several layers of data use. Our findings highlight the broad privacy concerns that affect ART clients' day-to-day choices, clients' trust in Malawi's health system, and their acceptance of, and familiarity with, point-of-care technologies used in HIV care. Based on our findings, we provide recommendations for building robust digital health systems in low- and middle-income countries with limited resources, nascent privacy regulations, and political will to take action to protect client data.


title: Towards Realistic Few-Shot Relation Extraction: A New Meta Dataset and Evaluation

abstract: We introduce a meta dataset for few-shot relation extraction, which includes two datasets derived from existing supervised relation extraction datasets NYT29 (Takanobu et al., 2019; Nayak and Ng, 2020) and WIKIDATA (Sorokin and Gurevych, 2017) as well as a few-shot form of the TACRED dataset (Sabo et al., 2021). Importantly, all these few-shot datasets were generated under realistic assumptions such as: the test relations are different from any relations a model might have seen before, limited training data, and a preponderance of candidate relation mentions that do not correspond to any of the relations of interest. Using this large resource, we conduct a comprehensive evaluation of six recent few-shot relation extraction methods, and observe that no method comes out as a clear winner. Further, the overall performance on this task is low, indicating substantial need for future research. We release all versions of the data, i.e., both supervised and few-shot, for future research.


title: Bounding Causal Effects with Leaky Instruments

abstract: Instrumental variables (IVs) are a popular and powerful tool for estimating causal effects in the presence of unobserved confounding. However, classical approaches rely on strong assumptions such as the $\textit{exclusion criterion}$, which states that instrumental effects must be entirely mediated by treatments. This assumption often fails in practice. When IV methods are improperly applied to data that do not meet the exclusion criterion, estimated causal effects may be badly biased. In this work, we propose a novel solution that provides $\textit{partial}$ identification in linear systems given a set of $\textit{leaky instruments}$, which are allowed to violate the exclusion criterion to some limited degree. We derive a convex optimization objective that provides provably sharp bounds on the average treatment effect under some common forms of information leakage, and implement inference procedures to quantify the uncertainty of resulting estimates. We demonstrate our method in a set of experiments with simulated data, where it performs favorably against the state of the art. An accompanying $\texttt{R}$ package, $\texttt{leakyIV}$, is available from $\texttt{CRAN}$.


title: Quasinormal modes of a nonsingular spherically symmetric black hole effective model with holonomy corrections

abstract: We calculate the quasinormal modes of a nonsingular spherically symmetric black hole effective model with holonomy corrections. The model is based on quantum corrections inspired by loop quantum gravity. It is covariant and results in a spacetime that is regular everywhere with a parameter-dependent black bounce. Perturbations of these black holes due to massless scalar and electromagnetic fields have been previously calculated and some intriguing results were observed. For some modes, the frequency versus minimum-radius parameter trajectories were found to spiral and self-intersect in the complex plane. In addition, the spectrum of overtones has real frequencies that oscillate with increasing overtone number, and may even vanishing for some overtones. We have calculated the quasinormal modes for all massless spin perturbations, including spin-1/2, and axial- and polar-gravitational. We find that the trajectory-spirals are restricted to scalar perturbations and observe some interesting overtone behaviour for gravitational perturbations. The amount of isospectrality violation in the gravitational quasinormal mode spectra is also examined.


title: Optimal pinwheel partitions and pinwheel solutions to a nonlinear Schr\"odinger system

abstract: We establish the existence of a solution to a nonlinear competitive Schr\"odinger system whose scalar potential tends to a positive constant at infinity with an appropriate rate. This solution has the property that all components are invariant under the action of a group of linear isometries and each component is obtained from the previous one by composing it with some fixed linear isometry. We call it a pinwheel solution. We describe the asymptotic behavior of the least energy pinwheel solutions when the competing parameter tends to zero and to minus infinity. In the latter case the components are segregated and give rise to an optimal pinwheel partition for the Schr\"odinger equation, that is, a partition formed by invariant sets that are mutually isometric through a fixed isometry.


title: Self-referencing photothermal common-path interferometry to measure absorption of Si3N4 membranes for laser-light sails

abstract: Laser-light sails are a spacecraft concept wherein lightweight "sails" are propelled to high speeds by lasers with high intensities. The sails must comprise materials with low optical loss, to minimize the risk of laser damage. Stoichiometric silicon nitride (Si$_3$N$_4$) is a candidate material with low loss in the near infrared, but the precise absorption coefficient has not been characterized in the membrane form-factor needed for sails. We use photothermal common-path interferometry (PCI), a sensitive pump-probe technique, to measure the absorption coefficient of stoichiometric and nonstoichiometric silicon nitride. To calibrate PCI measurements of membranes, we developed a self-referencing technique where a measurement is performed twice: once on a bare membrane, and a second time with a monolayer of graphene deposited on the membrane. The absorption of the sample with graphene can be measured by both PCI and more-conventional spectroscopic techniques, enabling the calibration of the PCI measurement. We find that with an absorption coefficient of (2.09 $\pm$ 0.76) $\times$ 10$^{-2}$ cm$^{-1}$ at 1064 nm, Si$_3$N$_4$ is a suitable laser-sail material for laser intensities as high as ~10 GW/m$^{2}$, which have been proposed for some laser-sail missions, while silicon-rich SiN$_x$ (x~1), with an absorption coefficient of 7.94 $\pm$ 0.50 cm$^{-1}$, is unlikely to survive such high laser intensities.

categories: physics.optics cond-mat.mtrl-sci physics.app-ph physics.space-ph


title: Quantum mechanical aspects of coherent photoproduction: the limits of coherence, and multiple vector mesons

abstract: Quantum mechanics is central to coherent photoproduction in ultra-peripheral collisions (UPCs). This writeup will discuss some surprising aspects of UPCs that stem from these quantum mechanical roots. The Good-Walker (GW) paradigm, which connects coherent photoproduction with the target nucleus remaining in its ground state. This contrasts with a semi-classical picture, where coherence depends on the positions of the individual nucleons and the momentum transfer. Unlike the GW approach, the semiclassical picture is consistent with the observed data on coherent photoproduction with nuclear breakup, and with coherent photoproduction in peripheral collisions. The semiclassical approach allows for a wider variety of coherent UPC reactions, such as coherent photoproduction of charged mesons, including some non $q\overline q$ exotica. Quantum mechanics is also key to the coherent photoproduction of multiple vector mesons by the interactions of a single ion pair. The vector mesons share a common impact parameter, and so can exhibit richer interference patterns than single mesons. At forward rapidities, the cross sections to produce multiple identical vector mesons are enhanced due to superradiance. With enough statistics, multi-meson events may provide an opportunity to observe stimulated decays.}


title: Simulation of Gas Mixture Dynamics in a Pipeline Network using Explicit Staggered-Grid Discretization

abstract: We develop an explicit second order staggered finite difference discretization scheme for simulating the transport of highly heterogeneous gas mixtures through pipeline networks. This study is motivated by the proposed blending of hydrogen into natural gas pipelines to reduce end use carbon emissions while using existing pipeline systems throughout their planned lifetimes. Our computational method accommodates an arbitrary number of constituent gases with very different physical properties that may be injected into a network with significant spatiotemporal variation. In this setting, the gas flow physics are highly location- and time- dependent, so that local composition and nodal mixing must be accounted for. The resulting conservation laws are formulated in terms of pressure, partial densities and flows, and volumetric and mass fractions of the constituents. We include non-ideal equations of state that employ linear approximations of gas compressibility factors, so that the pressure dynamics propagate locally according to a variable wave speed that depends on mixture composition and density. We derive compatibility relationships for network edge domain boundary values that are significantly more complex than in the case of a homogeneous gas. The simulation method is evaluated on initial boundary value problems for a single pipe and a small network, is cross-validated with a lumped element simulation, and used to demonstrate a local monitoring and control policy for maintaining allowable concentration levels.


title: Vision Transformers in Domain Adaptation and Generalization: A Study of Robustness

abstract: Deep learning models are often evaluated in scenarios where the data distribution is different from those used in the training and validation phases. The discrepancy presents a challenge for accurately predicting the performance of models once deployed on the target distribution. Domain adaptation and generalization are widely recognized as effective strategies for addressing such shifts, thereby ensuring reliable performance. The recent promising results in applying vision transformers in computer vision tasks, coupled with advancements in self-attention mechanisms, have demonstrated their significant potential for robustness and generalization in handling distribution shifts. Motivated by the increased interest from the research community, our paper investigates the deployment of vision transformers in domain adaptation and domain generalization scenarios. For domain adaptation methods, we categorize research into feature-level, instance-level, model-level adaptations, and hybrid approaches, along with other categorizations with respect to diverse strategies for enhancing domain adaptation. Similarly, for domain generalization, we categorize research into multi-domain learning, meta-learning, regularization techniques, and data augmentation strategies. We further classify diverse strategies in research, underscoring the various approaches researchers have taken to address distribution shifts by integrating vision transformers. The inclusion of comprehensive tables summarizing these categories is a distinct feature of our work, offering valuable insights for researchers. These findings highlight the versatility of vision transformers in managing distribution shifts, crucial for real-world applications, especially in critical safety and decision-making scenarios.


title: With or without $\nu$? Hunting for the seed of the matter-antimatter asymmetry

abstract: The matter-antimatter asymmetry underlines the incompleteness of the current understanding of particle physics. Neutrinoless double-beta ($0\nu \beta\beta$) decay may help explain this asymmetry, while unveiling the Majorana nature of the neutrino. The CUORE experiment searches for $0\nu \beta\beta$ decay of $^{130}$Te using a tonne-scale cryogenic calorimeter operated at milli-kelvin temperatures. We report no evidence for $0\nu \beta\beta$ decay and place a lower limit on the half-life of T$_{1/2}$ $>$ 3.8 $\times$ 10$^{25}$ years (90% C.I.) with over 2 tonne$\cdot$year TeO$_2$ exposure. The tools and techniques developed for this result and the 5 year stable operation of nearly 1000 detectors demonstrate the infrastructure for a next-generation experiment capable of searching for $0\nu \beta\beta$ decay across multiple isotopes.


title: Implicit Bias of AdamW: $\ell_\infty$ Norm Constrained Optimization

abstract: Adam with decoupled weight decay, also known as AdamW, is widely acclaimed for its superior performance in language modeling tasks, surpassing Adam with $\ell_2$ regularization in terms of generalization and optimization. However, this advantage is not theoretically well-understood. One challenge here is that though intuitively Adam with $\ell_2$ regularization optimizes the $\ell_2$ regularized loss, it is not clear if AdamW optimizes a specific objective. In this work, we make progress toward understanding the benefit of AdamW by showing that it implicitly performs constrained optimization. More concretely, we show in the full-batch setting, if AdamW converges with any non-increasing learning rate schedule whose partial sum diverges, it must converge to a KKT point of the original loss under the constraint that the $\ell_\infty$ norm of the parameter is bounded by the inverse of the weight decay factor. This result is built on the observation that Adam can be viewed as a smoothed version of SignGD, which is the normalized steepest descent with respect to $\ell_\infty$ norm, and a surprising connection between normalized steepest descent with weight decay and Frank-Wolfe.


title: Tomographic reconstruction of a disease transmission landscape via GPS recorded random paths

abstract: Identifying areas in a landscape where individuals have higher probability of becoming infected with a pathogen is a crucial step towards disease management. We perform a novel epidemiological tomography for the estimation of landscape propensity to disease infection, using GPS animal tracks in a manner analogous to tomographic techniques in Positron Emission Tomography. Our study data consists of individual tracks of white-tailed deer (Odocoileus virginianus) and three exotic Cervidae species moving freely in a high-fenced game preserve over given time periods. A serological test was performed on each individual to measure antibody concentration of epizootic hemorrhagic disease viruses (EHDV) at the beginning and at the end of each tracking period. EHDV is a vector-borne viral disease indirectly transmitted between ruminant hosts by biting midges. We model the data as a binomial linear inverse problem, where spatial coherence is enforced with a total variation regularization. The smoothness of the reconstructed propensity map is selected by the quantile universal threshold, which can also test the null hypothesis that the propensity map is spatially constant. We apply our method to simulated and real data, showing good statistical properties during simulations and consistent results and interpretations compared to intensive field estimations.


title: Beyond the Known: Adversarial Autoencoders in Novelty Detection

abstract: In novelty detection, the goal is to decide if a new data point should be categorized as an inlier or an outlier, given a training dataset that primarily captures the inlier distribution. Recent approaches typically use deep encoder and decoder network frameworks to derive a reconstruction error, and employ this error either to determine a novelty score, or as the basis for a one-class classifier. In this research, we use a similar framework but with a lightweight deep network, and we adopt a probabilistic score with reconstruction error. Our methodology calculates the probability of whether the sample comes from the inlier distribution or not. This work makes two key contributions. The first is that we compute the novelty probability by linearizing the manifold that holds the structure of the inlier distribution. This allows us to interpret how the probability is distributed and can be determined in relation to the local coordinates of the manifold tangent space. The second contribution is that we improve the training protocol for the network. Our results indicate that our approach is effective at learning the target class, and it outperforms recent state-of-the-art methods on several benchmark datasets.


title: The Homological Spectrum and Nilpotence Theorems for Lie Superalgebra Representations

abstract: Balmer recently showed that there is a general notion of a nilpotence theorem for tensor triangulated categories through the use of homological residue fields and the connection with the homological spectrum. The homological spectrum (like the theory of $\pi$-points) can be viewed as a topological space that provides an important realization of the Balmer spectrum. Let ${\mathfrak g}={\mathfrak g}_{\bar{0}}\oplus {\mathfrak g}_{\bar{1}}$ be a classical Lie superalgebra over ${\mathbb C}$. In this paper, the authors consider the tensor triangular geometry for the stable category of finite-dimensional Lie superalgebra representations: $\text{stab}({\mathcal F}_{({\mathfrak g},{\mathfrak g}_{\bar{0}})})$, The localizing subcategories for the detecting subalgebra ${\mathfrak f}$ are classified which answers a question of Boe, Kujawa, and Nakano. As a consequence of these results, the authors prove a nilpotence theorem and determine the homological spectrum for the stable module category of ${\mathcal F}_{({\mathfrak f},{\mathfrak f}_{\bar{0}})}$. The authors verify Balmer's ``Nerves of Steel'' Conjecture for ${\mathcal F}_{({\mathfrak f},{\mathfrak f}_{\bar{0}})}$. Let $F$ (resp. $G$) be the associated supergroup (scheme) for ${\mathfrak f}$ (resp. ${\mathfrak g}$). Under the condition that $F$ is a splitting subgroup for $G$, the results for the detecting subalgebra can be used to prove a nilpotence theorem for $\text{stab}({\mathcal F}_{({\mathfrak g},{\mathfrak g}_{\bar{0}})})$, and to determine the homological spectrum in this case. Now using natural assumptions in terms of realization of supports, the authors provide a method to explicitly realize the Balmer spectrum of $\text{stab}({\mathcal F}_{({\mathfrak g},{\mathfrak g}_{\bar{0}})})$, and prove the Nerves of Steel Conjecture in this case.


title: JRDB-Social: A Multifaceted Robotic Dataset for Understanding of Context and Dynamics of Human Interactions Within Social Groups

abstract: Understanding human social behaviour is crucial in computer vision and robotics. Micro-level observations like individual actions fall short, necessitating a comprehensive approach that considers individual behaviour, intra-group dynamics, and social group levels for a thorough understanding. To address dataset limitations, this paper introduces JRDB-Social, an extension of JRDB. Designed to fill gaps in human understanding across diverse indoor and outdoor social contexts, JRDB-Social provides annotations at three levels: individual attributes, intra-group interactions, and social group context. This dataset aims to enhance our grasp of human social dynamics for robotic applications. Utilizing the recent cutting-edge multi-modal large language models, we evaluated our benchmark to explore their capacity to decipher social human behaviour.


title: Spin-charge-lattice coupling across the charge density wave transition in a Kagome lattice antiferromagnet

abstract: Understanding spin and lattice excitations in a metallic magnetic ordered system form the basis to unveil the magnetic and lattice exchange couplings and their interactions with itinerant electrons. Kagome lattice antiferromagnet FeGe is interesting because it displays rare charge density wave (CDW) deep inside the antiferromagnetic ordered phase that interacts with the magnetic order. We use neutron scattering to study the evolution of spin and lattice excitations across the CDW transition $T_{\rm CDW}$ in FeGe. While spin excitations below $\sim$100 meV can be well described by spin waves of a spin-1 Heisenberg Hamiltonian, spin excitations at higher energies are centered around the Brillouin zone boundary and extend up to $\sim180$ meV consistent with quasiparticle excitations across spin-polarized electron-hole Fermi surfaces. Furthermore, $c$-axis spin wave dispersion and Fe-Ge optical phonon modes show a clear hardening below $T_{\rm CDW}$ due to spin-charge-lattice coupling but with no evidence for a phonon Kohn anomaly. By comparing our experimental results with density functional theory calculations in absolute units, we conclude that FeGe is a Hund's metal in the intermediate correlated regime where magnetism has contributions from both itinerant and localized electrons arising from spin polarized electronic bands near the Fermi level.


title: Transdimensional inference for gravitational-wave astronomy with Bilby

abstract: It has become increasingly useful to answer questions in gravitational-wave astronomy using transdimensional models where the number of free parameters can be varied depending on the complexity required to fit the data. Given the growing interest in transdimensional inference, we introduce a new package for the Bayesian inference Library (Bilby) called tBilby. The tBilby package allows users to set up transdimensional inference calculations using the existing Bilby architecture with off-the-shelf nested samplers and/or Markov Chain Monte Carlo algorithms. Transdimensional models are particularly helpful when we seek to test theoretically uncertain predictions described by phenomenological models. For example, bursts of gravitational waves can be modelled using a superposition of N wavelets where N is itself a free parameter. Short pulses are modelled with small values of N whereas longer, more complicated signals are represented with a large number of wavelets stitched together. Other transdimensional models have found use describing instrumental noise and the population properties of gravitational-wave sources. We provide a few demonstrations of tBilby, including fitting the gravitational-wave signal GW150914 with a superposition of N sine-Gaussian wavelets. We outline our plans to further develop the tbilby code suite for a broader range of transdimensional problems.


title: Comparison of algorithms in Foreign Exchange Rate Prediction

abstract: Foreign currency exchange plays a vital role for trading of currency in the financial market. Due to its volatile nature, prediction of foreign currency exchange is a challenging task. This paper presents different machine learning techniques like Artificial Neural Network (ANN), Recurrent Neural Network (RNN) to develop prediction model between Nepalese Rupees against three major currencies Euro, Pound Sterling and US dollar. Recurrent Neural Network is a type of neural network that have feedback connections. In this paper, prediction model were based on different RNN architectures, feed forward ANN with back propagation algorithm and then compared the accuracy of each model. Different ANN architecture models like Feed forward neural network, Simple Recurrent Neural Network (SRNN), Gated Recurrent Unit (GRU) and Long Short Term Memory (LSTM) were used. Input parameters were open, low, high and closing prices for each currency. From this study, we have found that LSTM networks provided better results than SRNN and GRU networks.


title: On the size of temporal cliques in subcritical random temporal graphs

abstract: A \emph{random temporal graph} is an Erd\H{o}s-R\'enyi random graph $G(n,p)$, together with a random ordering of its edges. A path in the graph is called \emph{increasing} if the edges on the path appear in increasing order. A set $S$ of vertices forms a \emph{temporal clique} if for all $u,v \in S$, there is an increasing path from $u$ to $v$. \cite{Becker2023} proved that if $p=c\log n/n$ for $c>1$, then, with high probability, there is a temporal clique of size $n-o(n)$. On the other hand, for $c<1$, with high probability, the largest temporal clique is of size $o(n)$. In this note we improve the latter bound by showing that, for $c<1$, the largest temporal clique is of \emph{constant} size with high probability.


title: A beam that can only bend on the Cantor set

abstract: In this work we address the following question: is it possible for a one-dimensional, linearly elastic beam to only bend on the Cantor set and, if so, what would the bending energy of such a beam look like? We answer this question by considering a sequence of beams, indexed by $n$, each one only able to bend on the set associated with the $n$-th step in the construction of the Cantor set and compute the $\Gamma$-limit of the bending energies. The resulting energy in the limit has a structure similar to the traditional bending energy, a key difference being that the measure used for the integration is the Hausdorff measure of dimension $\ln 2/\ln 3$, which is the dimension of the Cantor set.


title: Constructions of dual frames compensating for erasures with implementation

abstract: Let $I\subseteq \Bbb N$ be a finite or infinite set and let ${(x_n)_{n\in I}}$ be a frame for a separable Hilbert space $\mathcal{H}$. Consider transmission of a signal $h\in\mathcal{H}$ where a finite subset $(\langle h,x_n\rangle)_{n\in E}$ of the frame coefficients $(\langle h,x_n\rangle)_{n\in I}$ is lost. There are several approaches in the literature aiming recovery of $h$. In this paper we focus on the approach based on construction of a dual frame of the reduced frame $(x_n)_{n\in I\setminus E}$ which is then used for perfect reconstruction from the preserved frame coefficients $(\langle h,x_n\rangle)_{n\in I\setminus E}$. There are several methods for such construction, starting from the canonical dual or any other dual frame of ${(x_n)_{n\in I}}$. We implemented the algorithms for these methods and performed tests to compare their computational efficiency.


title: Aligning Diffusion Models by Optimizing Human Utility

abstract: We present Diffusion-KTO, a novel approach for aligning text-to-image diffusion models by formulating the alignment objective as the maximization of expected human utility. Since this objective applies to each generation independently, Diffusion-KTO does not require collecting costly pairwise preference data nor training a complex reward model. Instead, our objective requires simple per-image binary feedback signals, e.g. likes or dislikes, which are abundantly available. After fine-tuning using Diffusion-KTO, text-to-image diffusion models exhibit superior performance compared to existing techniques, including supervised fine-tuning and Diffusion-DPO, both in terms of human judgment and automatic evaluation metrics such as PickScore and ImageReward. Overall, Diffusion-KTO unlocks the potential of leveraging readily available per-image binary signals and broadens the applicability of aligning text-to-image diffusion models with human preferences.


title: Cybersecurity for Modern Smart Grid against Emerging Threats

abstract: Smart Grid is a power grid system that uses digital communication technologies. By deploying intelligent devices throughout the power grid infrastructure,from power generation to consumption, and enabling communication among them, it revolutionizes the modern power grid industry with increased efficiency, reliability, and availability. However, reliance on information and communication technologies has also made the smart grids exposed to new vulnerabilities and complications that may negatively impact the availability and stability of electricity services, which are vital for people's daily lives. The purpose of this monograph is to provide an up-to-date and comprehensive survey and tutorial on the cybersecurity aspect of smart grids. The book focuses on the sources of the cybersecurity issues, the taxonomy of threats, and the survey of various approaches to overcome or mitigate such threats. It covers the state-of-the-art research results in recent years, along with remaining open challenges. We hope that this monograph can be used both as learning materials for beginners who are embarking on research in this area and as a useful reference for established researchers in this field.


title: Demand Balancing in Primal-Dual Optimization for Blind Network Revenue Management

abstract: This paper proposes a practically efficient algorithm with optimal theoretical regret which solves the classical network revenue management (NRM) problem with unknown, nonparametric demand. Over a time horizon of length $T$, in each time period the retailer needs to decide prices of $N$ types of products which are produced based on $M$ types of resources with unreplenishable initial inventory. When demand is nonparametric with some mild assumptions, Miao and Wang (2021) is the first paper which proposes an algorithm with $O(\text{poly}(N,M,\ln(T))\sqrt{T})$ type of regret (in particular, $\tilde O(N^{3.5}\sqrt{T})$ plus additional high-order terms that are $o(\sqrt{T})$ with sufficiently large $T\gg N$). In this paper, we improve the previous result by proposing a primal-dual optimization algorithm which is not only more practical, but also with an improved regret of $\tilde O(N^{3.25}\sqrt{T})$ free from additional high-order terms. A key technical contribution of the proposed algorithm is the so-called demand balancing, which pairs the primal solution (i.e., the price) in each time period with another price to offset the violation of complementary slackness on resource inventory constraints. Numerical experiments compared with several benchmark algorithms further illustrate the effectiveness of our algorithm.


title: Asymptotic analysis for generalized functions using frames

abstract: This paper is a short overview of the main Abelian- and Tauberian-type results from [4, 14, 26] regarding the asymptotic analysis of different classes of generalized functions in terms of appropriate frames. The Tauberian-type results provide a comprehensive characterization of the quasiasymptotic and S-asymptotic properties of distributions.


title: Mixed-Query Transformer: A Unified Image Segmentation Architecture

abstract: Existing unified image segmentation models either employ a unified architecture across multiple tasks but use separate weights tailored to each dataset, or apply a single set of weights to multiple datasets but are limited to a single task. In this paper, we introduce the Mixed-Query Transformer (MQ-Former), a unified architecture for multi-task and multi-dataset image segmentation using a single set of weights. To enable this, we propose a mixed query strategy, which can effectively and dynamically accommodate different types of objects without heuristic designs. In addition, the unified architecture allows us to use data augmentation with synthetic masks and captions to further improve model generalization. Experiments demonstrate that MQ-Former can not only effectively handle multiple segmentation datasets and tasks compared to specialized state-of-the-art models with competitive performance, but also generalize better to open-set segmentation tasks, evidenced by over 7 points higher performance than the prior art on the open-vocabulary SeginW benchmark.


title: Sectional Category and the parametrized Borsuk-Ulam property

abstract: In this paper, for fibrations $p:E\to B$, $p':E'\to B$ over $B$ and a free involution $\tau:E\to E$ which satisfy the equality $p\circ\tau=p$, we discover a connection between the sectional category of the double covers $q:E\to E/\tau$ and $q^Y:F_{p'}(E',2)\to F_{p'}(E',2)/\mathbb{Z}_2$ from the $2$-ordered fibre-wise configuration space $F_{p'}(E',2)$ to its unordered quotient $ F_{p'}(E',2)/\mathbb{Z}_2$, and the parametrized Borsuk-Ulam property (PBUP) for the triple $\left((p,\tau);p'\right)$. Explicitly, we demonstrate that the triple $\left((p,\tau);p'\right)$ satisfies the PBUP if the sectional category of $q$ is bigger than the sectional category of $q^{p'}$. This property connects a standard problem in parametrized Borsuk-Ulam theory to current research trends in sectional category. As applictions of our results, we explore the PBUP for $E, E'$ one of the following fibrations: trivial fibration, Hopf fibration and the Fadell-Neuwirth fibration.


title: Estimation and Inference in Ultrahigh Dimensional Partially Linear Single-Index Models

abstract: This paper is concerned with estimation and inference for ultrahigh dimensional partially linear single-index models. The presence of high dimensional nuisance parameter and nuisance unknown function makes the estimation and inference problem very challenging. In this paper, we first propose a profile partial penalized least squares estimator and establish the sparsity, consistency and asymptotic representation of the proposed estimator in ultrahigh dimensional setting. We then propose an $F$-type test statistic for parameters of primary interest and show that the limiting null distribution of the test statistic is $\chi^2$ distribution, and the test statistic can detect local alternatives, which converge to the null hypothesis at the root-$n$ rate. We further propose a new test for the specification testing problem of the nonparametric function. The test statistic is shown to be asymptotically normal. Simulation studies are conducted to examine the finite sample performance of the proposed estimators and tests. A real data example is used to illustrate the proposed procedures.


title: Recovery from Adversarial Attacks in Cyber-physical Systems: Shallow, Deep and Exploratory Works

abstract: Cyber-physical systems (CPS) have experienced rapid growth in recent decades. However, like any other computer-based systems, malicious attacks evolve mutually, driving CPS to undesirable physical states and potentially causing catastrophes. Although the current state-of-the-art is well aware of this issue, the majority of researchers have not focused on CPS recovery, the procedure we defined as restoring a CPS's physical state back to a target condition under adversarial attacks. To call for attention on CPS recovery and identify existing efforts, we have surveyed a total of 30 relevant papers. We identify a major partition of the proposed recovery strategies: shallow recovery vs. deep recovery, where the former does not use a dedicated recovery controller while the latter does. Additionally, we surveyed exploratory research on topics that facilitate recovery. From these publications, we discuss the current state-of-the-art of CPS recovery, with respect to applications, attack type, attack surfaces and system dynamics. Then, we identify untouched sub-domains in this field and suggest possible future directions for researchers.


title: Unsupervised machine learning for supercooled liquids

abstract: Unraveling the relation between structural information and the dynamic properties of supercooled liquids is one of the grand challenges of physics. Dynamic heterogeneity, characterized by the propensity of particles, is often used as a proxy for the dynamic slowing down. In this work, we introduce an unsupervised machine learning approach based on a time-lagged autoencoder (TAE) to elucidate the effect of structural features on the long-time dynamic heterogeneity of supercooled liquids. The TAE uses an autoencoder to reconstruct features at time $t + \Delta t$ from input features at time $t$ for individual particles, and the resulting latent space variables are considered as order parameters. In the Kob-Andersen system, with a $\Delta t$ about a thousand times smaller than the relaxation time, the TAE order parameter exhibits a remarkable correlation with the long-time propensity. We find that radial features on all length-scales are required to capture the long-time dynamics, consistent with recent simulations. This shows that fluctuations of structural features contain sufficient information about the long-time dynamic heterogeneity.


title: RoNet: Rotation-oriented Continuous Image Translation

abstract: The generation of smooth and continuous images between domains has recently drawn much attention in image-to-image (I2I) translation. Linear relationship acts as the basic assumption in most existing approaches, while applied to different aspects including features, models or labels. However, the linear assumption is hard to conform with the element dimension increases and suffers from the limit that having to obtain both ends of the line. In this paper, we propose a novel rotation-oriented solution and model the continuous generation with an in-plane rotation over the style representation of an image, achieving a network named RoNet. A rotation module is implanted in the generation network to automatically learn the proper plane while disentangling the content and the style of an image. To encourage realistic texture, we also design a patch-based semantic style loss that learns the different styles of the similar object in different domains. We conduct experiments on forest scenes (where the complex texture makes the generation very challenging), faces, streetscapes and the iphone2dslr task. The results validate the superiority of our method in terms of visual quality and continuity.


title: Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluators

abstract: LLM-based auto-annotators have become a key component of the LLM development process due to their cost-effectiveness and scalability compared to human-based evaluation. However, these auto-annotators can introduce complex biases that are hard to remove. Even simple, known confounders such as preference for longer outputs remain in existing automated evaluation metrics. We propose a simple regression analysis approach for controlling biases in auto-evaluations. As a real case study, we focus on reducing the length bias of AlpacaEval, a fast and affordable benchmark for chat LLMs that uses LLMs to estimate response quality. Despite being highly correlated with human preferences, AlpacaEval is known to favor models that generate longer outputs. We introduce a length-controlled AlpacaEval that aims to answer the counterfactual question: "What would the preference be if the model's and baseline's output had the same length?". To achieve this, we first fit a generalized linear model to predict the biased output of interest (auto-annotator preferences) based on the mediators we want to control for (length difference) and other relevant features. We then obtain length-controlled preferences by predicting preferences while conditioning the GLM with a zero difference in lengths. Length-controlling not only improves the robustness of the metric to manipulations in model verbosity, we also find that it increases the Spearman correlation with LMSYS' Chatbot Arena from 0.94 to 0.98. We release the code and leaderboard at https://tatsu-lab.github.io/alpaca_eval/ .


title: DELTA: Decoupling Long-Tailed Online Continual Learning

abstract: A significant challenge in achieving ubiquitous Artificial Intelligence is the limited ability of models to rapidly learn new information in real-world scenarios where data follows long-tailed distributions, all while avoiding forgetting previously acquired knowledge. In this work, we study the under-explored problem of Long-Tailed Online Continual Learning (LTOCL), which aims to learn new tasks from sequentially arriving class-imbalanced data streams. Each data is observed only once for training without knowing the task data distribution. We present DELTA, a decoupled learning approach designed to enhance learning representations and address the substantial imbalance in LTOCL. We enhance the learning process by adapting supervised contrastive learning to attract similar samples and repel dissimilar (out-of-class) samples. Further, by balancing gradients during training using an equalization loss, DELTA significantly enhances learning outcomes and successfully mitigates catastrophic forgetting. Through extensive evaluation, we demonstrate that DELTA improves the capacity for incremental learning, surpassing existing OCL methods. Our results suggest considerable promise for applying OCL in real-world applications.


title: Fundamental Limits of Optical Fiber MIMO Channels With Finite Blocklength

abstract: The multiple-input and multiple-output (MIMO) technique is regarded as a promising approach to boost the throughput and reliability of optical fiber communications. However, the fundamental limits of optical fiber MIMO systems with finite block-length (FBL) are not available in the literature. This paper studies the fundamental limits of optical fiber multicore/multimode systems in the FBL regime when the coding rate is a perturbation within $\mathcal{O}(\frac{1}{\sqrt{ML}})$ of the capacity, where M and L represent the number of transmit channels and blocklength, respectively. Considering the Jacobi MIMO channel, which was proposed to model the nearly lossless propagation and the crosstalks in optical fiber systems, we derive the upper and lower bounds for the optimal error probability. For that purpose, we first set up the central limit theorem for the information density in the asymptotic regime where the number of transmit, receive, available channels and the blocklength go to infinity at the same pace. The result is then utilized to derive the upper and lower bounds for the optimal average error probability with the concerned rate. The derived theoretical results reveal interesting physical insights for Jacobi MIMO channels with FBL. First, the derived bounds for Jacobi channels degenerate to those for Rayleigh channels when the number of available channels approaches infinity. Second, the high signal-to-noise (SNR) approximation indicates that a larger number of available channels results in a larger error probability. Numerical results validate the accuracy of the theoretical results and show that the derived bounds are closer to the performance of practical LDPC codes than outage probability.


title: Diffusion-RWKV: Scaling RWKV-Like Architectures for Diffusion Models

abstract: Transformers have catalyzed advancements in computer vision and natural language processing (NLP) fields. However, substantial computational complexity poses limitations for their application in long-context tasks, such as high-resolution image generation. This paper introduces a series of architectures adapted from the RWKV model used in the NLP, with requisite modifications tailored for diffusion model applied to image generation tasks, referred to as Diffusion-RWKV. Similar to the diffusion with Transformers, our model is designed to efficiently handle patchnified inputs in a sequence with extra conditions, while also scaling up effectively, accommodating both large-scale parameters and extensive datasets. Its distinctive advantage manifests in its reduced spatial aggregation complexity, rendering it exceptionally adept at processing high-resolution images, thereby eliminating the necessity for windowing or group cached operations. Experimental results on both condition and unconditional image generation tasks demonstrate that Diffison-RWKV achieves performance on par with or surpasses existing CNN or Transformer-based diffusion models in FID and IS metrics while significantly reducing total computation FLOP usage.


title: On Capped Higgs Positivity Cone

abstract: The Wilson coefficients of the Standard Model Effective Field Theory are subject to a series of positivity bounds. It has been shown that, while the positivity part of the UV partial wave unitarity leads to the Wilson coefficients living in a convex cone, further including the non-positivity part caps the cone from above. For the Higgs scattering, a capped positivity cone have been obtained using a simplified, linear unitarity conditions and without utilizing the full internal symmetries of the Higgs scattering. Here we further implement the stronger nonlinear unitarity conditions from the UV, which generically gives rise to better bounds. We show that, for the Higgs case in particular, while the nonlinear unitarity conditions per se do not enhance the bounds, the fuller use of the internal symmetries do shrink the capped positivity cone significantly.


title: Possible charge density wave induced lattice distortion in ferromagnetic FeGe film

abstract: Binary compound FeGe hosts multiple structures, where skyrmion lattice emerges in the chiral B20 phase and antiferromagnet with charge density wave shows up in the hexagonal phase. Here, we synthesized monoclinic FeGe films which are ferromagnetic with Curie temperature as high as 800 K. By low temperature transmission electron microscope, lattice reconstructions in both real and reciprocal space were captured at 100 K whereas no observable transition was observed in either transport nor magnetic characterizations. We infer the lattice distortion may be induced by charge density wave. Our work suggests FeGe films an ideal platform for understanding the intertwining of charge density wave, lattice distortion and magnetism, and paves the way to the tuning charge density wave by means of lattice engineering.


title: Joint Identifiability of Cross-Domain Recommendation via Hierarchical Subspace Disentanglement

abstract: Cross-Domain Recommendation (CDR) seeks to enable effective knowledge transfer across domains. Existing works rely on either representation alignment or transformation bridges, but they struggle on identifying domain-shared from domain-specific latent factors. Specifically, while CDR describes user representations as a joint distribution over two domains, these methods fail to account for its joint identifiability as they primarily fixate on the marginal distribution within a particular domain. Such a failure may overlook the conditionality between two domains and how it contributes to latent factor disentanglement, leading to negative transfer when domains are weakly correlated. In this study, we explore what should and should not be transferred in cross-domain user representations from a causality perspective. We propose a Hierarchical subspace disentanglement approach to explore the Joint IDentifiability of cross-domain joint distribution, termed HJID, to preserve domain-specific behaviors from domain-shared factors. HJID organizes user representations into layers: generic shallow subspaces and domain-oriented deep subspaces. We first encode the generic pattern in the shallow subspace by minimizing the Maximum Mean Discrepancy of initial layer activation. Then, to dissect how domain-oriented latent factors are encoded in deeper layers activation, we construct a cross-domain causality-based data generation graph, which identifies cross-domain consistent and domain-specific components, adhering to the Minimal Change principle. This allows HJID to maintain stability whilst discovering unique factors for different domains, all within a generative framework of invertible transformations that guarantee the joint identifiability. With experiments on real-world datasets, we show that HJID outperforms SOTA methods on a range of strongly and weakly correlated CDR tasks.


title: Data-Driven Online Resource Allocation for User Experience Improvement in Mobile Edge Clouds

abstract: As the cloud is pushed to the edge of the network, resource allocation for user experience improvement in mobile edge clouds (MEC) is increasingly important and faces multiple challenges. This paper studies quality of experience (QoE)-oriented resource allocation in MEC while considering user diversity, limited resources, and the complex relationship between allocated resources and user experience. We introduce a closed-loop online resource allocation (CORA) framework to tackle this problem. It learns the objective function of resource allocation from the historical dataset and updates the learned model using the online testing results. Due to the learned objective model is typically non-convex and challenging to solve in real-time, we leverage the Lyapunov optimization to decouple the long-term average constraint and apply the prime-dual method to solve this decoupled resource allocation problem. Thereafter, we put forth a data-driven optimal online queue resource allocation (OOQRA) algorithm and a data-driven robust OQRA (ROQRA) algorithm for homogenous and heterogeneous user cases, respectively. Moreover, we provide a rigorous convergence analysis for the OOQRA algorithm. We conduct extensive experiments to evaluate the proposed algorithms using the synthesis and YouTube datasets. Numerical results validate the theoretical analysis and demonstrate that the user complaint rate is reduced by up to 100% and 18% in the synthesis and YouTube datasets, respectively.


title: FastHDRNet: A new efficient method for SDR-to-HDR Translation

abstract: Modern displays nowadays possess the capability to render video content with a high dynamic range (HDR) and an extensive color gamut .However, the majority of available resources are still in standard dynamic range (SDR). Therefore, we need to identify an effective methodology for this objective.The existing deep neural networks (DNN) based SDR to HDR conversion methods outperforms conventional methods, but they are either too large to implement or generate some terrible artifacts. We propose a neural network for SDR to HDR conversion, termed "FastHDRNet". This network includes two parts, Adaptive Universal Color Transformation (AUCT) and Local Enhancement (LE). The architecture is designed as a lightweight network that utilizes global statistics and local information with super high efficiency. After the experiment, we find that our proposed method achieves state-of-the-art performance in both quantitative comparisons and visual quality with a lightweight structure and a enhanced infer speed.


title: Automated Detection of Galactic Rings from SDSS Images

abstract: Morphological features in galaxies, like spiral arms, bars, rings, tidal tails etc. carry information about their structure, origin and evolution. It is therefore important to catalogue and study such features and to correlate them with other basic galaxy properties the environment in which the galaxies are located and their interactions with other galaxies. Surveys such as SDSS, Pan-STARRS, HSC-SSP have made available very large samples of galaxies for gainful morphological studies. The availability of galaxy images and catalogues will increase manifold with future surveys like LSST. The volume of present and future data is so large that traditional methods, which involve expert astronomers identifying morphological features through visual inspection, are no longer sufficient. It is therefore necessary to use AI based techniques like machine learning and deep learning for finding morphological structures quickly and efficiently. We report in this study the application of deep learning for finding ring like structures in galaxy images from the Sloan Digital Sky Survey (SDSS) data release DR18. We use a catalogue by Buta (2017) of ringed galaxies from the SDSS to train the network reaching good accuracy and recall, and generate a catalogue of 29420 galaxies of which 9805 have ring like structures with prediction confidence exceeding 90 percent. Using a catalogue of barred galaxy images identified by Abraham et. al. (2018) using deep learning techniques, we identify a set of 2087 galaxies with bars as well as rings. The catalogues should be very useful in understanding the origin of these important morphological structures.


title: Majority Voting of Doctors Improves Appropriateness of AI Reliance in Pathology

abstract: As Artificial Intelligence (AI) making advancements in medical decision-making, there is a growing need to ensure doctors develop appropriate reliance on AI to avoid adverse outcomes. However, existing methods in enabling appropriate AI reliance might encounter challenges while being applied in the medical domain. With this regard, this work employs and provides the validation of an alternative approach -- majority voting -- to facilitate appropriate reliance on AI in medical decision-making. This is achieved by a multi-institutional user study involving 32 medical professionals with various backgrounds, focusing on the pathology task of visually detecting a pattern, mitoses, in tumor images. Here, the majority voting process was conducted by synthesizing decisions under AI assistance from a group of pathology doctors (pathologists). Two metrics were used to evaluate the appropriateness of AI reliance: Relative AI Reliance (RAIR) and Relative Self-Reliance (RSR). Results showed that even with groups of three pathologists, majority-voted decisions significantly increased both RAIR and RSR -- by approximately 9% and 31%, respectively -- compared to decisions made by one pathologist collaborating with AI. This increased appropriateness resulted in better precision and recall in the detection of mitoses. While our study is centered on pathology, we believe these insights can be extended to general high-stakes decision-making processes involving similar visual tasks.


title: Discrete Brunn-Minkowski Inequality for subsets of the cube

abstract: We show that for all $A, B \subseteq \{0,1,2\}^{d}$ we have $$ |A+B|\geq (|A||B|)^{\log(5)/(2\log(3))}. $$ We also show that for all finite $A,B \subset \mathbb{Z}^{d}$, and any $V \subseteq\{0,1\}^{d}$ the inequality $$ |A+B+V|\geq |A|^{1/p}|B|^{1/q}|V|^{\log_{2}(p^{1/p}q^{1/q})} $$ holds for all $p \in (1, \infty)$, where $q=\frac{p}{p-1}$ is the conjugate exponent of $p$. All the estimates are dimension free with the best possible exponents. We discuss applications to various related problems.


title: KazQAD: Kazakh Open-Domain Question Answering Dataset

abstract: We introduce KazQAD -- a Kazakh open-domain question answering (ODQA) dataset -- that can be used in both reading comprehension and full ODQA settings, as well as for information retrieval experiments. KazQAD contains just under 6,000 unique questions with extracted short answers and nearly 12,000 passage-level relevance judgements. We use a combination of machine translation, Wikipedia search, and in-house manual annotation to ensure annotation efficiency and data quality. The questions come from two sources: translated items from the Natural Questions (NQ) dataset (only for training) and the original Kazakh Unified National Testing (UNT) exam (for development and testing). The accompanying text corpus contains more than 800,000 passages from the Kazakh Wikipedia. As a supplementary dataset, we release around 61,000 question-passage-answer triples from the NQ dataset that have been machine-translated into Kazakh. We develop baseline retrievers and readers that achieve reasonable scores in retrieval (NDCG@10 = 0.389 MRR = 0.382), reading comprehension (EM = 38.5 F1 = 54.2), and full ODQA (EM = 17.8 F1 = 28.7) settings. Nevertheless, these results are substantially lower than state-of-the-art results for English QA collections, and we think that there should still be ample room for improvement. We also show that the current OpenAI's ChatGPTv3.5 is not able to answer KazQAD test questions in the closed-book setting with acceptable quality. The dataset is freely available under the Creative Commons licence (CC BY-SA) at https://github.com/IS2AI/KazQAD.


title: On the existence of positive solution for a Neumann problem with double critical exponents in half-space

abstract: In this paper, we consider the existence and nonexistence of positive solution for a Neumann problem with double critical exponents and fast increasing weighted in half-space. This problem is closely related to the study of self-similar solutions for nonlinear heat equation. By applying the Mountain Pass Theorem without (PS) condition and the delicate estimates for the Mountain Pass level, we obtain the existence of a positive solution under different assumptions. Meanwhile, some nonexistence results for this problem is also obtained by an improved Pohozaev identity and Hardy inequality according to the value of the parameters. Particularly, we give the best lower bound of the parameter for the existence of a positive solution of this problem if dimension N=4.


title: Formation and Microwave Losses of Hydrides in Superconducting Niobium Thin Films Resulting from Fluoride Chemical Processing

abstract: Superconducting Nb thin films have recently attracted significant attention due to their utility for quantum information technologies. In the processing of Nb thin films, fluoride-based chemical etchants are commonly used to remove surface oxides that are known to affect superconducting quantum devices adversely. However, these same etchants can also introduce hydrogen to form Nb hydrides, potentially negatively impacting microwave loss performance. Here, we present comprehensive materials characterization of Nb hydrides formed in Nb thin films as a function of fluoride chemical treatments. In particular, secondary-ion mass spectrometry, X-ray scattering, and transmission electron microscopy reveal the spatial distribution and phase transformation of Nb hydrides. The rate of hydride formation is determined by the fluoride solution acidity and the etch rate of Nb2O5, which acts as a diffusion barrier for hydrogen into Nb. The resulting Nb hydrides are detrimental to Nb superconducting properties and lead to increased power-independent microwave loss in coplanar waveguide resonators. However, Nb hydrides do not correlate with two-level system loss or device aging mechanisms. Overall, this work provides insight into the formation of Nb hydrides and their role in microwave loss, thus guiding ongoing efforts to maximize coherence time in superconducting quantum devices.

categories: cond-mat.mtrl-sci cond-mat.supr-con physics.app-ph quant-ph


title: Hyperparameter Optimization for SecureBoost via Constrained Multi-Objective Federated Learning

abstract: SecureBoost is a tree-boosting algorithm that leverages homomorphic encryption (HE) to protect data privacy in vertical federated learning. SecureBoost and its variants have been widely adopted in fields such as finance and healthcare. However, the hyperparameters of SecureBoost are typically configured heuristically for optimizing model performance (i.e., utility) solely, assuming that privacy is secured. Our study found that SecureBoost and some of its variants are still vulnerable to label leakage. This vulnerability may lead the current heuristic hyperparameter configuration of SecureBoost to a suboptimal trade-off between utility, privacy, and efficiency, which are pivotal elements toward a trustworthy federated learning system. To address this issue, we propose the Constrained Multi-Objective SecureBoost (CMOSB) algorithm, which aims to approximate Pareto optimal solutions that each solution is a set of hyperparameters achieving an optimal trade-off between utility loss, training cost, and privacy leakage. We design measurements of the three objectives, including a novel label inference attack named instance clustering attack (ICA) to measure the privacy leakage of SecureBoost. Additionally, we provide two countermeasures against ICA. The experimental results demonstrate that the CMOSB yields superior hyperparameters over those optimized by grid search and Bayesian optimization regarding the trade-off between utility loss, training cost, and privacy leakage.


title: Galaxy 3D Shape Recovery using Mixture Density Network

abstract: Since the turn of the century, astronomers have been exploiting the rich information afforded by combining stellar kinematic maps and imaging in an attempt to recover the intrinsic, three-dimensional (3D) shape of a galaxy. A common intrinsic shape recovery method relies on an expected monotonic relationship between the intrinsic misalignment of the kinematic and morphological axes and the triaxiality parameter. Recent studies have, however, cast doubt about underlying assumptions relating shape and intrinsic kinematic misalignment. In this work, we aim to recover the 3D shape of individual galaxies using their projected stellar kinematic and flux distributions using a supervised machine learning approach with mixture density network (MDN). Using a mock dataset of the EAGLE hydrodynamical cosmological simulation, we train the MDN model for a carefully selected set of common kinematic and photometric parameters. Compared to previous methods, we demonstrate potential improvements achieved with the MDN model to retrieve the 3D galaxy shape along with the uncertainties, especially for prolate and triaxial systems. We make specific recommendations for recovering galaxy intrinsic shapes relevant for current and future integral field spectroscopic galaxy surveys.


title: Automated Lane Change Behavior Prediction and Environmental Perception Based on SLAM Technology

abstract: In addition to environmental perception sensors such as cameras, radars, etc. in the automatic driving system, the external environment of the vehicle is perceived, in fact, there is also a perception sensor that has been silently dedicated in the system, that is, the positioning module. This paper explores the application of SLAM (Simultaneous Localization and Mapping) technology in the context of automatic lane change behavior prediction and environment perception for autonomous vehicles. It discusses the limitations of traditional positioning methods, introduces SLAM technology, and compares LIDAR SLAM with visual SLAM. Real-world examples from companies like Tesla, Waymo, and Mobileye showcase the integration of AI-driven technologies, sensor fusion, and SLAM in autonomous driving systems. The paper then delves into the specifics of SLAM algorithms, sensor technologies, and the importance of automatic lane changes in driving safety and efficiency. It highlights Tesla's recent update to its Autopilot system, which incorporates automatic lane change functionality using SLAM technology. The paper concludes by emphasizing the crucial role of SLAM in enabling accurate environment perception, positioning, and decision-making for autonomous vehicles, ultimately enhancing safety and driving experience.


title: Tracing the evolving X-ray reverberation lags within an individual AGN light curve

abstract: We present the Granger causality (GC) test for the X-ray reverberation analysis of Active Galactic Nuclei (AGN). If the light curves in the continuum-dominated band help predict (Granger cause) those dominated by reflection, the Granger lags that associate to the intrinsic reverberation lags can be inferred. We focus on six AGN observed by XMM-Newton, including the sources well-known to exhibit clear X-ray reverberation lags (IRAS 13224-3809 and 1H 0707-495) and those in which reverberation signatures are not well confirmed (MCG-6-30-15, IZW1, Mrk 704 and Mrk 1040). We employ the sliding-window algorithm and estimate the Granger (intrinsic) Fe-L lags along the light curve as the window moves through. This reveals the evolving lags towards the end of some individual observations, suggesting that the corona varies progressively. Occasionally, we observe two clearly separate lags that suggest an extended corona consisting of two zones while producing competing reverberation of two lags. While the GC test is purely hypothetical and might not explain true causality, our conclusion is that the lags are present and could be understood as reverberation lags. Assuming the lags changing solely with the corona, we find that the IRAS 13224-3809 corona varies between $\sim 10$-$25$ $r_{\rm g}$ and sometimes move to $\gtrsim 50$ $r_{\rm g}$. The corona of 1H 0707-495 and MCG-6-30-15 may be analogous to that of IRAS 13224-3809, while in IZw1, Mrk 704 and Mrk 1040 a more compact corona is expected.


title: Fast and simple inner-loop algorithms of static / dynamic BLP estimations

abstract: This study investigates computationally efficient inner-loop algorithms for estimating static/dynamic BLP models. It provides the following ideas to reduce the number of inner-loop iterations: (1). Add a term concerning the outside option share in the BLP contraction mapping; (2). Analytically represent mean product utilities as a function of value functions and solve for the value functions (for dynamic BLP); (3-1). Combine the spectral/SQUAREM algorithm; (3-2). Choice of the step sizes. They are independent and easy to implement. This study shows good performance of these methods by numerical experiments.


title: Fast and Accurate Bayesian Optimization with Pre-trained Transformers for Constrained Engineering Problems

abstract: Bayesian Optimization (BO) is a foundational strategy in the field of engineering design optimization for efficiently handling black-box functions with many constraints and expensive evaluations. This paper introduces a fast and accurate BO framework that leverages Pre-trained Transformers for Bayesian Optimization (PFN4sBO) to address constrained optimization problems in engineering. Unlike traditional BO methods that rely heavily on Gaussian Processes (GPs), our approach utilizes Prior-data Fitted Networks (PFNs), a type of pre-trained transformer, to infer constraints and optimal solutions without requiring any iterative retraining. We demonstrate the effectiveness of PFN-based BO through a comprehensive benchmark consisting of fifteen test problems, encompassing synthetic, structural, and engineering design challenges. Our findings reveal that PFN-based BO significantly outperforms Constrained Expected Improvement and Penalty-based GP methods by an order of magnitude in speed while also outperforming them in accuracy in identifying feasible, optimal solutions. This work showcases the potential of integrating machine learning with optimization techniques in solving complex engineering challenges, heralding a significant leap forward for optimization methodologies, opening up the path to using PFN-based BO to solve other challenging problems, such as enabling user-guided interactive BO, adaptive experiment design, or multi-objective design optimization. Additionally, we establish a benchmark for evaluating BO algorithms in engineering design, offering a robust platform for future research and development in the field. This benchmark framework for evaluating new BO algorithms in engineering design will be published at https://github.com/rosenyu304/BOEngineeringBenchmark.


title: Towards Better Graph Neural Network-based Fault Localization Through Enhanced Code Representation

abstract: Automatic software fault localization plays an important role in software quality assurance by pinpointing faulty locations for easier debugging. Coverage-based fault localization, a widely used technique, employs statistics on coverage spectra to rank code based on suspiciousness scores. However, the rigidity of statistical approaches calls for learning-based techniques. Amongst all, Grace, a graph-neural network (GNN) based technique has achieved state-of-the-art due to its capacity to preserve coverage spectra, i.e., test-to-source coverage relationships, as precise abstract syntax-enhanced graph representation, mitigating the limitation of other learning-based technique which compresses the feature representation. However, such representation struggles with scalability due to the increasing complexity of software and associated coverage spectra and AST graphs. In this work, we proposed a new graph representation, DepGraph, that reduces the complexity of the graph representation by 70% in nodes and edges by integrating interprocedural call graph in the graph representation of the code. Moreover, we integrate additional features such as code change information in the graph as attributes so the model can leverage rich historical project data. We evaluate DepGraph using Defects4j 2.0.0, and it outperforms Grace by locating 20% more faults in Top-1 and improving the Mean First Rank (MFR) and the Mean Average Rank (MAR) by over 50% while decreasing GPU memory usage by 44% and training/inference time by 85%. Additionally, in cross-project settings, DepGraph surpasses the state-of-the-art baseline with a 42% higher Top-1 accuracy, and 68% and 65% improvement in MFR and MAR, respectively. Our study demonstrates DepGraph's robustness, achieving state-of-the-art accuracy and scalability for future extension and adoption.