title: Elastic energy storage of spring-driven jumping robots

abstract: Spring-driven jumping robots use an energised spring for propulsion, while the onboard motor only serves as a spring-charging source. A common mechanism in designing these robots is the rhomboidal linkage, which has been combined with linear springs (spring-linkage) to create a nonlinear spring, thereby increasing elastic energy storage and jump height for a given motor force. The effectiveness of this spring-linkage has been examined for individual designs, but a generalised design theory of this class of system remains absent. This paper presents an energetics analysis of the spring-linkage and provides insight into designing an ideal constant force spring, which stores the maximum energy for a given motor force. A quasi-static analysis shows that the force-displacement relationship of the spring-linkage changes with the orientation and type of the spring, but is independent of the linkage scale. Combining different types and orientations of springs within the linkage enables higher elastic energy storage than using single springs. Placing two translational springs at the diagonals of the rhomboidal linkage creates an ideal spring that could increase the jump height of prior robots by 50-160%.


title: FairSeg: A Large-Scale Medical Image Segmentation Dataset for Fairness Learning Using Segment Anything Model with Fair Error-Bound Scaling

abstract: Fairness in artificial intelligence models has gained significantly more attention in recent years, especially in the area of medicine, as fairness in medical models is critical to people's well-being and lives. High-quality medical fairness datasets are needed to promote fairness learning research. Existing medical fairness datasets are all for classification tasks, and no fairness datasets are available for medical segmentation, while medical segmentation is an equally important clinical task as classifications, which can provide detailed spatial information on organ abnormalities ready to be assessed by clinicians. In this paper, we propose the first fairness dataset for medical segmentation named Harvard-FairSeg with 10,000 subject samples. In addition, we propose a fair error-bound scaling approach to reweight the loss function with the upper error-bound in each identity group, using the segment anything model (SAM). We anticipate that the segmentation performance equity can be improved by explicitly tackling the hard cases with high training errors in each identity group. To facilitate fair comparisons, we utilize a novel equity-scaled segmentation performance metric to compare segmentation metrics in the context of fairness, such as the equity-scaled Dice coefficient. Through comprehensive experiments, we demonstrate that our fair error-bound scaling approach either has superior or comparable fairness performance to the state-of-the-art fairness learning models. The dataset and code are publicly accessible via https://ophai.hms.harvard.edu/datasets/harvard-fairseg10k.


title: The Tensor as an Informational Resource

abstract: A tensor is a multidimensional array of numbers that can be used to store data, encode a computational relation and represent quantum entanglement. In this sense a tensor can be viewed as valuable resource whose transformation can lead to an understanding of structure in data, computational complexity and quantum information. In order to facilitate the understanding of this resource, we propose a family of information-theoretically constructed preorders on tensors, which can be used to compare tensors with each other and to assess the existence of transformations between them. The construction places copies of a given tensor at the edges of a hypergraph and allows transformations at the vertices. A preorder is then induced by the transformations possible in a given growing sequence of hypergraphs. The new family of preorders generalises the asymptotic restriction preorder which Strassen defined in order to study the computational complexity of matrix multiplication. We derive general properties of the preorders and their associated asymptotic notions of tensor rank and view recent results on tensor rank non-additivity, tensor networks and algebraic complexity in this unifying frame. We hope that this work will provide a useful vantage point for exploring tensors in applied mathematics, physics and computer science, but also from a purely mathematical point of view.


title: SparsePoser: Real-time Full-body Motion Reconstruction from Sparse Data

abstract: Accurate and reliable human motion reconstruction is crucial for creating natural interactions of full-body avatars in Virtual Reality (VR) and entertainment applications. As the Metaverse and social applications gain popularity, users are seeking cost-effective solutions to create full-body animations that are comparable in quality to those produced by commercial motion capture systems. In order to provide affordable solutions, though, it is important to minimize the number of sensors attached to the subject's body. Unfortunately, reconstructing the full-body pose from sparse data is a heavily under-determined problem. Some studies that use IMU sensors face challenges in reconstructing the pose due to positional drift and ambiguity of the poses. In recent years, some mainstream VR systems have released 6-degree-of-freedom (6-DoF) tracking devices providing positional and rotational information. Nevertheless, most solutions for reconstructing full-body poses rely on traditional inverse kinematics (IK) solutions, which often produce non-continuous and unnatural poses. In this article, we introduce SparsePoser, a novel deep learning-based solution for reconstructing a full-body pose from a reduced set of six tracking devices. Our system incorporates a convolutional-based autoencoder that synthesizes high-quality continuous human poses by learning the human motion manifold from motion capture data. Then, we employ a learned IK component, made of multiple lightweight feed-forward neural networks, to adjust the hands and feet toward the corresponding trackers. We extensively evaluate our method on publicly available motion capture datasets and with real-time live demos. We show that our method outperforms state-of-the-art techniques using IMU sensors or 6-DoF tracking devices, and can be used for users with different body dimensions and proportions.


title: Automating Governing Knowledge Commons and Contextual Integrity (GKC-CI) Privacy Policy Annotations with Large Language Models

abstract: Identifying contextual integrity (CI) and governing knowledge commons (GKC) parameters in privacy policy texts can facilitate normative privacy analysis. However, GKC-CI annotation has heretofore required manual or crowdsourced effort. This paper demonstrates that high-accuracy GKC-CI parameter annotation of privacy policies can be performed automatically using large language models. We fine-tune 18 open-source and proprietary models on 21,588 GKC-CI annotations from 16 ground truth privacy policies. Our best-performing model (fine-tuned GPT-3.5 Turbo with prompt engineering) has an accuracy of 86%, exceeding the performance of prior crowdsourcing approaches despite the complexity of privacy policy texts and the nuance of the GKC-CI annotation task. We apply our best-performing model to privacy policies from 164 popular online services, demonstrating the effectiveness of scaling GKC-CI annotation for data exploration. We make all annotated policies as well as the training data and scripts needed to fine-tune our best-performing model publicly available for future research.


title: An effective self-supervised learning method for various seismic noise attenuation

abstract: Faced with the scarcity of clean label data in real scenarios, seismic denoising methods based on supervised learning (SL) often encounter performance limitations. Specifically, when a model trained on synthetic data is directly applied to field data, its performance would drastically decline due to significant differences in feature distributions between the two. To address this challenge, we develop an effective self-supervised strategy. This strategy, while relying on a single denoising network model, adeptly attenuates various types of seismic noise. The strategy comprises two main phases: 1. The warm-up phase. By using prior knowledge or extracting information from real data, we introduce additional noise to the original noisy data, constructing a noisier data with intensified noise. This data serves as the input, with the original noisy data acting as pseudo-labels. This facilitates rapid pre-training of the network to capture a certain noise characteristics and boosts network stability, setting the stage for the subsequent phase. 2. Iterative data refinement (IDR) phase. During this phase, we use the predictions of the original noisy data from the network trained in the previous epoch as the pseudo-labels. We continue to add noise to the predictions, creating a new noisier-noisy dataset for the current epoch of network training. Through this iterative process, we progressively reduce the discrepancy between the original noisy data and the desired clean data. Ultimately, the network's predictions on the original noisy data become our denoised results. Validations under scenarios with random noise, backscattered noise, and blending noise reveal that our method not only matches the traditional SL techniques on synthetic data but significantly outperforms them on field data.


title: AlberDICE: Addressing Out-Of-Distribution Joint Actions in Offline Multi-Agent RL via Alternating Stationary Distribution Correction Estimation

abstract: One of the main challenges in offline Reinforcement Learning (RL) is the distribution shift that arises from the learned policy deviating from the data collection policy. This is often addressed by avoiding out-of-distribution (OOD) actions during policy improvement as their presence can lead to substantial performance degradation. This challenge is amplified in the offline Multi-Agent RL (MARL) setting since the joint action space grows exponentially with the number of agents. To avoid this curse of dimensionality, existing MARL methods adopt either value decomposition methods or fully decentralized training of individual agents. However, even when combined with standard conservatism principles, these methods can still result in the selection of OOD joint actions in offline MARL. To this end, we introduce AlberDICE, an offline MARL algorithm that alternatively performs centralized training of individual agents based on stationary distribution optimization. AlberDICE circumvents the exponential complexity of MARL by computing the best response of one agent at a time while effectively avoiding OOD joint action selection. Theoretically, we show that the alternating optimization procedure converges to Nash policies. In the experiments, we demonstrate that AlberDICE significantly outperforms baseline algorithms on a standard suite of MARL benchmarks.


title: A Primordial Origin for the Gas-Rich Debris Disks Around Intermediate-Mass Stars

abstract: While most debris disks consist of dust with little or no gas, a fraction has significant amounts of gas detected via emission lines of CO, ionized carbon, and/or atomic oxygen. Almost all such gaseous debris disks known are around A-type stars with ages up to 50 Myr. We show, using semi-analytic disk evolution modeling, that this can be understood if the gaseous debris disks are remnant protoplanetary disks that have become depleted of small grains compared to the interstellar medium. Photoelectric heating by the A-stars' FUV radiation is then inefficient, while the stars' EUV and X-ray emissions are weak owing to a lack of surface convective zones capable of driving magnetic activity. In this picture, stars outside the range of spectral types from A through early B are relatively hard to have such long-lived gas disks. Less-massive stars have stronger magnetic activity in the chromosphere, transition region, and corona with resulting EUV and X-ray emission, while more-massive stars have photospheres hot enough to produce strong EUV radiation. In both cases, primordial disk gas is likely to photoevaporate well before 50 Myr. These results come from 0D disk evolution models where we incorporate internal accretion stresses, MHD winds, and photoevaporation by EUV and X-ray photons with luminosities that are functions of the stellar mass and age. A key issue this work leaves open is how some disks become depleted in small dust so that FUV photoevaporation slows. Candidates include grains' growth, settling, radial drift, radiation force, and incorporation into planetary systems.


title: Pooled Bewley Estimator of Long Run Relationships in Dynamic Heterogenous Panels

abstract: Using a transformation of the autoregressive distributed lag model due to Bewley, a novel pooled Bewley (PB) estimator of long-run coefficients for dynamic panels with heterogeneous short-run dynamics is proposed. The PB estimator is directly comparable to the widely used Pooled Mean Group (PMG) estimator, and is shown to be consistent and asymptotically normal. Monte Carlo simulations show good small sample performance of PB compared to the existing estimators in the literature, namely PMG, panel dynamic OLS (PDOLS), and panel fully-modified OLS (FMOLS). Application of two bias-correction methods and a bootstrapping of critical values to conduct inference robust to cross-sectional dependence of errors are also considered. The utility of the PB estimator is illustrated in an empirical application to the aggregate consumption function.


title: Localization and integrability breaking in weakly interacting Floquet circuits

abstract: We present a family of Floquet circuits that can interpolate between non-interacting qubits, free propagation, generic interacting, and dual-unitary dynamics. We identify the operator entanglement entropy of the two-qubit gate as a good quantitative measure of the interaction strength. We test the persistence of localization in the vicinity of the non-interacting point by probing spectral statistics, decay of autocorrelators, and measuring entanglement growth. The finite-size analysis suggests that the many-body localized regime does not persist in the thermodynamic limit. Instead, our results are compatible with an integrability-breaking phenomenon.


title: Imitation Bootstrapped Reinforcement Learning

abstract: Despite the considerable potential of reinforcement learning (RL), robotic control tasks predominantly rely on imitation learning (IL) due to its better sample efficiency. However, it is costly to collect comprehensive expert demonstrations that enable IL to generalize to all possible scenarios, and any distribution shift would require recollecting data for finetuning. Therefore, RL is appealing if it can build upon IL as an efficient autonomous self-improvement procedure. We propose imitation bootstrapped reinforcement learning (IBRL), a novel framework for sample-efficient RL with demonstrations that first trains an IL policy on the provided demonstrations and then uses it to propose alternative actions for both online exploration and bootstrapping target values. Compared to prior works that oversample the demonstrations or regularize RL with an additional imitation loss, IBRL is able to utilize high quality actions from IL policies since the beginning of training, which greatly accelerates exploration and training efficiency. We evaluate IBRL on 6 simulation and 3 real-world tasks spanning various difficulty levels. IBRL significantly outperforms prior methods and the improvement is particularly more prominent in harder tasks.


title: Merger Interactions Enhance Star Formation Rates in Galaxy Group Housing QSO PKS0405$-$123 and Gaseous Nebulae

abstract: The star formation rate (SFR) of galaxies can change due to interactions between galaxies, stellar feedback ejection of gas into the circumgalactic medium, and energy injection from accretion onto black holes. However, it is not clear which of these processes dominantly alters the formation of stars within galaxies. Johnson et al. (2018) reported the discovery of large gaseous nebulae in the intragroup medium of a galaxy group housing QSO PKS0405$-$123 and hypothesized they were created by galaxy interactions. We identify a sample of 30 group member galaxies at z$\sim$0.57 from the VLT/MUSE observations of the field and calculate their [OII]$\lambda$$\lambda$3727,3729 SFRs in order to investigate whether the QSO and nebulae have affected the SFRs of the surrounding galaxies. We find that star formation is more prevalent in galaxies within the nebulae, signifying galaxy interactions are fueling higher SFRs.


title: Optimization Based Data Enrichment Using Stochastic Dynamical System Models

abstract: We develop a general framework for state estimation in systems modeled with noise-polluted continuous time dynamics and discrete time noisy measurements. Our approach is based on maximum likelihood estimation and employs the calculus of variations to derive optimality conditions for continuous time functions. We make no prior assumptions on the form of the mapping from measurements to state-estimate or on the distributions of the noise terms, making the framework more general than Kalman filtering/smoothing where this mapping is assumed to be linear and the noises Gaussian. The optimal solution that arises is interpreted as a continuous time spline, the structure and temporal dependency of which is determined by the system dynamics and the distributions of the process and measurement noise. Similar to Kalman smoothing, the optimal spline yields increased data accuracy at instants when measurements are taken, in addition to providing continuous time estimates outside the measurement instances. We demonstrate the utility and generality of our approach via illustrative examples that render both linear and nonlinear data filters depending on the particular system.


title: On 2-Distance ($\Delta+4$)-coloring of planar graphs with girth at least five

abstract: A vertex coloring of a graph $G$ is called a 2-distance coloring if any two vertices at distance at most $2$ from each other receive different colors. Let $G$ be a planar graph with girth at least $5$. We prove that $G$ admits a $2$-distance coloring with $\Delta+4$ colors if $\Delta\geq 22$.


title: Neural Collage Transfer: Artistic Reconstruction via Material Manipulation

abstract: Collage is a creative art form that uses diverse material scraps as a base unit to compose a single image. Although pixel-wise generation techniques can reproduce a target image in collage style, it is not a suitable method due to the solid stroke-by-stroke nature of the collage form. While some previous works for stroke-based rendering produced decent sketches and paintings, collages have received much less attention in research despite their popularity as a style. In this paper, we propose a method for learning to make collages via reinforcement learning without the need for demonstrations or collage artwork data. We design the collage Markov Decision Process (MDP), which allows the agent to handle various materials and propose a model-based soft actor-critic to mitigate the agent's training burden derived from the sophisticated dynamics of collage. Moreover, we devise additional techniques such as active material selection and complexity-based multi-scale collage to handle target images at any size and enhance the results' aesthetics by placing relatively more scraps in areas of high complexity. Experimental results show that the trained agent appropriately selected and pasted materials to regenerate the target image into a collage and obtained a higher evaluation score on content and style than pixel-wise generation methods. Code is available at https://github.com/northadventure/CollageRL.


title: Complexity of sign imbalance, parity of linear extensions, and height 2 posets

abstract: Sign imbalance is a statistic on posets which counts the difference between the number of even and odd linear extensions. We prove complexity results about the sign imbalance and parity of linear extensions, focusing on the representative case of height 2 posets. We then consider a recent conjecture of Chan and Pak.


title: Active risk aversion in SIS epidemics on networks

abstract: We present and analyze an actively controlled Susceptible-Infected-Susceptible (actSIS) model of interconnected populations to study how risk aversion strategies, such as social distancing, affect network epidemics. A population using a risk aversion strategy reduces its contact rate with other populations when it perceives an increase in infection risk. The network actSIS model relies on two distinct networks. One is a physical contact network that defines which populations come into contact with which other populations and thus how infection spreads. The other is a communication network, such as an online social network, that defines which populations observe the infection level of which other populations and thus how information spreads. We prove that the model, with these two networks and populations using risk aversion strategies, exhibits a transcritical bifurcation in which an endemic equilibrium emerges. For regular graphs, we prove that the endemic infection level is uniform across populations and reduced by the risk aversion strategy, relative to the network SIS endemic level. We show that when communication is sufficiently sparse, this initially stable equilibrium loses stability in a secondary bifurcation. Simulations show that a new stable solution emerges with nonuniform infection levels.


title: An Introduction to Natural Language Processing Techniques and Framework for Clinical Implementation in Radiation Oncology

abstract: Natural Language Processing (NLP) is a key technique for developing Medical Artificial Intelligence (AI) systems that leverage Electronic Health Record (EHR) data to build diagnostic and prognostic models. NLP enables the conversion of unstructured clinical text into structured data that can be fed into AI algorithms. The emergence of the transformer architecture and large language models (LLMs) has led to remarkable advances in NLP for various healthcare tasks, such as entity recognition, relation extraction, sentence similarity, text summarization, and question answering. In this article, we review the major technical innovations that underpin modern NLP models and present state-of-the-art NLP applications that employ LLMs in radiation oncology research. However, these LLMs are prone to many errors such as hallucinations, biases, and ethical violations, which necessitate rigorous evaluation and validation before clinical deployment. As such, we propose a comprehensive framework for assessing the NLP models based on their purpose and clinical fit, technical performance, bias and trust, legal and ethical implications, and quality assurance, prior to implementation in clinical radiation oncology. Our article aims to provide guidance and insights for researchers and clinicians who are interested in developing and using NLP models in clinical radiation oncology.


title: Modern Datalog on the GPU

abstract: Modern deductive database engines (e.g., LogicBlox and Souffl\'e) enable their users to write declarative queries which compute recursive deductions over extensional data, leaving their high-performance operationalization (query planning, semi-na\"ive evaluation, and parallelization) to the engine. Such engines form the backbone of modern high-throughput applications in static analysis, security auditing, social-media mining, and business analytics. State-of-the-art engines are built upon nested loop joins over explicit representations (e.g., BTrees and tries) and ubiquitously employ range indexing to accelerate iterated joins. In this work, we present GDlog: a GPU-based deductive analytics engine (implemented as a CUDA library) which achieves significant performance improvements (5--10x or more) versus prior systems. GDlog is powered by a novel range-indexed SIMD datastructure: the hash-indexed sorted array (HISA). We perform extensive evaluation on GDlog, comparing it against both CPU and GPU-based hash tables and Datalog engines, and using it to support a range of large-scale deductive queries including reachability, same generation, and context-sensitive program analysis. Our experiments show that GDlog achieves performance competitive with modern SIMD hash tables and beats prior work by an order of magnitude in runtime while offering more favorable memory footprint.


title: Inter-layer bias effect on time-reversal symmetry breaking in twisted bilayer cuprates

abstract: We study a one-band Hubbard model of twisted bilayer cuprates with a twist angle of $53.13^\circ$. By introducing an inter-layer bias, we simulate heterobilayers of different dopings. Using the variational cluster approximation (VCA) we probe the effect of this bias on the time-reversal-symmetry (TRS) breaking phase. Doping differences between layers affect the region where TRS-breaking occurs; we construct a phase diagram mapping out the TRS-breaking phase in the $n_1$-$n_2$ plane, $n_\ell$ being the electron density on layer $\ell$. We also map the spontaneous supercurrent on the same plane.


title: Note on a bomb dropped by Mr Conant and Mr Kruckman, and its consequences for the theory ACFG

abstract: This note is a reaction to Conant and Kruckman's recent preprint `Three surprising instance of dividing'. It mainly consists of an erratum to the author's paper `Forking, imaginaries and other features of ACFG', in light of the results of the aforementioned paper.


title: A Model-Based Synthetic Stock Price Time Series Generation Framework

abstract: The Ornstein-Uhlenbeck (OU) process, a mean-reverting stochastic process, has been widely applied as a time series model in various domains. This paper describes the design and implementation of a model-based synthetic time series model based on a multivariate OU process and the Arbitrage Pricing Theory (APT) for generating synthetic pricing data for a complex market of interacting stocks. The objective is to create a group of synthetic stock price time series that reflects the correlation between individual stocks and clusters of stocks in how a real market behaves. We demonstrate the method using the Standard and Poor's (S&P) 500 universe of stocks as an example.


title: Causality violations in simulations of large and small heavy-ion collisions

abstract: Heavy-ion collisions, such as Pb-Pb or p-Pb, produce extreme conditions in temperature and density that make the hadronic matter transition to a new state, called quark-gluon plasma (QGP). Simulations of heavy-ion collisions provide a way to improve our understanding of the QGP's properties. These simulations are composed of a hybrid description that results in final observables in agreement with accelerators like LHC and RHIC. However, recent works pointed out that these hydrodynamic simulations can display acausal behavior during the evolution in certain regions, indicating a deviation from a faithful representation of the underlying QCD dynamics. To pursue a better understanding of this problem and its consequences, this work simulated two different collision systems, Pb-Pb and p-Pb at $\sqrt{s_{NN}} = 5.02$ TeV. In this context, our results show that causality violation, even though always present, typically occurs on a small part of the system, quantified by the total energy fraction residing in the acausal region. In addition, the acausal behavior can be reduced with changes in the pre-hydrodynamic factors and the definition of the bulk-viscous relaxation time. Since these aspects are fairly arbitrary in current simulation models, without solid guidance from the underlying theory, it is reasonable to use the disturbing presence of acausal behavior in current simulations to guide improvements towards more realistic modeling. While this work does not solve the acausality problem, it sheds more light on this issue and also proposes a way to solve this problem in simulations of heavy-ion collisions.


title: Rock Climbing Route Generation and Grading as Computational Creativity

abstract: In this paper, we bridge work in rock climbing route generation and grading into the computational creativity community. We provide the necessary background to situate that literature and demonstrate the domain's intellectual merit in the computational creativity community. We provide a guiding set of desiderata for future work in this area. We propose an approach to computational route grading. Finally, we identify important gaps in the literature and consider how they may be filled. This paper thus also serves as a pilot study, planting a flag for our ongoing research in this domain.


title: Anisotropic positive linear and sub-linear magnetoresistivity in the cubic type-II Dirac metal Pd$_3$In$_7$

abstract: We report a transport study on Pd$_3$In$_7$ which displays multiple Dirac type-II nodes in its electronic dispersion. Pd$_3$In$_7$ is characterized by low residual resistivities and high mobilities, which are consistent with Dirac-like quasiparticles. For an applied magnetic field $(\mu_{\text{0}} H)$ having a non-zero component along the electrical current, we find a large, positive, and linear in $\mu_{\text{0}} H$ longitudinal magnetoresistivity (LMR). The sign of the LMR and its linear dependence deviate from the behavior reported for the chiral-anomaly-driven LMR in Weyl semimetals. Interestingly, such anomalous LMR is consistent with predictions for the role of the anomaly in type-II Weyl semimetals. In contrast, the transverse or conventional magnetoresistivity (CMR for electric fields $\textbf{E} \bot \mu_{\text{0}} \textbf{H}$) is large and positive, increasing by $10^3-10^4$ \% as a function of $\mu_{\text{0}}H$ while following an anomalous, angle-dependent power law $\rho_{\text{xx}}\propto (\mu_{\text{0}}H)^n$ with $n(\theta) \leq 1$. The order of magnitude of the CMR, and its anomalous power-law, is explained in terms of uncompensated electron and hole-like Fermi surfaces characterized by anisotropic carrier scattering likely due to the lack of Lorentz invariance.


abstract: Bayesian Optimization (BO) is a technique for sample-efficient black-box optimization that employs probabilistic models to identify promising input locations for evaluation. When dealing with composite-structured functions, such as f=g o h, evaluating a specific location x yields observations of both the final outcome f(x) = g(h(x)) as well as the intermediate output(s) h(x). Previous research has shown that integrating information from these intermediate outputs can enhance BO performance substantially. However, existing methods struggle if the outputs h(x) are high-dimensional. Many relevant problems fall into this setting, including in the context of generative AI, molecular design, or robotics. To effectively tackle these challenges, we introduce Joint Composite Latent Space Bayesian Optimization (JoCo), a novel framework that jointly trains neural network encoders and probabilistic models to adaptively compress high-dimensional input and output spaces into manageable latent representations. This enables viable BO on these compressed representations, allowing JoCo to outperform other state-of-the-art methods in high-dimensional BO on a wide variety of simulated and real-world problems.


title: An improved limit on the neutrinoless double-electron capture of $^{36}$Ar with GERDA

abstract: The GERmanium Detector Array (GERDA) experiment operated enriched high-purity germanium detectors in a liquid argon cryostat, which contains 0.33% of $^{36}$Ar, a candidate isotope for the two-neutrino double-electron capture (2$\nu$ECEC) and therefore for the neutrinoless double-electron capture (0$\nu$ECEC). If detected, this process would give evidence of lepton number violation and the Majorana nature of neutrinos. In the radiative 0$\nu$ECEC of $^{36}$Ar, a monochromatic photon is emitted with an energy of 429.88 keV, which may be detected by the GERDA germanium detectors. We searched for the $^{36}$Ar 0$\nu$ECEC with GERDA data, with a total live time of 4.34 yr (3.08 yr accumulated during GERDA Phase II and 1.26 yr during GERDA Phase I). No signal was found and a 90% C.L. lower limit on the half-life of this process was established T$_{1/2}$ > 1.5x10$^{22}$ yr


title: Towards model-free RL algorithms that scale well with unstructured data

abstract: Conventional reinforcement learning (RL) algorithms exhibit broad generality in their theoretical formulation and high performance on several challenging domains when combined with powerful function approximation. However, developing RL algorithms that perform well across problems with unstructured observations at scale remains challenging because most function approximation methods rely on externally provisioned knowledge about the structure of the input for good performance (e.g. convolutional networks, graph neural networks, tile-coding). A common practice in RL is to evaluate algorithms on a single problem, or on problems with limited variation in the observation scale. RL practitioners lack a systematic way to study how well a single RL algorithm performs when instantiated across a range of problem scales, and they lack function approximation techniques that scale well with unstructured observations. We address these limitations by providing environments and algorithms to study scaling for unstructured observation vectors and flat action spaces. We introduce a family of combinatorial RL problems with an exponentially large state space and high-dimensional dynamics but where linear computation is sufficient to learn a (nonlinear) value function estimate for performant control. We provide an algorithm that constructs reward-relevant general value function (GVF) questions to find and exploit predictive structure directly from the experience stream. In an empirical evaluation of the approach on synthetic problems, we observe a sample complexity that scales linearly with the observation size. The proposed algorithm reliably outperforms a conventional deep RL algorithm on these scaling problems, and they exhibit several desirable auxiliary properties. These results suggest new algorithmic mechanisms by which algorithms can learn at scale from unstructured data.


title: Exploring the Numerical Reasoning Capabilities of Language Models: A Comprehensive Analysis on Tabular Data

abstract: Numbers are crucial for various real-world domains such as finance, economics, and science. Thus, understanding and reasoning with numbers are essential skills for language models to solve different tasks. While different numerical benchmarks have been introduced in recent years, they are limited to specific numerical aspects mostly. In this paper, we propose a hierarchical taxonomy for numerical reasoning skills with more than ten reasoning types across four levels: representation, number sense, manipulation, and complex reasoning. We conduct a comprehensive evaluation of state-of-the-art models to identify reasoning challenges specific to them. Henceforth, we develop a diverse set of numerical probes employing a semi-automated approach. We focus on the tabular Natural Language Inference (TNLI) task as a case study and measure models' performance shifts. Our results show that no model consistently excels across all numerical reasoning types. Among the probed models, FlanT5 (few-/zero-shot) and GPT-3.5 (few-shot) demonstrate strong overall numerical reasoning skills compared to other models. Label-flipping probes indicate that models often exploit dataset artifacts to predict the correct labels.


title: Linear difference operators with sequence coefficients having infinite-dimentional solution spaces

abstract: The notion of lacunary infinite numerical sequence is introduced. It is shown that for an arbitrary linear difference operator L with coefficients belonging to the set R of infinite numerical sequences, a criterion (i.e., a necessary and sufficient condition) for the infinite dimensionality of its space $V_L$ of solutions belonging to R is the presence of a lacunary sequence in $V_L$.


title: Influence of a static electric field on a one-dimensional Bose-Fermi mixture confined in a double potential welll

abstract: In this study, we conducted a detailed investigation into the time evolution of the probability density within a 1D double-well potential hosting a Bose-Fermi mixture. This system comprised spinless bosons and spin one-half fermions with weak repulsive contact interactions. Notably, even at very low effective coupling constants, periodic probabilities were observed, indicating correlated tunneling of both bosons and fermions, leading to complete miscibility, which disappears when an external electric field is turned on. The electric field accentuated fermion-fermion interactions due to the Pauli exclusion principle, altering both boson density and interactions and leading to spatial redistribution of particles. These findings underscore the complex interplay between interactions, external fields, and spatial distributions within confined quantum systems. Our exploration of higher interaction strengths revealed conditions under which probability density functions are decoupled. Furthermore, we observed that increased fermion interaction, driven by the electric field, led to higher tunneling frequencies for both species because of the repulsive nature of the boson-fermion interaction. Conversely, increased boson-boson interaction resulted in complete tunneling of both species, especially when boson density was high, leading to effective fermion repulsion. Expanding our analysis to scenarios involving four bosons demonstrated that higher interaction values corresponded to increased oscillation frequencies in tunneling probabilities. Finally, by manipulating interaction parameters and activating the electric field, we achieved complete tunneling of both species, further increasing oscillation frequencies and resulting in intervals characterized by overlapping probability functions.


title: On the dimension of the solution space of linear difference equations over the ring of infinite sequences

abstract: For a linear difference equation with the coefficients being computable sequences, we establish algorithmic undecidability of the problem of determining the dimension of the solution space including the case when some additional prior information on the dimension is available.


title: A geometric approach to the relative de Rham-Witt complex in the smooth, $\mathbb{Z}$-torsion free case

abstract: Let $X$ be a smooth scheme over a finitely generated flat $\mathbb{Z}$-, $\mathbb{Z}_{(p)}$- or $\mathbb{Z}_p$-algebra $R$. Evaluated at finite truncation sets $S$, the relative de Rham-Witt complex $W_S\Omega_{X/R}^{\bullet}$ is a quotient of the de Rham complex $\Omega^{\bullet}_{W_S(X)/W_S(R)}$, which can be computed affine locally via explicit, but complicated relations. In this paper we prove that $W_S\Omega_{X/R}^{\bullet}$ is the torsionless quotient of the usual de Rham complex $\Omega^{\bullet}_{W_S(X)/W_S(R)}$ on the singular scheme $W_S(X)$. This result was suggested by comparison with a similar modification of the de Rham complex in the theory of singular varieties.


title: Structured Neural Networks for Density Estimation and Causal Inference

abstract: Injecting structure into neural networks enables learning functions that satisfy invariances with respect to subsets of inputs. For instance, when learning generative models using neural networks, it is advantageous to encode the conditional independence structure of observed variables, often in the form of Bayesian networks. We propose the Structured Neural Network (StrNN), which injects structure through masking pathways in a neural network. The masks are designed via a novel relationship we explore between neural network architectures and binary matrix factorization, to ensure that the desired independencies are respected. We devise and study practical algorithms for this otherwise NP-hard design problem based on novel objectives that control the model architecture. We demonstrate the utility of StrNN in three applications: (1) binary and Gaussian density estimation with StrNN, (2) real-valued density estimation with Structured Autoregressive Flows (StrAFs) and Structured Continuous Normalizing Flows (StrCNF), and (3) interventional and counterfactual analysis with StrAFs for causal inference. Our work opens up new avenues for learning neural networks that enable data-efficient generative modeling and the use of normalizing flows for causal effect estimation.


title: Lessons learned while developing the Serenity-S1 ATCA card

abstract: The Serenity-S1 is a Xilinx Virtex Ultrascale+ based Advanced Telecommunications Computing Architecture (ATCA) processing blade that has been optimised for production. It incorporates many developments from the Serenity-A and Serenity-Z prototype cards and, where possible, adopts solutions being used across CERN. It also uses many new parts because commonly used parts have disappeared from the market during the semiconductor crisis, with only some returning. Improvements to simplify manufacture, the performance of new components, some of the more difficult aspects of procurement, the performance of production-grade Samtec 25\,Gb/s optical firefly parts, and issues with the rack cooling infrastructure are discussed.


title: Landau-Lifshitz-Navier-Stokes Equations: Large Deviations and Relationship to The Energy Equality

abstract: The dynamical large deviations principle for the three-dimensional incompressible Landau-Lifschitz-Navier-Stokes equations is shown, in the joint scaling regime of vanishing noise intensity and correlation length. This proves the consistency of the large deviations in lattice gas models \cite{QY}, with Landau-Lifschitz fluctuating hydrodynamics \cite{LL87}. Secondly, in the course of the proof, we unveil a novel relation between the validity of the deterministic energy equality for the deterministic forced Navier-Stokes equations and matching large deviations upper and lower bounds. In particular, we conclude that time-reversible uniqueness to the forced Navier-Stokes equations implies the validity of the energy equality, thus generalising the classical Lions-Ladyzhenskaya result. Thirdly, we prove that no non-trivial large deviations result can be true for local-in-time strong solutions.


title: Structural Properties of Search Trees with 2-way Comparisons

abstract: Optimal 3-way comparison search trees (3WCST's) can be computed using standard dynamic programming in time O(n^3), and this can be further improved to O(n^2) by taking advantage of the Monge property. In contrast, the fastest algorithm in the literature for computing optimal 2-way comparison search trees (2WCST's) runs in time O(n^4). To shed light on this discrepancy, we study structure properties of 2WCST's. On one hand, we show some new threshold bounds involving key weights that can be helpful in deciding which type of comparison should be at the root of the optimal tree. On the other hand, we also show that the standard techniques for speeding up dynamic programming (the Monge property / quadrangle inequality) do not apply to 2WCST's.


title: Multi-scale Time-stepping of Partial Differential Equations with Transformers

abstract: Developing fast surrogates for Partial Differential Equations (PDEs) will accelerate design and optimization in almost all scientific and engineering applications. Neural networks have been receiving ever-increasing attention and demonstrated remarkable success in computational modeling of PDEs, however; their prediction accuracy is not at the level of full deployment. In this work, we utilize the transformer architecture, the backbone of numerous state-of-the-art AI models, to learn the dynamics of physical systems as the mixing of spatial patterns learned by a convolutional autoencoder. Moreover, we incorporate the idea of multi-scale hierarchical time-stepping to increase the prediction speed and decrease accumulated error over time. Our model achieves similar or better results in predicting the time-evolution of Navier-Stokes equations compared to the powerful Fourier Neural Operator (FNO) and two transformer-based neural operators OFormer and Galerkin Transformer.


title: The Case for Controls: Identifying outbreak risk factors through case-control comparisons

abstract: Investigations of infectious disease outbreaks often focus on identifying place- and context-dependent factors responsible for emergence and spread, resulting in phenomenological narratives ill-suited to developing generalizable predictive and preventive measures. We contend that case-control hypothesis testing is a more powerful framework for epidemiological investigation. The approach, widely used in medical research, involves identifying counterfactuals, with case-control comparisons drawn to test hypotheses about the conditions that manifest outbreaks. Here we outline the merits of applying a case-control framework as epidemiological study design. We first describe a framework for iterative multidisciplinary interrogation to discover minimally sufficient sets of factors that can lead to disease outbreaks. We then lay out how case-control comparisons can respectively center on pathogen(s), factor(s), or landscape(s) with vignettes focusing on pathogen transmission. Finally, we consider how adopting case-control approaches can promote evidence-based decision making for responding to and preventing outbreaks.


title: State-Wise Safe Reinforcement Learning With Pixel Observations

abstract: In the context of safe exploration, Reinforcement Learning (RL) has long grappled with the challenges of balancing the tradeoff between maximizing rewards and minimizing safety violations, particularly in complex environments with contact-rich or non-smooth dynamics, and when dealing with high-dimensional pixel observations. Furthermore, incorporating state-wise safety constraints in the exploration and learning process, where the agent must avoid unsafe regions without prior knowledge, adds another layer of complexity. In this paper, we propose a novel pixel-observation safe RL algorithm that efficiently encodes state-wise safety constraints with unknown hazard regions through a newly introduced latent barrier-like function learning mechanism. As a joint learning framework, our approach begins by constructing a latent dynamics model with low-dimensional latent spaces derived from pixel observations. We then build and learn a latent barrier-like function on top of the latent dynamics and conduct policy optimization simultaneously, thereby improving both safety and the total expected return. Experimental evaluations on the safety-gym benchmark suite demonstrate that our proposed method significantly reduces safety violations throughout the training process, and demonstrates faster safety convergence compared to existing methods while achieving competitive results in reward return.


title: Towards Fairness-aware Crowd Management System and Surge Prevention in Smart Cities

abstract: Instances of casualties resulting from large crowds persist, highlighting the existing limitations of current crowd management practices in Smart Cities. One notable drawback is the insufficient provision for disadvantaged individuals who may require additional time to evacuate due to their slower running speed. Moreover, the existing escape strategies may fall short of ensuring the safety of all individuals during a crowd surge. To address these pressing concerns, this paper proposes two crowd management methodologies. Firstly, we advocate for implementing a fair evacuation strategy following a surge event, which considers the diverse needs of all individuals, ensuring inclusivity and mitigating potential risks. Secondly, we propose a preventative approach involving the adjustment of attraction locations and switching between stage performances in large-crowded events to minimize the occurrence of surges and enhance crowd dispersion. We used high-fidelity crowd management simulators to assess the effectiveness of our proposals. Our findings demonstrate the positive impact of the fair evacuation strategy on safety measures and inclusivity, which increases fairness by 41.8% on average. Furthermore, adjusting attraction locations and stage performances has shown a significant reduction in surges by 34% on average, enhancing overall crowd safety.


title: Two-Stage Cryogenic HEMT Based Amplifier For Low Temperature Detectors

abstract: To search for dark matter candidates with masses below $\mathcal{O}$(MeV), the SPLENDOR (Search for Particles of Light dark mattEr with Narrow-gap semiconDuctORs) experiment is developing novel narrow-bandgap semiconductors with electronic bandgaps on the order of 1-100 meV. In order to detect the charge signal produced by scattering or absorption events, SPLENDOR has designed a two-stage cryogenic HEMT-based amplifier with an estimated charge resolution approaching the single-electron level. A low-capacitance ($\sim$1.6 pF) HEMT is used as a buffer stage at $T=10\,\mathrm{mK}$ to mitigate effects of stray capacitance at the input. The buffered signal is then amplified by a higher-capacitance ($\sim$200 pF) HEMT amplifier stage at $T=4\,\mathrm{K}$. Importantly, the design of this amplifier makes it usable with any insulating material - allowing for rapid prototyping of a variety of novel detector materials. We present the two-stage cryogenic amplifier design, preliminary voltage noise performance, and estimated charge resolution of 7.2 electrons.


title: The first ground-based detection of the 752 GHz water line in local ultra-luminous infrared galaxies using APEX-SEPIA

abstract: We report the first ground-based detection of the water line p-H2O (211-202) at 752.033 GHz in three z < 0.08 ultra-luminous infrared galaxies (ULIRGs): IRAS 06035-7102, IRAS 17207-0014 and IRAS 09022-3615. Using the Atacama Pathfinder EXperiment (APEX), with its Swedish-ESO PI Instrument for APEX (SEPIA) band-9 receiver, we detect this H2O line with overall signal-to-noise ratios of 8-10 in all three galaxies. Notably, this is the first detection of this line in IRAS 06035-7102. Our new APEX-measured fluxes, between 145 to 705 Jy km s-1, are compared with previous values taken from Herschel SPIRE FTS. We highlight the great capabilities of APEX for resolving the H2O line profiles with high spectral resolutions while also improving by a factor of two the significance of the detection within moderate integration times. While exploring the correlation between the p-H2O(211-202) and the total infrared luminosity, our galaxies are found to follow the trend at the bright end of the local ULIRG's distribution. The p-H2O(211-202) line spectra are compared to the mid-J CO and HCN spectra, and dust continuum previously observed with ALMA. In the complex interacting system IRAS 09022-3615, the profile of the water emission line is offset in velocity with respect to the ALMA CO(J = 4 - 3) emission. For IRAS 17207-0014 and IRAS 06035-7102, the profiles between the water line and the CO lines are spectroscopically aligned. This pilot study demonstrates the feasibility of directly conducting ground-based high-frequency observations of this key water line, opening the possibility of detailed follow-up campaigns to tackle its nature.


title: A Gronwall Inequality Based Approach to Transient Stability Assessment for Power Grids

abstract: This paper proposes a novel Gronwall inequality-based method for transient stability assessment for power systems. The challenges of applying such methods to power systems are how to construct the differential inequality and how to treat its nonlinearity. By leveraging partial derivatives, a rotor angle difference inequality model is established, and the difficulty of nonlinearity of this model is solved by piecewise linearization. Based on our method, the upper bound of the rotor angle difference is given analytically, which can be used to estimate the stability boundary, i.e. the critical clearing time (CCT) of power systems. A case study on the IEEE 9-bus system shows the accuracy of the approach in early warning of transient instability for power grids.


title: Modeling Cancer Progression: An Integrated Workflow Extending Data-Driven Kinetic Models to Bio-Mechanical PDE Models

abstract: Computational modeling of cancer can help unveil dynamics and interactions that are hard to replicate experimentally. Thanks to the advancement in cancer databases and data analysis technologies, these models have become more robust than ever. There are many mathematical models which investigate cancer through different approaches, from sub-cellular to tissue scale, and from treatment to diagnostic points of view. In this study, we lay out a step-by-step methodology for a data-driven mechanistic model of the tumor microenvironment. We discuss data acquisition strategies, data preparation, parameter estimation, and sensitivity analysis techniques. Furthermore, we propose a possible approach to extend mechanistic ODE models to PDE models coupled with mechanical growth. The workflow discussed in this article can help understand the complex temporal and spatial interactions between cells and cytokines in the tumor microenvironment and their effect on tumor growth.


title: On quantum measurement

abstract: We propose a solution to the quantum measurement paradox by first identifying its classical counterpart.


title: Synchronous Observer Design for Inertial Navigation Systems with Almost-Global Convergence

abstract: An Inertial Navigation System (INS) is a system that integrates acceleration and angular velocity readings from an Inertial Measurement Unit (IMU), along with other sensors such as GNSS position, GNSS velocity, and magnetometer, to estimate the attitude, velocity, and position of a vehicle. This paper shows that the INS problem can be analysed using the automorphism group of the extended special Euclidean group: a group we term the extended similarity group. By exploiting this novel geometric framework, we propose an observer architecture with synchronous error dynamics; that is, the error is stationary if the observer correction terms are set to zero. In turn, this enables us to derive a modular, or plug-and-play, observer design for INS that allows different sensors to be added or removed depending on what is available in the vehicle sensor suite. We prove both almost-global asymptotic and local exponential stability of the error dynamics for the common scenario of at least IMU and GNSS position. To the authors' knowledge, this is the first non-linear observer design with almost global convergence guarantees or with plug-and-play modular capability. A simulation with extreme initial error demonstrates the almost-global robustness of the system. Real-world capability is demonstrated on data from a fixed-wing UAV, and the solution is compared to the state-of-the-art ArduPilot INS.


title: Decay estimates and continuation for the non-cutoff Boltzmann equation

abstract: We consider the non-cutoff Boltzmann equation in the spatially inhomogeneous, soft potentials regime, and establish decay estimates for large velocity. In particular, we prove that pointwise algebraically decaying upper bounds in the velocity variable are propagated forward in time whenever the solution has finite weighted $L^\infty_{t,x} L^p_v$-norms for certain $p$. The main novelty is that these estimates hold for any decay exponent above $\max\{2,3 + \gamma\} +2s$, where $\gamma$ and $s$ are standard physical parameters such that $\gamma \in (-3,0)$ and $s\in (0,1)$. Our results are useful even for solutions with mild decay. As an application, we combine our decay estimates with recent short-time existence results to derive a continuation criterion for large-data solutions. Compared to past results, this extends the range of allowable parameters and weakens the requirements on smoothness and decay in velocity of solutions.


title: Robust Fine-Tuning of Vision-Language Models for Domain Generalization

abstract: Transfer learning enables the sharing of common knowledge among models for a variety of downstream tasks, but traditional methods suffer in limited training data settings and produce narrow models incapable of effectively generalizing under distribution shifts. Foundation models have recently demonstrated impressive zero-shot inference capabilities and robustness under distribution shifts. However, zero-shot evaluation for these models has been predominantly confined to benchmarks with simple distribution shifts, limiting our understanding of their effectiveness under the more realistic shifts found in practice. Moreover, common fine-tuning methods for these models have yet to be evaluated against vision models in few-shot scenarios where training data is limited. To address these gaps, we present a new recipe for few-shot fine-tuning of the popular vision-language foundation model CLIP and evaluate its performance on challenging benchmark datasets with realistic distribution shifts from the WILDS collection. Our experimentation demonstrates that, while zero-shot CLIP fails to match performance of trained vision models on more complex benchmarks, few-shot CLIP fine-tuning outperforms its vision-only counterparts in terms of in-distribution and out-of-distribution accuracy at all levels of training data availability. This provides a strong incentive for adoption of foundation models within few-shot learning applications operating with real-world data. Code is available at https://github.com/mit-ll/robust-vision-language-finetuning


title: Explainable Authorship Identification in Cultural Heritage Applications: Analysis of a New Perspective

abstract: While a substantial amount of work has recently been devoted to enhance the performance of computational Authorship Identification (AId) systems, little to no attention has been paid to endowing AId systems with the ability to explain the reasons behind their predictions. This lacking substantially hinders the practical employment of AId methodologies, since the predictions returned by such systems are hardly useful unless they are supported with suitable explanations. In this paper, we explore the applicability of existing general-purpose eXplainable Artificial Intelligence (XAI) techniques to AId, with a special focus on explanations addressed to scholars working in cultural heritage. In particular, we assess the relative merits of three different types of XAI techniques (feature ranking, probing, factuals and counterfactual selection) on three different AId tasks (authorship attribution, authorship verification, same-authorship verification) by running experiments on real AId data. Our analysis shows that, while these techniques make important first steps towards explainable Authorship Identification, more work remains to be done in order to provide tools that can be profitably integrated in the workflows of scholars.


title: Canonical formulation for the thermodynamics of $sl_n$-invariant integrable spin chains

abstract: Integrable quantum spin chains display distinctive physical properties making them a laboratory to test and assess different states of matter. The study of the finite temperature properties is possible by use of the thermodynamic Bethe ansatz, however at the expense of dealing with non-linear integral equations for, in general, infinitely many auxiliary functions. The definition of an alternative finite set of auxiliary functions allowing for the complete description of their thermodynamic properties at finite temperature and fields has been elusive. Indeed, in the context of $sl_n$-invariant models satisfactory auxiliary functions have been established only for $n \leq 4$. In this paper we take a step further by proposing a systematic approach to generate finite sets of auxiliary functions for $sl_n$-invariant models. We refer to this construction as the canonical formulation. The numerical efficiency is illustrated for $n=5$, for which we present some of the thermodynamic properties of the corresponding spin chain.

categories: math-ph cond-mat.stat-mech cond-mat.str-el math.MP nlin.SI


title: Using DUCK-Net for Polyp Image Segmentation

abstract: This paper presents a novel supervised convolutional neural network architecture, "DUCK-Net", capable of effectively learning and generalizing from small amounts of medical images to perform accurate segmentation tasks. Our model utilizes an encoder-decoder structure with a residual downsampling mechanism and a custom convolutional block to capture and process image information at multiple resolutions in the encoder segment. We employ data augmentation techniques to enrich the training set, thus increasing our model's performance. While our architecture is versatile and applicable to various segmentation tasks, in this study, we demonstrate its capabilities specifically for polyp segmentation in colonoscopy images. We evaluate the performance of our method on several popular benchmark datasets for polyp segmentation, Kvasir-SEG, CVC-ClinicDB, CVC-ColonDB, and ETIS-LARIBPOLYPDB showing that it achieves state-of-the-art results in terms of mean Dice coefficient, Jaccard index, Precision, Recall, and Accuracy. Our approach demonstrates strong generalization capabilities, achieving excellent performance even with limited training data. The code is publicly available on GitHub: https://github.com/RazvanDu/DUCK-Net


title: Towards Machine Unlearning Benchmarks: Forgetting the Personal Identities in Facial Recognition Systems

abstract: Machine unlearning is a crucial tool for enabling a classification model to forget specific data that are used in the training time. Recently, various studies have presented machine unlearning algorithms and evaluated their methods on several datasets. However, most of the current machine unlearning algorithms have been evaluated solely on traditional computer vision datasets such as CIFAR-10, MNIST, and SVHN. Furthermore, previous studies generally evaluate the unlearning methods in the class-unlearning setup. Most previous work first trains the classification models and then evaluates the machine unlearning performance of machine unlearning algorithms by forgetting selected image classes (categories) in the experiments. Unfortunately, these class-unlearning settings might not generalize to real-world scenarios. In this work, we propose a machine unlearning setting that aims to unlearn specific instance that contains personal privacy (identity) while maintaining the original task of a given model. Specifically, we propose two machine unlearning benchmark datasets, MUFAC and MUCAC, that are greatly useful to evaluate the performance and robustness of a machine unlearning algorithm. In our benchmark datasets, the original model performs facial feature recognition tasks: face age estimation (multi-class classification) and facial attribute classification (binary class classification), where a class does not depend on any single target subject (personal identity), which can be a realistic setting. Moreover, we also report the performance of the state-of-the-art machine unlearning methods on our proposed benchmark datasets. All the datasets, source codes, and trained models are publicly available at https://github.com/ndb796/MachineUnlearning.


title: Rolling spheres and the Willmore energy

abstract: The Willmore energy plays a central role in the conformal geometry of surfaces in the conformal 3-sphere \(S^3\). It also arises as the leading term in variational problems ranging from black holes, to elasticity, and cell biology. In the computational setting a discrete version of the Willmore energy is desired. Ideally it should have the same symmetries as the smooth formulation. Such a M\"obius invariant discrete Willmore energy for simplicial surfaces was introduced by Bobenko. In the present paper we provide a new geometric interpretation of the discrete energy as the curvature of a rolling spheres connection in analogy to the smooth setting where the curvature of a connection induced by the mean curvature sphere congruence gives the Willmore integrand. We also show that the use of a particular projective quaternionic representation of all relevant quantities gives clear geometric interpretations which are manifestly M\"obius invariant.


title: Democratic Policy Development using Collective Dialogues and AI

abstract: We design and test an efficient democratic process for developing policies that reflect informed public will. The process combines AI-enabled collective dialogues that make deliberation democratically viable at scale with bridging-based ranking for automated consensus discovery. A GPT4-powered pipeline translates points of consensus into representative policy clauses from which an initial policy is assembled. The initial policy is iteratively refined with the input of experts and the public before a final vote and evaluation. We test the process three times with the US public, developing policy guidelines for AI assistants related to medical advice, vaccine information, and wars & conflicts. We show the process can be run in two weeks with 1500+ participants for around $10,000, and that it generates policy guidelines with strong public support across demographic divides. We measure 75-81% support for the policy guidelines overall, and no less than 70-75% support across demographic splits spanning age, gender, religion, race, education, and political party. Overall, this work demonstrates an end-to-end proof of concept for a process we believe can help AI labs develop common-ground policies, governing bodies break political gridlock, and diplomats accelerate peace deals.


title: Equal Opportunity of Coverage in Fair Regression

abstract: We study fair machine learning (ML) under predictive uncertainty to enable reliable and trustworthy decision-making. The seminal work of ``equalized coverage'' proposed an uncertainty-aware fairness notion. However, it does not guarantee equal coverage rates across more fine-grained groups (e.g., low-income females) conditioning on the true label and is biased in the assessment of uncertainty. To tackle these limitations, we propose a new uncertainty-aware fairness -- Equal Opportunity of Coverage (EOC) -- that aims to achieve two properties: (1) coverage rates for different groups with similar outcomes are close, and (2) the coverage rate for the entire population remains at a predetermined level. Further, the prediction intervals should be narrow to be informative. We propose Binned Fair Quantile Regression (BFQR), a distribution-free post-processing method to improve EOC with reasonable width for any trained ML models. It first calibrates a hold-out set to bound deviation from EOC, then leverages conformal prediction to maintain EOC on a test set, meanwhile optimizing prediction interval width. Experimental results demonstrate the effectiveness of our method in improving EOC. Our code is publicly available at https://github.com/fangxin-wang/bfqr .


title: Solute mixing, dynamic uncertainty and effective dispersion in two-dimensional heterogeneous porous media

abstract: We study the mixing dynamics of a solute that is transported by advection and dispersion in a heterogeneous Darcy scale porous medium. We quantify mixing and dynamic uncertainty in terms of the mean squared solute concentration and the concentration variance. The latter measures the degree of mixing of the solute and at the same time the uncertainty around the mean concentration. Its evolution is controlled by the creation of concentration fluctuations due to solute spreading and its destruction by local dispersion. For moderate heterogeneity, this interplay can be quantified by using apparent and effective dispersion coefficients. For increasing heterogeneity we find deviations from the predicted behavior. In order to shed light on these behaviors and separate solute mixing and spreading, we decompose the solute plume into partial plumes, transport Green functions, and analyze their dynamics relative to those of the whole plume. This reveals that the variability in the dispersive scales of the Green functions in the plume and their interactions due to the strong focusing of preferential flow paths play an important role in highly heterogeneous porous media.


title: Fuss-Catalan numbers and planar partitions

abstract: We show how the Fuss-Catalan numbers $ \frac{1}{p n+1}\binom{pn+1}{n}$ enter different problems of counting simple and multiple planar partitions.


title: Intersection theorems for uniform subfamilies of hereditary families

abstract: A family $\mathcal C$ of sets is hereditary if whenever $A\in \mathcal C$ and $B\subset A$, we have $B\in \mathcal C$. Chv\'atal conjectured that the largest intersecting subfamily of a hereditary family is the family of all sets containing a fixed element. This is a generalization of the non-uniform Erd\H{o}s-Ko-Rado theorem. A natural uniform variant of this question, which is essentially a generalization for the uniform Erd\H{o}s-Ko-Rado theorem, was suggested by Borg: given a hereditary family $\mathcal C$, in which all maximal sets have size at least $n$, what is the largest intersecting subfamily of the family of all $k$-element sets in $\mathcal C$? The answer, of course, depends on $n$ and $k$, and Borg conjectured that for $n\ge 2k$ the it is again the family of all $k$-element sets containing a singleton. Borg proved this conjecture for $n\ge k^3$. He also considered a $t$-intersecting variant of the question. In this paper, we improve the bound on $n$ for both intersecting and $t$-intersecting cases, showing that for $n\ge Ckt\log^2\frac nk$ and $n\ge Ck\log k$ the largest $t$-intersecting subfamily of the $k$-th layer of a hereditary family with maximal sets of size at least $n$ is the family of all sets containing a fixed $t$-element set. We also prove a stability result.


title: PRISM: Progressive Restoration for Scene Graph-based Image Manipulation

abstract: Scene graphs have emerged as accurate descriptive priors for image generation and manipulation tasks, however, their complexity and diversity of the shapes and relations of objects in data make it challenging to incorporate them into the models and generate high-quality results. To address these challenges, we propose PRISM, a novel progressive multi-head image manipulation approach to improve the accuracy and quality of the manipulated regions in the scene. Our image manipulation framework is trained using an end-to-end denoising masked reconstruction proxy task, where the masked regions are progressively unmasked from the outer regions to the inner part. We take advantage of the outer part of the masked area as they have a direct correlation with the context of the scene. Moreover, our multi-head architecture simultaneously generates detailed object-specific regions in addition to the entire image to produce higher-quality images. Our model outperforms the state-of-the-art methods in the semantic image manipulation task on the CLEVR and Visual Genome datasets. Our results demonstrate the potential of our approach for enhancing the quality and precision of scene graph-based image manipulation.


title: COSMIC: Data Efficient Instruction-tuning For Speech In-Context Learning

abstract: We present a cost-effective method to integrate speech into a large language model (LLM), resulting in a Contextual Speech Model with Instruction-following/in-context-learning Capabilities (COSMIC) multi-modal LLM. Using GPT-3.5, we generate Speech Comprehension Test Question-Answer (SQA) pairs from speech transcriptions for supervised instruction tuning. With under 30 million trainable parameters and only 450 hours of English speech data, COSMIC demonstrates emerging capabilities in instruction-following and in-context learning. Equipped with such capabilities, COSMIC achieves a maximum 33.18 BLEU score in 0-shot EN-to-X speech to text translation (S2TT) and a significant boost in the 1-shot setting. Additionally, there is an average 25.8\% relative Word Error Rate (WER) reduction for 1-shot cross-domain adaptation. COSMIC exhibits a significant automatic speech recognition (ASR) accuracy gain in contextual biasing tasks due to its instruction-following capability.


title: MISO: Monitoring Inactivity of Single Older Adults at Home using RGB-D Technology

abstract: A new application for real-time monitoring of the lack of movement in older adults' own homes is proposed, aiming to support people's lives and independence in their later years. A lightweight camera monitoring system, based on an RGB-D camera and a compact computer processor, was developed and piloted in community homes to observe the daily behavior of older adults. Instances of body inactivity were detected in everyday scenarios anonymously and unobtrusively. These events can be explained at a higher level, such as a loss of consciousness or physiological deterioration. The accuracy of the inactivity monitoring system is assessed, and statistics of inactivity events related to the daily behavior of older adults are provided. The results demonstrate that our method achieves high accuracy in inactivity detection across various environments and camera views. It outperforms existing state-of-the-art vision-based models in challenging conditions like dim room lighting and TV flickering. However, the proposed method does require some ambient light to function effectively.


title: Efficient Scenario Generation for Chance-constrained Economic Dispatch Considering Ambient Wind Conditions

abstract: Scenario generation is an effective data-driven method for solving chance-constrained optimization while ensuring desired risk guarantees with a finite number of samples. Crucial challenges in deploying this technique in the real world arise due to the absence of appropriate risk-tuning models tailored for the desired application. In this paper, we focus on designing efficient scenario generation schemes for economic dispatch in power systems. We propose a novel scenario generation method based on filtering scenarios using ambient wind conditions. These filtered scenarios are deployed incrementally in order to meet desired risk levels while using minimum resources. In order to study the performance of the proposed scheme, we illustrate the procedure on case studies performed for both 24-bus and 118-bus systems with real-world wind power forecasting data. Numerical results suggest that the proposed filter-and-increment scenario generation model leads to a precise and efficient solution for the chance-constrained economic dispatch problem.


title: The Potential of Wearable Sensors for Assessing Patient Acuity in Intensive Care Unit (ICU)

abstract: Acuity assessments are vital in critical care settings to provide timely interventions and fair resource allocation. Traditional acuity scores rely on manual assessments and documentation of physiological states, which can be time-consuming, intermittent, and difficult to use for healthcare providers. Furthermore, such scores do not incorporate granular information such as patients' mobility level, which can indicate recovery or deterioration in the ICU. We hypothesized that existing acuity scores could be potentially improved by employing Artificial Intelligence (AI) techniques in conjunction with Electronic Health Records (EHR) and wearable sensor data. In this study, we evaluated the impact of integrating mobility data collected from wrist-worn accelerometers with clinical data obtained from EHR for developing an AI-driven acuity assessment score. Accelerometry data were collected from 86 patients wearing accelerometers on their wrists in an academic hospital setting. The data was analyzed using five deep neural network models: VGG, ResNet, MobileNet, SqueezeNet, and a custom Transformer network. These models outperformed a rule-based clinical score (SOFA= Sequential Organ Failure Assessment) used as a baseline, particularly regarding the precision, sensitivity, and F1 score. The results showed that while a model relying solely on accelerometer data achieved limited performance (AUC 0.50, Precision 0.61, and F1-score 0.68), including demographic information with the accelerometer data led to a notable enhancement in performance (AUC 0.69, Precision 0.75, and F1-score 0.67). This work shows that the combination of mobility and patient information can successfully differentiate between stable and unstable states in critically ill patients.


title: Room-Temperature CsPbBr$_3$ Mixed Polaritons States

abstract: Light-matter interactions are known to lead to the formation of polariton states through what is called strong coupling, leading to the formation of two hybrid states usually tagged as Upper and Lower Polaritons. Here, we consider a similar interaction between excitons and photons in the realm of strong interactions, with the difference that it enables us to obtain a mixed-polariton state. In this case, the energy of this mixed state is found between the energies of the exciton state and the cavity mode, resulting in an imaginary coupling coefficient related to a specific class of singular points. These mixed states are often considered unobservable, although they are predicted well when the dressed states of a two-level atom are considered. However, intense light confinement can be obtained by using a Bound State in the Continuum, reducing the damping rates, and enabling the observation of mixed states resulting from the correct kind of exceptional point giving place to strong coupling. In this study, using the Transfer Matrix Method, we simulated cavities made of porous silicon coupled with CsPbBr3 perovskite quantum dots to numerically observe the mixed states as well as experimentally, by fabricating appropriate samples. The dispersion relation of the mixed states is fitted using the same equation as that used for strong coupling but considering a complex coupling coefficient, which is directly related to the appropriate type of exceptional point.


title: Comparative Knowledge Distillation

abstract: In the era of large scale pretrained models, Knowledge Distillation (KD) serves an important role in transferring the wisdom of computationally heavy teacher models to lightweight, efficient student models while preserving performance. Traditional KD paradigms, however, assume readily available access to teacher models for frequent inference -- a notion increasingly at odds with the realities of costly, often proprietary, large scale models. Addressing this gap, our paper considers how to minimize the dependency on teacher model inferences in KD in a setting we term Few Teacher Inference Knowledge Distillation (FTI KD). We observe that prevalent KD techniques and state of the art data augmentation strategies fall short in this constrained setting. Drawing inspiration from educational principles that emphasize learning through comparison, we propose Comparative Knowledge Distillation (CKD), which encourages student models to understand the nuanced differences in a teacher model's interpretations of samples. Critically, CKD provides additional learning signals to the student without making additional teacher calls. We also extend the principle of CKD to groups of samples, enabling even more efficient learning from limited teacher calls. Empirical evaluation across varied experimental settings indicates that CKD consistently outperforms state of the art data augmentation and KD techniques.


title: Learning-Based and Quality Preserving Super-Resolution of Noisy Images

abstract: Several applications require the super-resolution of noisy images and the preservation of geometrical and texture features. State-of-the-art super-resolution methods do not account for noise and generally enhance the output image's artefacts (e.g., aliasing, blurring). We propose a learning-based method that accounts for the presence of noise and preserves the properties of the input image, as measured by quantitative metrics (e.g., normalised crossed correlation, normalised mean squared error, peak-signal-to-noise-ration, structural similarity feature-based similarity, universal image quality). We train our network to up-sample a low-resolution noisy image while preserving its properties. We perform our tests on the Cineca Marconi100 cluster, at the 26th position in the top500 list. The experimental results show that our method outperforms learning-based methods, has comparable results with standard methods, preserves the properties of the input image as contours, brightness, and textures, and reduces the artefacts. As average quantitative metrics, our method has a PSNR value of 23.81 on the super-resolution of Gaussian noise images with a 2X up-sampling factor. In contrast, previous work has a PSNR value of 23.09 (standard method) and 21.78 (learning-based method). Our learning-based and quality-preserving super-resolution improves the high-resolution prediction of noisy images with respect to state-of-the-art methods with different noise types and up-sampling factors.


title: Decks of rooted binary trees

abstract: We consider extremal problems related to decks and multidecks of rooted binary trees (a.k.a. rooted phylogenetic tree shapes). Here, the deck (resp. multideck) of a tree $T$ refers to the set (resp. multiset) of leaf induced binary subtrees of $T$. On the one hand, we consider the reconstruction of trees from their (multi)decks. We give lower and upper bounds on the minimum (multi)deck size required to uniquely encode a rooted binary tree on $n$ leaves. On the other hand, we consider problems related to deck cardinalities. In particular, we characterize trees with minimum-size as well as maximum-size decks. Finally, we present some exhaustive computations for $k$-universal trees, i.e., rooted binary trees that contain all $k$-leaf rooted binary trees as induced subtrees.


title: Image Recognition of Oil Leakage Area Based on Logical Semantic Discrimination

abstract: Implementing precise detection of oil leaks in peak load equipment through image analysis can significantly enhance inspection quality and ensure the system's safety and reliability. However, challenges such as varying shapes of oil-stained regions, background noise, and fluctuating lighting conditions complicate the detection process. To address this, the integration of logical rule-based discrimination into image recognition has been proposed. This approach involves recognizing the spatial relationships among objects to semantically segment images of oil spills using a Mask RCNN network. The process begins with histogram equalization to enhance the original image, followed by the use of Mask RCNN to identify the preliminary positions and outlines of oil tanks, the ground, and areas of potential oil contamination. Subsequent to this identification, the spatial relationships between these objects are analyzed. Logical rules are then applied to ascertain whether the suspected areas are indeed oil spills. This method's effectiveness has been confirmed by testing on images captured from peak power equipment in the field. The results indicate that this approach can adeptly tackle the challenges in identifying oil-contaminated areas, showing a substantial improvement in accuracy compared to existing methods.


title: Detection and Calibration of Low-Energy Nuclear Recoils for Dark Matter and Neutrino Scattering Experiments

abstract: Detection of low-energy nuclear recoil events plays a central role in searches for particle dark matter interactions with atomic matter and studies of coherent neutrino scatters. Precise nuclear recoil calibration data allow the responses of these dark matter and neutrino detectors to be characterized and enable in situ evaluation of an experiment's sensitivity to anticipated signals. This article reviews the common methods for detection of nuclear recoil events and the wide variety of techniques that have been developed to calibrate detector response to nuclear recoils. We summarize the main experimental factors that are critical for accurate nuclear recoil calibrations, investigate mitigation strategies for different backgrounds and biases, and discuss how the presentation of calibration results can facilitate comparison between experiments. Lastly, we discuss the challenges for future nuclear recoil calibration efforts and the physics opportunities they may enable.


title: Learning Time-Invariant Representations for Individual Neurons from Population Dynamics

abstract: Neurons can display highly variable dynamics. While such variability presumably supports the wide range of behaviors generated by the organism, their gene expressions are relatively stable in the adult brain. This suggests that neuronal activity is a combination of its time-invariant identity and the inputs the neuron receives from the rest of the circuit. Here, we propose a self-supervised learning based method to assign time-invariant representations to individual neurons based on permutation-, and population size-invariant summary of population recordings. We fit dynamical models to neuronal activity to learn a representation by considering the activity of both the individual and the neighboring population. Our self-supervised approach and use of implicit representations enable robust inference against imperfections such as partial overlap of neurons across sessions, trial-to-trial variability, and limited availability of molecular (transcriptomic) labels for downstream supervised tasks. We demonstrate our method on a public multimodal dataset of mouse cortical neuronal activity and transcriptomic labels. We report > 35% improvement in predicting the transcriptomic subclass identity and > 20% improvement in predicting class identity with respect to the state-of-the-art.


title: Vanquishing volumetric locking in quadratic NURBS-based discretizations of nearly-incompressible linear elasticity: CAS elements

abstract: Quadratic NURBS-based discretizations of the Galerkin method suffer from volumetric locking when applied to nearly-incompressible linear elasticity. Volumetric locking causes not only smaller displacements than expected, but also large-amplitude spurious oscillations of normal stresses. Continuous-assumed-strain (CAS) elements have been recently introduced to remove membrane locking in quadratic NURBS-based discretizations of linear plane curved Kirchhoff rods (Casquero et al., CMAME, 2022). In this work, we propose two generalizations of CAS elements (named CAS1 and CAS2 elements) to overcome volumetric locking in quadratic NURBS-based discretizations of nearly-incompressible linear elasticity. CAS1 elements linearly interpolate the strains at the knots in each direction for the term in the variational form involving the first Lam\'e parameter while CAS2 elements linearly interpolate the dilatational strains at the knots in each direction. For both element types, a displacement vector with C1 continuity across element boundaries results in assumed strains with C0 continuity across element boundaries. In addition, the implementation of the two locking treatments proposed in this work does not require any additional global or element matrix operations such as matrix inversions or matrix multiplications. The locking treatments are applied at the element level and the nonzero pattern of the global stiffness matrix is preserved. The numerical examples solved in this work show that CAS1 and CAS2 elements, using either two or three Gauss-Legrendre quadrature points per direction, are effective locking treatments since they not only result in more accurate displacements for coarse meshes, but also remove the spurious oscillations of normal stresses.


title: Functional Central limit theorems for epidemic models with varying infectivity and waning immunity

abstract: We study an individual-based stochastic epidemic model in which infected individuals become susceptible again following each infection (generalized SIS model). Specifically, after each infection, the infectivity is a random function of the time elapsed since the infection, and each recovered individual loses immunity gradually (equivalently, becomes gradually susceptible) after some time according to a random susceptibility function. The epidemic dynamics is described by the average infectivity and susceptibility processes in the population together with the numbers of infected and susceptible/uninfected individuals. In \cite{forien-Zotsa2022stochastic}, a functional law of large numbers (FLLN) is proved as the population size goes to infinity, and asymptotic endemic behaviors are also studied. In this paper, we prove a functional central limit theorem (FCLT) for the stochastic fluctuations of the epidemic dynamics around the FLLN limit. The FCLT limit for the aggregate infectivity and susceptibility processes is given by a system of stochastic non-linear integral equation driven by a two-dimensional Gaussian process.


title: Phase and contrast moir\'e signatures in two-dimensional cone beam interferometry

abstract: Neutron interferometry has played a distinctive role in fundamental science and characterization of materials. Moir\'e neutron interferometers are candidate next-generation instruments: they offer microscopy-like magnification of the signal, enabling direct camera recording of interference patterns across the full neutron wavelength spectrum. Here we demonstrate the extension of phase-grating moir\'e interferometry to two-dimensional geometries. Our fork-dislocation phase gratings reveal phase singularities in the moir\'e pattern, and we explore orthogonal moir\'e patterns with two-dimensional phase-gratings. Our measurements of phase topologies and gravitationally induced phase shifts are in good agreement with theory. These techniques can be implemented in existing neutron instruments to advance interferometric analyses of emerging materials and precision measurements of fundamental constants.


title: Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs

abstract: In human-written articles, we often leverage the subtleties of text style, such as bold and italics, to guide the attention of readers. These textual emphases are vital for the readers to grasp the conveyed information. When interacting with large language models (LLMs), we have a similar need - steering the model to pay closer attention to user-specified information, e.g., an instruction. Existing methods, however, are constrained to process plain text and do not support such a mechanism. This motivates us to introduce PASTA - Post-hoc Attention STeering Approach, a method that allows LLMs to read text with user-specified emphasis marks. To this end, PASTA identifies a small subset of attention heads and applies precise attention reweighting on them, directing the model attention to user-specified parts. Like prompting, PASTA is applied at inference time and does not require changing any model parameters. Experiments demonstrate that PASTA can substantially enhance an LLM's ability to follow user instructions or integrate new knowledge from user inputs, leading to a significant performance improvement on a variety of tasks, e.g., an average accuracy improvement of 22% for LLAMA-7B. Our code is publicly available at https://github.com/QingruZhang/PASTA .


title: List Decoding of Tanner and Expander Amplified Codes from Distance Certificates

abstract: We develop new list decoding algorithms for Tanner codes and distance-amplified codes based on bipartite spectral expanders. We show that proofs exhibiting lower bounds on the minimum distance of these codes can be used as certificates discoverable by relaxations in the Sum-of-Squares (SoS) semidefinite programming hierarchy. Combining these certificates with certain entropic proxies to ensure that the solutions to the relaxations cover the entire list, then leads to algorithms for list decoding several families of codes up to the Johnson bound. We prove the following: - We show that the LDPC Tanner codes of Sipser-Spielman [IEEE Trans. Inf. Theory 1996] and Z\'{e}mor [IEEE Trans. Inf. Theory 2001] with alphabet size $q$, block-length $n$ and distance $\delta$, based on an expander graph with degree $d$, can be list-decoded up to distance $\mathcal{J}_q(\delta) - \epsilon$ in time $n^{O_{d,q}(1/\epsilon^4)}$, where $\mathcal{J}_q(\delta)$ denotes the Johnson bound. - We show that the codes obtained via the expander-based distance amplification procedure of Alon, Edmonds and Luby [FOCS 1995] can be list-decoded close to the Johnson bound using the SoS hierarchy, by reducing the list decoding problem to unique decoding of the base code. In particular, starting from \emph{any} base code unique-decodable up to distance $\delta$, one can obtain near-MDS codes with rate $R$ and distance $1-R - \epsilon$, list-decodable up to the Johnson bound in time $n^{O_{\epsilon, \delta}(1)}$. - We show that the locally testable codes of Dinur et al. [STOC 2022] with alphabet size $q$, block-length $n$ and distance $\delta$ based on a square Cayley complex with generator sets of size $d$, can be list-decoded up to distance $\mathcal{J}_q(\delta) - \epsilon$ in time $n^{O_{d,q}(1/\epsilon^{4})}$, where $\mathcal{J}_q(\delta)$ denotes the Johnson bound.


title: Algebraic geometry in tensor categories

abstract: We set up some foundations of generalised scheme theory related to new incompressible symmetric tensor categories. This is analogous to the relation between super schemes and the category of super vector spaces.


title: Not all layers are equally as important: Every Layer Counts BERT

abstract: This paper introduces a novel modification of the transformer architecture, tailored for the data-efficient pretraining of language models. This aspect is evaluated by participating in the BabyLM challenge, where our solution won both the strict and strict-small tracks. Our approach allows each transformer layer to select which outputs of previous layers to process. The empirical results verify the potential of this simple modification and show that not all layers are equally as important.


title: Multi-task Learning for Optical Coherence Tomography Angiography (OCTA) Vessel Segmentation

abstract: Optical Coherence Tomography Angiography (OCTA) is a non-invasive imaging technique that provides high-resolution cross-sectional images of the retina, which are useful for diagnosing and monitoring various retinal diseases. However, manual segmentation of OCTA images is a time-consuming and labor-intensive task, which motivates the development of automated segmentation methods. In this paper, we propose a novel multi-task learning method for OCTA segmentation, called OCTA-MTL, that leverages an image-to-DT (Distance Transform) branch and an adaptive loss combination strategy. The image-to-DT branch predicts the distance from each vessel voxel to the vessel surface, which can provide useful shape prior and boundary information for the segmentation task. The adaptive loss combination strategy dynamically adjusts the loss weights according to the inverse of the average loss values of each task, to balance the learning process and avoid the dominance of one task over the other. We evaluate our method on the ROSE-2 dataset its superiority in terms of segmentation performance against two baseline methods: a single-task segmentation method and a multi-task segmentation method with a fixed loss combination.


title: Interfacial Thermal Transport and Electrical Performance of Supercapacitors with Graphene/Carbon Nanotube Composite Electrodes

abstract: Advanced supercapacitors have great potential to transform how we store and utilize energy, leading to more efficient and sustainable energy systems. This study reveals the structural features influencing the interfacial thermal transport and electrical performances of supercapacitors, using the constant potential and constant charge molecular dynamics simulation techniques. Thermal and electrical properties were calculated for graphene/carbon nanotube composite electrodes and ionic liquid electrolytes with different nanotube diameter, number, layers, and alignments of the nanotubes. The effect of application of a constant potential on the Kapitza resistance is determined for the first time. The vertically aligned CNT structures exhibited higher electrical performance, while the horizontal arrangement showed better thermal performance. Optimum electrode configurations were identified by considering thermal and electrical performance, along with other design factors, such as structural stability, ease of manufacturing, and scalability. After considering all these factors, the horizontally stacked multi-layer CNT arrangement emerged as the optimal electrode structure. The insights gained from this study aid in comprehending the effects of variations in electrode structure, thereby enabling efficient supercapacitor electrode design.


title: LLMs-augmented Contextual Bandit

abstract: Contextual bandits have emerged as a cornerstone in reinforcement learning, enabling systems to make decisions with partial feedback. However, as contexts grow in complexity, traditional bandit algorithms can face challenges in adequately capturing and utilizing such contexts. In this paper, we propose a novel integration of large language models (LLMs) with the contextual bandit framework. By leveraging LLMs as an encoder, we enrich the representation of the context, providing the bandit with a denser and more informative view. Preliminary results on synthetic datasets demonstrate the potential of this approach, showing notable improvements in cumulative rewards and reductions in regret compared to traditional bandit algorithms. This integration not only showcases the capabilities of LLMs in reinforcement learning but also opens the door to a new era of contextually-aware decision systems.


title: All Hurwitz Algebras from 3D Geometric Algebras

abstract: Hurwitz algebras are unital composition algebras widely known in algebra and mathematical physics for their useful applications. In this paper, inspired by works of Lesenby and Hitzer, we show how to embed all seven Hurwitz algebras (division and split) in 3D geometric algebras, i.e. $\mathcal{G}\left(p,q\right)$ with $p+q=3$. This is achieved studying the even subalgebra, which is always of quaternionic or split-quaternionic type, and the algebra generated by the pseudoscalar which is always of complex or split-complex type. Reversion, inversion and Clifford conjugation correspond to biquaternionic, complex and quaternionic conjugation respectively. Octonionic algebras, i.e., octonions and split-octonions, are obtained in two ways introducing two different products, replicating a variation of the Cayley-Dickson process. Octonionic conjugation is achieved in the geometric algebra formalism through the involution defined by the full grade inversion.