title: Ultra-light Dark Matter Limits from Astrophysical Neutrino Flavor

abstract: Ultra-light dark matter is a class of dark matter models where the mass of the dark matter particle is very small and the dark matter behaves as a classical field pervading our galaxy. If astrophysical neutrinos interact with ultra-light dark matter, these interactions would produce a matter potential in our galaxy which may cause anomalous flavor conversions. Recently, IceCube high-energy starting event flavor measurements are used to set stringent limits on isotropic Lorentz violating fields under the Standard-Model Extension framework. We apply the IceCube Lorentz violation limits to set limits on neutrino - ultra-light dark matter couplings. We assume the dark matter field undergoes fast oscillations in our galaxy, yielding neutrino interactions with dark matter that broaden and smear the observed flavor structure of astrophysical neutrinos at IceCube. The constraints we obtain are an order of magnitude tighter than current and future terrestrial neutrino experimental limits. The sensitivity of ultra-light dark matter can be further improved in the near future by new particle identification algorithms in IceCube and the emergence of next-generation neutrino telescopes.


title: A Concise Tiling Strategy for Preserving Spatial Context in Earth Observation Imagery

abstract: We propose a new tiling strategy, Flip-n-Slide, which has been developed for specific use with large Earth observation satellite images when the location of objects-of-interest (OoI) is unknown and spatial context can be necessary for class disambiguation. Flip-n-Slide is a concise and minimalistic approach that allows OoI to be represented at multiple tile positions and orientations. This strategy introduces multiple views of spatio-contextual information, without introducing redundancies into the training set. By maintaining distinct transformation permutations for each tile overlap, we enhance the generalizability of the training set without misrepresenting the true data distribution. Our experiments validate the effectiveness of Flip-n-Slide in the task of semantic segmentation, a necessary data product in geophysical studies. We find that Flip-n-Slide outperforms the previous state-of-the-art augmentation routines for tiled data in all evaluation metrics. For underrepresented classes, Flip-n-Slide increases precision by as much as 15.8%.


title: GPU-Based Parallel Computing Methods for Medical Photoacoustic Image Reconstruction

abstract: Recent years have witnessed a rapid advancement in GPU technology, establishing it as a formidable high-performance parallel computing technology with superior floating-point computational capabilities compared to traditional CPUs. This paper explores the application of this technology in the field of photoacoustic imaging, an emerging non-destructive testing technique in biomedical engineering characterized by its high contrast, resolution, and penetration depth. We conduct a data parallelism analysis targeting the computationally intensive image reconstruction segment of photoacoustic imaging. By parallelizing the serial code for iterative reconstruction and optimizing memory access, we achieve significant improvements in processing speed. Our experiments compare the imaging speeds of vascular images reconstructed using CPUs and GPUs, with the results visualized using Matlab. The findings demonstrate that, while maintaining data accuracy, GPU parallel computing methods can markedly accelerate photoacoustic image reconstruction. This acceleration has the potential to facilitate the broader adoption of photoacoustic imaging in applications such as hemodynamic monitoring, clinical disease diagnosis, and drug development.


title: Decreasing Wages in Gig Economy: A Game Theoretic Explanation Using Mathematical Program Networks

abstract: Gig economy consists of two market groups connected via an intermediary. Popular examples are rideshares where passengers and drivers are mediated via platforms such as Uber and Lyft. In a duopoly market, the platforms must compete to attract not only the passengers by providing a lower rate but also the drivers by providing better wages. While this should indicate better driver payout, as platforms compete to attract the driver pool, real world statistics does not indicate such. This goes completely against the intuition that the worker side of a gig economy, given their importance, should always earn better. We attempt to answer the low wages of drivers in the gig economy by modeling the ridesharing game between duopoly platforms, drivers, and passengers using Mathematical Program Networks. Our model is parsimonious, expressive, models the same-side and cross-side externalities of the economy, and has interpretations under both single-homing and multi-homing regimes. We derive the conditions for the existence of a profitable duopoly and show that it can only happen if the platforms collude together to pay the bare minimum to the drivers. This not only answers why drivers are paid less but also provides strong managerial insights to any interested policy maker.


title: A preconditioner for solving linear programming problems with dense columns

abstract: The Interior-Point Methods are a class for solving linear programming problems that rely upon the solution of linear systems. At each iteration, it becomes important to determine how to solve these linear systems when the constraint matrix of the linear programming problem includes dense columns. In this paper, we propose a preconditioner to handle linear programming problems with dense columns, and we prove theoretically that the final linear system to solve is uniformly bounded when the Interior-Point Method is converging to an optimal solution. This result is illustrated through computational experiments, which show that our proposed method is robust and competitive in terms of running time and/or number of iterations compared with existing methods.


title: The Relationship between Consumer Theories with and without Utility Maximization

abstract: To study the assumption that the utility maximization hypothesis implicitly adds to consumer theory, we consider a mathematical representation of pre-marginal revolution consumer theory based on subjective exchange ratios. We introduce two axioms on subjective exchange ratio, and show that both axioms hold if and only if consumer behavior is consistent with the utility maximization hypothesis. Moreover, we express the process for a consumer to find the transaction stopping point in terms of differential equations, and prove that the conditions for its stability are equal to the two axioms introduced in the above argument. Therefore, the consumer can find his/her transaction stopping point if and only if his/her behavior is consistent with the utility maximization hypothesis. In addition to these results, we discuss equivalence conditions for axioms to evaluate their mathematical strength, and methods for expressing the theory of subjective exchange ratios in terms of binary relations.


title: Self-trapping of active particles induced by non-reciprocal interactions in disordered media

abstract: Disordered media is known to modify the transport properties of active matter depending on interactions between particles and with the substrate. Here we study systems of active particles with visual-like perception that co-align with the positions of perceived conspecifics, and anti-align with positions of static obstacles. We report a novel self-trapping mechanism of particles forming closed loops that progressively shrink, surrounding one or multiple obstacles.This mechanism corresponds to a pinning behavior preventing particle diffusion. Increased co-alignment strength is found to reduce loop shrinking time, although this effect reaches a plateau at higher strengths. Loops are found to initially exhibit local polar order, but eventually they transition to nematic states as they absorb more particles. We show a phase diagram demonstrating self-trapping occurs within a specific range of aperture angles of the vision cone.


title: LLMem: Estimating GPU Memory Usage for Fine-Tuning Pre-Trained LLMs

abstract: Fine-tuning pre-trained large language models (LLMs) with limited hardware presents challenges due to GPU memory constraints. Various distributed fine-tuning methods have been proposed to alleviate memory constraints on GPU. However, determining the most effective method for achieving rapid fine-tuning while preventing GPU out-of-memory issues in a given environment remains unclear. To address this challenge, we introduce LLMem, a solution that estimates the GPU memory consumption when applying distributed fine-tuning methods across multiple GPUs and identifies the optimal method. We conduct GPU memory usage estimation prior to fine-tuning, leveraging the fundamental structure of transformer-based decoder models and the memory usage distribution of each method. Experimental results show that LLMem accurately estimates peak GPU memory usage on a single GPU, with error rates of up to 1.6%. Additionally, it shows an average error rate of 3.0% when applying distributed fine-tuning methods to LLMs with more than a billion parameters on multi-GPU setups.


title: Shears: Unstructured Sparsity with Neural Low-rank Adapter Search

abstract: Recently, several approaches successfully demonstrated that weight-sharing Neural Architecture Search (NAS) can effectively explore a search space of elastic low-rank adapters (LoRA), allowing the parameter-efficient fine-tuning (PEFT) and compression of large language models. In this paper, we introduce a novel approach called Shears, demonstrating how the integration of cost-effective sparsity and a proposed Neural Low-rank adapter Search (NLS) algorithm can further improve the efficiency of PEFT approaches. Results demonstrate the benefits of Shears compared to other methods, reaching high sparsity levels while improving or with little drop in accuracy, utilizing a single GPU for a pair of hours.


title: Molecular relaxation by reverse diffusion with time step prediction

abstract: Molecular relaxation, finding the equilibrium state of a non-equilibrium structure, is an essential component of computational chemistry to understand reactivity. Classical force field methods often rely on insufficient local energy minimization, while neural network force field models require large labeled datasets encompassing both equilibrium and non-equilibrium structures. As a remedy, we propose MoreRed, molecular relaxation by reverse diffusion, a conceptually novel and purely statistical approach where non-equilibrium structures are treated as noisy instances of their corresponding equilibrium states. To enable the denoising of arbitrarily noisy inputs via a generative diffusion model, we further introduce a novel diffusion time step predictor. Notably, MoreRed learns a simpler pseudo potential energy surface instead of the complex physical potential energy surface. It is trained on a significantly smaller, and thus computationally cheaper, dataset consisting of solely unlabeled equilibrium structures, avoiding the computation of non-equilibrium structures altogether. We compare MoreRed to classical force fields, equivariant neural network force fields trained on a large dataset of equilibrium and non-equilibrium data, as well as a semi-empirical tight-binding model. To assess this quantitatively, we evaluate the root-mean-square deviation between the found equilibrium structures and the reference equilibrium structures as well as their DFT energies.

categories: physics.chem-ph cs.LG physics.comp-ph stat.ML


title: Beam Training in mmWave Vehicular Systems: Machine Learning for Decoupling Beam Selection

abstract: Codebook-based beam selection is one approach for configuring millimeter wave communication links. The overhead required to reconfigure the transmit and receive beam pair, though, increases in highly dynamic vehicular communication systems. Location information coupled with machine learning (ML) beam recommendation is one way to reduce the overhead of beam pair selection. In this paper, we develop ML-based location-aided approaches to decouple the beam selection between the user equipment (UE) and the base station (BS). We quantify the performance gaps due to decoupling beam selection and also disaggregating the UE's location information from the BS. Our simulation results show that decoupling beam selection with available location information at the BS performs comparable to joint beam pair selection at the BS. Moreover, decoupled beam selection without location closely approaches the performance of beam pair selection at the BS when sufficient beam pairs are swept.


title: A Universal Property of the Spectrum of a Ring and the Semiring of its Ideals

abstract: Arithmetic valuations are intimately connected with the structure of the ideals of a commutative ring. We show how the generalized idempotent semiring valuations of Jeffrey and Noah Giansiracusa can be used to make this connection explicit. Through this generalized valuation theory sufficiently complete positive valuations give rise to Galois correspondences with the lattice of ideals of a commutative ring. Up to isomorphism the semiring of ideals of a commutative ring can be defined as a universal factoring semiring for positive valuations. We then further show that this valuation theory can formally connect Joyal's \textit{notion de z\'eros} and universal property of the spectrum of a ring to arithmetic valuation theory. We show that up to isomorphism as a coframe, the closed Zariski topology on a spectrum of a commutative ring can be defined as the universal factoring semiring of additively and multiplicatively idempotent valuations.


title: Safety-critical Autonomous Inspection of Distillation Columns using Quadrupedal Robots Equipped with Roller Arms

abstract: This paper proposes a comprehensive framework designed for the autonomous inspection of complex environments, with a specific focus on multi-tiered settings such as distillation column trays. Leveraging quadruped robots equipped with roller arms, and through the use of onboard perception, we integrate essential motion components including: locomotion, safe and dynamic transitions between trays, and intermediate motions that bridge a variety of motion primitives. Given the slippery and confined nature of column trays, it is critical to ensure safety of the robot during inspection, therefore we employ a safety filter and footstep re-planning based upon control barrier function representations of the environment. Our framework integrates all system components into a state machine encoding the developed safety-critical planning and control elements to guarantee safety-critical autonomy, enabling autonomous and safe navigation and inspection of distillation columns. Experimental validation in an environment, consisting of industrial-grade chemical distillation trays, highlights the effectiveness of our multi-layered architecture.


title: More Room for Language: Investigating the Effect of Retrieval on Language Models

abstract: Retrieval-augmented language models pose a promising alternative to standard language modeling. During pretraining, these models search in a corpus of documents for contextually relevant information that could aid the language modeling objective. We introduce an 'ideal retrieval' methodology to study these models in a fully controllable setting. We conduct an extensive evaluation to examine how retrieval augmentation affects the behavior of the underlying language model. Among other things, we observe that these models: i) save substantially less world knowledge in their weights, ii) are better at understanding local context and inter-word dependencies, but iii) are worse at comprehending global context.


title: Neuromorphic Vision-based Motion Segmentation with Graph Transformer Neural Network

abstract: Moving object segmentation is critical to interpret scene dynamics for robotic navigation systems in challenging environments. Neuromorphic vision sensors are tailored for motion perception due to their asynchronous nature, high temporal resolution, and reduced power consumption. However, their unconventional output requires novel perception paradigms to leverage their spatially sparse and temporally dense nature. In this work, we propose a novel event-based motion segmentation algorithm using a Graph Transformer Neural Network, dubbed GTNN. Our proposed algorithm processes event streams as 3D graphs by a series of nonlinear transformations to unveil local and global spatiotemporal correlations between events. Based on these correlations, events belonging to moving objects are segmented from the background without prior knowledge of the dynamic scene geometry. The algorithm is trained on publicly available datasets including MOD, EV-IMO, and \textcolor{black}{EV-IMO2} using the proposed training scheme to facilitate efficient training on extensive datasets. Moreover, we introduce the Dynamic Object Mask-aware Event Labeling (DOMEL) approach for generating approximate ground-truth labels for event-based motion segmentation datasets. We use DOMEL to label our own recorded Event dataset for Motion Segmentation (EMS-DOMEL), which we release to the public for further research and benchmarking. Rigorous experiments are conducted on several unseen publicly-available datasets where the results revealed that GTNN outperforms state-of-the-art methods in the presence of dynamic background variations, motion patterns, and multiple dynamic objects with varying sizes and velocities. GTNN achieves significant performance gains with an average increase of 9.4% and 4.5% in terms of motion segmentation accuracy (IoU%) and detection rate (DR%), respectively.


title: Viscous shock waves of Burgers equation with fast diffusion and singularity

abstract: In this paper, we study the asymptotic stability of viscous shock waves for Burgers' equation with fast diffusion $u_t+f(u)_x=\mu (u^m)_{xx}$ on $\mathbb{R} \times (0, +\infty)$ when $0<m<1$. For the proposed constant states $u_->u_+=0$, the equation with fast diffusion $(u^m)_{xx}=m\left(\frac{u_x}{u^{1-m}}\right)_x$ processes a strong singularity at $u_+=0$, which causes the stability study to be challenging. We observe that, there exist two different types of viscous shocks, one is the non-degenerate shock satisfying Lax's entropy condition with fast algebraic decay to the singular state $u_+=0$, which causes much strong singularity to the system in the form of $m\left(\frac{u_x}{u^{1-m}}\right)_x$, and the other is the degenerate viscous shock with slow algebraic decay to $u_+=0$, which makes less strong singularity to the system. In order to overcome the singularity at $u_+=0$, we technically use the weighted energy method and develop a new strategy where the weights related to the shock waves are carefully selected, while the chosen weights for the non-degenerate case are stronger than the degenerate case. Numerical simulations are also carried out in different cases to illustrate and validate our theoretical results. In particular, we numerically approximate the solution for different value of $0<m<1$, and find that the shapes of shock waves become steeper when the singularity $\left(\frac{u_x}{u^{1-m}}\right)_x$ is stronger as $m\rightarrow 0$, which indicates that the effect of singular fast diffusion on the solution is essential.


title: What Hides behind Unfairness? Exploring Dynamics Fairness in Reinforcement Learning

abstract: In sequential decision-making problems involving sensitive attributes like race and gender, reinforcement learning (RL) agents must carefully consider long-term fairness while maximizing returns. Recent works have proposed many different types of fairness notions, but how unfairness arises in RL problems remains unclear. In this paper, we address this gap in the literature by investigating the sources of inequality through a causal lens. We first analyse the causal relationships governing the data generation process and decompose the effect of sensitive attributes on long-term well-being into distinct components. We then introduce a novel notion called dynamics fairness, which explicitly captures the inequality stemming from environmental dynamics, distinguishing it from those induced by decision-making or inherited from the past. This notion requires evaluating the expected changes in the next state and the reward induced by changing the value of the sensitive attribute while holding everything else constant. To quantitatively evaluate this counterfactual concept, we derive identification formulas that allow us to obtain reliable estimations from data. Extensive experiments demonstrate the effectiveness of the proposed techniques in explaining, detecting, and reducing inequality in reinforcement learning. We publicly release code at https://github.com/familyld/InsightFair.


title: Unsupervised machine learning for the detection of exotic phases in skyrmion phase diagrams

abstract: Undoubtedly, machine learning techniques are being increasingly applied to a wide range of situations in the field of condensed matter. Amongst these techniques, unsupervised techniques are especially attractive, since they imply the possibility of extracting information from the data without previous labeling. In this work, we resort to the technique known as anomaly detection to explore potential exotic phases in skyrmion phase diagrams, using two different algorithms: Principal Component Analysis and Convolutional Autoencoder (CAE). First, we train these algorithms with an artificial dataset of skyrmion lattices constructed from an analytical parametrization, for different magnetizations, skyrmion lattice orientations, and skyrmion radii. We apply the trained algorithms to a set of snapshots obtained from Monte Carlo simulations for three ferromagnetic skyrmion models: two with in-plane Dzyaloshinskii-Moriya (DMI) in the triangular and kagome lattices, and one with an additional out of plane DMI in the kagome lattice. Then, we compare the root mean square error (RMSE) and the binary cross entropy between the input and output snapshots as a function of the external magnetic field and temperature. We find that the RMSE and its variance in the CAE case may be useful to not only detect exotic low temperature phases, but also to differentiate between the characteristic low temperature orderings of a skyrmion phase diagram (helical, skyrmions and ferromagnetic). Moreover, we apply the skyrmion trained CAE to two antiferromagnetic models in the triangular lattice, one that gives rise to antiferromagnetic skyrmions, and the pure exchange antiferromagnetic case. Despite the predictably larger RMSE, we find that, even in these cases, RMSE is also an indicator of different orderings and the emergence of particular features, such as the well-known pseudo-plateau in the pure exchange case.


title: Threat Behavior Textual Search by Attention Graph Isomorphism

abstract: Cyber attacks cause over \$1 trillion loss every year. An important task for cyber security analysts is attack forensics. It entails understanding malware behaviors and attack origins. However, existing automated or manual malware analysis can only disclose a subset of behaviors due to inherent difficulties (e.g., malware cloaking and obfuscation). As such, analysts often resort to text search techniques to identify existing malware reports based on the symptoms they observe, exploiting the fact that malware samples share a lot of similarity, especially those from the same origin. In this paper, we propose a novel malware behavior search technique that is based on graph isomorphism at the attention layers of Transformer models. We also compose a large dataset collected from various agencies to facilitate such research. Our technique outperforms state-of-the-art methods, such as those based on sentence embeddings and keywords by 6-14%. In the case study of 10 real-world malwares, our technique can correctly attribute 8 of them to their ground truth origins while using Google only works for 3 cases.


title: Dynamics of an oscillatory boundary layer over a sediment bed

abstract: We investigate the mechanisms by which a particle bed modifies the oscillatory boundary layer. We perform Euler-Lagrange simulations of an OBL over a particle bed at Reynolds numbers $\mathrm{Re}_{\delta}= 200$, 400, and 800, density ratio $\rho_p/\rho_f = 2.65$, maximum Shields numbers ranging from $1.42 \times 10^{-2}$ to $7.40 \times 10^{-2}$, Galileo number $\mathrm{Ga} = 51.9$, Stokes number ranging from 3.99 to 15.97, and Kuelegan-Carpenter number ranging from $1.7 \times 10^3$ to $6.8 \times 10^3$, and showed large modulation to the underlying boundary layer. We show two mechanisms of modification to the oscillatory boundary layer: (I) the permeability of the bed allows fluid flow to penetrate into the bed, introducing a slip velocity at the bed-fluid interface, an inflection point and the expansion of the boundary layer, and (II) for $\mathrm{Re}_{\delta} = 400$, and 800, particle motion creates an evolving bedform. For $\mathrm{Re}_{\delta} = 200$, particles are nearly motionless and the permeability of the bed drives the alteration of the velocity profile. The initial bed form drives velocity fluctuations not seen for flow over a smooth, impermeable wall. For Reynolds 400 and 800 particle momentum is associated with the peak velocity fluctuations, indicating that the particle feedback force contributes to velocity fluctuations. We show that the coefficient of friction, computed using the bed shear stress, is decreased by nearly half for Reynolds 200 and 400, and nearly an eighth for Reynolds 800.


title: Information encoding and decoding in in-vitro neural networks on micro electrode arrays through stimulation timing

abstract: A primary challenge in utilizing in-vitro biological neural networks for computations is finding good encoding and decoding schemes for inputting and decoding data to and from the networks. Furthermore, identifying the optimal parameter settings for a given combination of encoding and decoding schemes adds additional complexity to this challenge. In this study we explore stimulation timing as an encoding method, i.e. we encode information as the delay between stimulation pulses and identify the bounds and acuity of stimulation timings which produce linearly separable spike responses. We also examine the optimal readout parameters for a linear decoder in the form of epoch length, time bin size and epoch offset. Our results suggest that stimulation timings between 36 and 436ms may be optimal for encoding and that different combinations of readout parameters may be optimal at different parts of the evoked spike response.


title: Residual Connections Harm Abstract Feature Learning in Masked Autoencoders

abstract: We demonstrate that adding a weighting factor to decay the strength of identity shortcuts within residual networks substantially improves semantic feature learning in the state-of-the-art self-supervised masked autoencoding (MAE) paradigm. Our modification to the identity shortcuts within a VIT-B/16 backbone of an MAE boosts linear probing accuracy on ImageNet from 67.8% to 72.7%. This significant gap suggests that, while residual connection structure serves an essential role in facilitating gradient propagation, it may have a harmful side effect of reducing capacity for abstract learning by virtue of injecting an echo of shallower representations into deeper layers. We ameliorate this downside via a fixed formula for monotonically decreasing the contribution of identity connections as layer depth increases. Our design promotes the gradual development of feature abstractions, without impacting network trainability. Analyzing the representations learned by our modified residual networks, we find correlation between low effective feature rank and downstream task performance.


title: First double-differential cross section measurement of neutral-current $\pi^0$ production in neutrino-argon scattering in the MicroBooNE detector

abstract: We report the first double-differential cross section measurement of neutral-current neutral pion (NC$\pi^0$) production in neutrino-argon scattering, as well as single-differential measurements of the same channel in terms of final states with and without protons. The kinematic variables of interest for these measurements are the $\pi^0$ momentum and the $\pi^0$ scattering angle with respect to the neutrino beam. A total of 4971 candidate NC$\pi^0$ events fully-contained within the MicroBooNE detector are selected using data collected at a mean neutrino energy of $\sim 0.8$ GeV from $6.4\times10^{20}$ protons on target from the Booster Neutrino Beam at the Fermi National Accelerator Laboratory. After extensive data-driven model validation to ensure unbiased unfolding, the Wiener-SVD method is used to extract nominal flux-averaged cross sections. The results are compared to predictions from commonly used neutrino event generators, which tend to overpredict the measured NC$\pi^0$ cross section, especially in the 0.2-0.5 GeV/c $\pi^0$ momentum range, at forward scattering angles, and when at least one proton is present in the final state. These measurements show sensitivity to a variety of features that complicate the description of NC$\pi^0$ production including the form factors describing the elementary neutrino interaction and the final state interactions of the outgoing particles in the residual argon nucleus. This data will help improve the modeling of NC$\pi^0$ production, which represents a major background in measurements of charge-parity violation in the neutrino sector and in searches for new physics beyond the Standard Model.


title: Human-Algorithm Collaborative Bayesian Optimization for Engineering Systems

abstract: Bayesian optimization has been successfully applied throughout Chemical Engineering for the optimization of functions that are expensive-to-evaluate, or where gradients are not easily obtainable. However, domain experts often possess valuable physical insights that are overlooked in fully automated decision-making approaches, necessitating the inclusion of human input. In this article we re-introduce the human back into the data-driven decision making loop by outlining an approach for collaborative Bayesian optimization. Our methodology exploits the hypothesis that humans are more efficient at making discrete choices rather than continuous ones and enables experts to influence critical early decisions. We apply high-throughput (batch) Bayesian optimization alongside discrete decision theory to enable domain experts to influence the selection of experiments. At every iteration we apply a multi-objective approach that results in a set of alternate solutions that have both high utility and are reasonably distinct. The expert then selects the desired solution for evaluation from this set, allowing for the inclusion of expert knowledge and improving accountability, whilst maintaining the advantages of Bayesian optimization. We demonstrate our approach across a number of applied and numerical case studies including bioprocess optimization and reactor geometry design, demonstrating that even in the case of an uninformed practitioner our algorithm recovers the regret of standard Bayesian optimization. Through the inclusion of continuous expert opinion, our approach enables faster convergence, and improved accountability for Bayesian optimization in engineering systems.


title: Algorithms for Computing the Augustin--Csisz\'ar Mutual Information and Lapidoth--Pfister Mutual Information

abstract: The Augustin--Csisz{\' a}r mutual information (MI) and Lapidoth--Pfister MI are well-known generalizations of the Shannon MI, but do not have known closed-form expressions, so they need to be calculated by solving optimization problems. In this study, we propose alternating optimization algorithms for computing these types of MI and present proofs of their global convergence properties. We also provide a novel variational characterization of the Augustin--Csisz{\' a}r MI that is similar to that of the Sibson MI.


abstract: We obtain some sharp $L^p$ weighted Fourier restriction estimates of the form $\|Ef\|_{L^p(B^{n+1}(0,R),Hdx)} \lessapprox R^{\beta}\|f\|_2$, where $E$ is the Fourier extension operator over the truncated paraboloid, and $H$ is a weight function on $\mathbb R^{n+1}$ which is $n$-dimensional up to scale $\sqrt R$.


title: Can Language Models Solve Olympiad Programming?

abstract: Computing olympiads contain some of the most challenging problems for humans, requiring complex algorithmic reasoning, puzzle solving, in addition to generating efficient code. However, it has been understudied as a domain to evaluate language models (LMs). In this paper, we introduce the USACO benchmark with 307 problems from the USA Computing Olympiad, along with high-quality unit tests, reference code, and official analyses for each problem. These resources enable us to construct and test a range of LM inference methods for competitive programming for the first time. We find GPT-4 only achieves a 8.7% pass@1 accuracy with zero-shot chain-of-thought prompting, and our best inference method improves it to 20.2% using a combination of self-reflection and retrieval over episodic knowledge. However, this is far from solving the benchmark. To better understand the remaining challenges, we design a novel human-in-the-loop study and surprisingly find that a small number of targeted hints enable GPT-4 to solve 13 out of 15 problems previously unsolvable by any model and method. Our benchmark, baseline methods, quantitative results, and qualitative analysis serve as an initial step toward LMs with grounded, creative, and algorithmic reasoning.


title: Limit points of $A_{\alpha}$-matrices of graphs

abstract: We study limit points of the spectral radii of $A_{\alpha}$-matrices of graphs. Adapting a method used by J. B. Shearer in 1989, we prove a density property of $A_{\alpha}$-limit points of caterpillars for $\alpha$ close to zero. Precisely, we show that for $\alpha \in [0, 1/2)$ there exists a positive number $\tau_2(\alpha)>2$ such that any value $\lambda> \tau_2(\alpha)$ is an $A_{\alpha}$-limit point. We also determine the existence of other intervals for which all its points are $A_{\alpha}$-limit points.


title: A computational account of the development and evolution of psychotic symptoms

abstract: The mechanisms of psychotic symptoms like hallucinations and delusions are often investigated in fully-formed illness, well after symptoms emerge. These investigations have yielded key insights, but are not well-positioned to reveal the dynamic forces underlying symptom formation itself. Understanding symptom development over time would allow us to identify steps in the pathophysiological process leading to psychosis, shifting the focus of psychiatric intervention from symptom alleviation to prevention. We propose a model for understanding the emergence of psychotic symptoms within the context of an adaptive, developing neural system. We will make the case for a pathophysiological process that begins with cortical hyperexcitability and bottom-up noise transmission, which engenders inappropriate belief formation via aberrant prediction error signaling. We will argue that this bottom-up noise drives learning about the (im)precision of new incoming sensory information because of diminished signal-to-noise ratio, causing an adaptive relative over-reliance on prior beliefs. This over-reliance on priors predisposes to hallucinations and covaries with hallucination severity. An over-reliance on priors may also lead to increased conviction in the beliefs generated by bottom-up noise and drive movement toward conversion to psychosis. We will identify predictions of our model at each stage, examine evidence to support or refute those predictions, and propose experiments that could falsify or help select between alternative elements of the overall model. Nesting computational abnormalities within longitudinal development allows us to account for hidden dynamics among the mechanisms driving symptom formation and to view established symptomatology as a point of equilibrium among competing biological forces.


title: The Traveling Tournament Problem: Improved Algorithms Based on Cycle Packing

abstract: The Traveling Tournament Problem (TTP) is a well-known benchmark problem in the field of tournament timetabling, which asks us to design a double round-robin schedule such that each pair of teams plays one game in each other's home venue, minimizing the total distance traveled by all $n$ teams ($n$ is even). TTP-$k$ is the problem with one more constraint that each team can have at most $k$-consecutive home games or away games. In this paper, we investigate schedules for TTP-$k$ and analyze the approximation ratio of the solutions. Most previous schedules were constructed based on a Hamiltonian cycle of the graph. We will propose a novel construction based on a $k$-cycle packing. Then, combining our $k$-cycle packing schedule with the Hamiltonian cycle schedule, we obtain improved approximation ratios for TTP-$k$ with deep analysis. The case where $k=3$, TTP-3, is one of the most investigated cases. We improve the approximation ratio of TTP-3 from $(1.667+\varepsilon)$ to $(1.598+\varepsilon)$, for any $\varepsilon>0$. For TTP-$4$, we improve the approximation ratio from $(1.750+\varepsilon)$ to $(1.700+\varepsilon)$. By a refined analysis of the Hamiltonian cycle construction, we also improve the approximation ratio of TTP-$k$ from $(\frac{5k-7}{2k}+\varepsilon)$ to $(\frac{5k^2-4k+3}{2k(k+1)}+\varepsilon)$ for any constant $k\geq 5$. Our methods can be extended to solve a variant called LDTTP-$k$ (TTP-$k$ where all teams are allocated on a straight line). We show that the $k$-cycle packing construction can achieve an approximation ratio of $(\frac{3k-3}{2k-1}+\varepsilon)$, which improves the approximation ratio of LDTTP-3 from $4/3$ to $(6/5+\varepsilon)$.


title: Challenges to Inflation in the Post-Planck Era

abstract: Space-based missions studying the cosmic microwave background (CMB) have progressively refined the parameter space in conventional models of inflation shortly ($\sim 10^{-37}$ seconds) after the big bang. While most inflationary scenarios proposed thus far in the context of GR have since been ruled out, the basic idea of inflation may still be tenable, albeit with several unresolved conundrums, such as conflicting initial conditions and inconsistencies with the measured CMB power spectrum. In the new slow-roll inflationary picture, inflation arising in plateau-like potentials requires an initiation beyond the Planck time. This delay may be consistent with the cutoff, $k_{\rm min}$, measured recently in the primordial power spectrum. However, the actual value of $k_{\rm min}$ would imply an initiation time too far beyond the big bang for inflation to solve the horizon problem. In this paper, we also describe several other undesirable consequences of this delay, including an absence of well motivated initial conditions and a significant difficulty providing a viable mechanism for properly quantizing the primordial fluctuations. Nevertheless, many of these inconsistencies may still be avoided if one introduces non-conventional modifications to inflation, such as a brief departure from slow-roll dynamics, possibly due to a dramatic change in the inflationary potential, inflation driven by multiple fields, or a non-minimal coupling to gravity. In addition, some of these difficulties could be mitigated via the use of alternative cosmologies based, e.g., on loop quantum gravity, which replaces the initial big-bang singularity with finite conditions at a bounce-like beginning.


title: Personalized Federated Learning via Stacking

abstract: Traditional Federated Learning (FL) methods typically train a single global model collaboratively without exchanging raw data. In contrast, Personalized Federated Learning (PFL) techniques aim to create multiple models that are better tailored to individual clients' data. We present a novel personalization approach based on stacked generalization where clients directly send each other privacy-preserving models to be used as base models to train a meta-model on private data. Our approach is flexible, accommodating various privacy-preserving techniques and model types, and can be applied in horizontal, hybrid, and vertically partitioned federations. Additionally, it offers a natural mechanism for assessing each client's contribution to the federation. Through comprehensive evaluations across diverse simulated data heterogeneity scenarios, we showcase the effectiveness of our method.


abstract: We obtain $L^p$ estimates of the maximal Schr\"odinger operator in $\mathbb R^n$ using polynomial partitioning, bilinear refined Strichartz estimates, and weighted restriction estimates.


title: On approximability of the Permanent of PSD matrices

abstract: We study the complexity of approximating the permanent of a positive semidefinite matrix $A\in \mathbb{C}^{n\times n}$. 1. We design a new approximation algorithm for $\mathrm{per}(A)$ with approximation ratio $e^{(0.9999 + \gamma)n}$, exponentially improving upon the current best bound of $e^{(1+\gamma-o(1))n}$ [AGOS17,YP22]. Here, $\gamma \approx 0.577$ is Euler's constant. 2. We prove that it is NP-hard to approximate $\mathrm{per}(A)$ within a factor $e^{(\gamma-\epsilon)n}$ for any $\epsilon>0$. This is the first exponential hardness of approximation for this problem. Along the way, we prove optimal hardness of approximation results for the $\|\cdot\|_{2\to q}$ ``norm'' problem of a matrix for all $-1 < q < 2$.


title: Uncertainty-Based Abstention in LLMs Improves Safety and Reduces Hallucinations

abstract: A major barrier towards the practical deployment of large language models (LLMs) is their lack of reliability. Three situations where this is particularly apparent are correctness, hallucinations when given unanswerable questions, and safety. In all three cases, models should ideally abstain from responding, much like humans, whose ability to understand uncertainty makes us refrain from answering questions we don't know. Inspired by analogous approaches in classification, this study explores the feasibility and efficacy of abstaining while uncertain in the context of LLMs within the domain of question-answering. We investigate two kinds of uncertainties, statistical uncertainty metrics and a distinct verbalized measure, termed as In-Dialogue Uncertainty (InDU). Using these uncertainty measures combined with models with and without Reinforcement Learning with Human Feedback (RLHF), we show that in all three situations, abstention based on the right kind of uncertainty measure can boost the reliability of LLMs. By sacrificing only a few highly uncertain samples we can improve correctness by 2% to 8%, avoid 50% hallucinations via correctly identifying unanswerable questions and increase safety by 70% up to 99% with almost no additional computational overhead.


title: Chernoff Bounds and Reverse Hypercontractivity on HDX

abstract: We prove optimal concentration of measure for lifted functions on high dimensional expanders (HDX). Let $X$ be a $k$-dimensional HDX. We show for any $i\leq k$ and $f:X(i)\to [0,1]$: \[\Pr_{s\in X(k)}\left[\left|\underset{{t\subseteq s}}{\mathbb{E}}[f(t)]-\mu\right|\geq\varepsilon\right]\leq exp\left(-\varepsilon^2\frac{k}{i}\right).\] Using this fact, we prove that high dimensional expanders are reverse hypercontractive, a powerful functional inequality from discrete analysis implying that for any sets $A,B \subset X(k)$, the probability a $\rho$-correlated pair passes between them is at least \[\Pr_{s,s' \sim T_\rho}[s \in A, s' \in B] \geq \Pr[A]^{O(1)} \Pr[B]^{O(1)}.\] Our results hold under weak spectral assumptions on $X$. Namely we prove exponential concentration of measure for any complex below the `Trickling-Down Threshold' (beyond which concentration may be arbitrarily poor), and optimal concentration for $\sqrt{k}$-skeletons of such complexes. We also show optimal bounds for the top dimension of stronger HDX among other settings. We leverage our inequalities to prove several new agreement testing theorems on high dimensional expanders, including a new 99%-regime test for subsets, and a variant of the `Z-test' achieving inverse exponential soundness under the stronger assumption of $\ell_\infty$-expansion. The latter gives rise to the first optimal testers beyond the complete complex and products, a stepping stone toward the use of HDX in strong soundness PCPs. We also give applications within expansion, analysis, combinatorics, and coding theory, including a proof that two-sided HDX have optimal geometric overlap (giving the first explicit bounded-degree construction), near-optimal double samplers, new super-exponential degree lower bounds for certain HDX, distance-amplified list-decodable and locally testable codes, a Frankl-R\"odl Theorem and more.


title: Eulerian $k$-dominating reconfiguration graphs

abstract: For a graph $G$, the vertices of the $k$-dominating graph, denoted $\mathcal{D}_k(G)$, correspond to the dominating sets of $G$ with cardinality at most $k$. Two vertices of $\mathcal{D}_k(G)$ are adjacent if and only if the corresponding dominating sets in $G$ can be obtained from one other by adding or removing a single vertex of $G$. Since $\mathcal{D}_k(G)$ is not necessarily connected when $k < |V(G)|$, much research has focused on conditions under which $\mathcal{D}_k(G)$ is connected and recent work has explored the existence of Hamilton paths in the $k$-dominating graph. We consider the complementary problem of determining the conditions under which the $k$-dominating graph is Eulerian. In the case where $k = |V(G)|$, we characterize those graphs $G$ for which $\mathcal{D}_k(G)$ is Eulerian. In the case where $k$ is restricted, we determine for a number of graph classes, the conditions under which the $k$-dominating graph is Eulerian.


title: Dose rate dependence of TID damage to 65 nm CMOS transistors in X-ray irradiations of the ATLAS ITk Pixel ASIC (ITkPix)

abstract: The ATLAS Inner Tracker (ITk) upgrade for the High-Luminosity LHC (HL-LHC) requires a radiation-tolerant pixel readout chip, which must withstand a total ionising dose (TID) of up to 1 Grad. The readout ASIC for the ITk upgrade has been designed by the RD53 collaboration using 65 nm CMOS technology. In order to characterise the radiation tolerance of the chip digital logic, the RD53 ASICs include ring oscillators, which can be used to measure gate delay degradation. Extensive X-ray irradiation studies of the ring oscillators have been performed on the ITk Pixel pre-production readout ASIC, ITkPixV1. A dependence of radiation damage on dose rate has been observed in 65 nm CMOS technology. This paper aims to quantify the dose rate dependence of TID damage to the ITkPix ring oscillators and, therefore, the ITkPix ASIC digital logic. X-ray irradiations at different dose rates between 20 krad/h and 30 Mrad/h are compared. A dose rate dependence is observed, with 2-3 times more damage at the lowest dose rate of 20 krad/h, compared to 4 Mrad/h. The dose rate dependence was also observed to be dependent on transistor size and type.


title: Drawing Competitive Districts in Redistricting

abstract: In the process of redistricting, one important metric is the number of competitive districts, that is, districts where both parties have a reasonable chance of winning a majority of votes. Competitive districts are important for achieving proportionality, responsiveness, and other desirable qualities; some states even directly list competitiveness in their legally-codified districting requirements. In this work, we discuss the problem of drawing plans with at least a fixed number of competitive districts. In addition to the standard, ``vote-band'' measure of competitivenesss (i.e., how close was the last election?), we propose a measure that explicitly considers ``swing voters'' - the segment of the population that may choose to vote either way, or not vote at all, in a given election. We present two main, contrasting results. First, from a computational complexity perspective, we show that the task of drawing plans with competitive districts is NP-hard, even on very natural instances where the districting task itself is easy (e.g., small rectangular grids of population-balanced cells). Second, however, we show that a simple hill-climbing procedure can in practice find districtings on real states in which all the districts are competitive. We present the results of the latter on the precinct-level graphs of the U.S. states of North Carolina and Arizona, and discuss trade-offs between competitiveness and other desirable qualities.


title: IMIL: Interactive Medical Image Learning Framework

abstract: Data augmentations are widely used in training medical image deep learning models to increase the diversity and size of sparse datasets. However, commonly used augmentation techniques can result in loss of clinically relevant information from medical images, leading to incorrect predictions at inference time. We propose the Interactive Medical Image Learning (IMIL) framework, a novel approach for improving the training of medical image analysis algorithms that enables clinician-guided intermediate training data augmentations on misprediction outliers, focusing the algorithm on relevant visual information. To prevent the model from using irrelevant features during training, IMIL will 'blackout' clinician-designated irrelevant regions and replace the original images with the augmented samples. This ensures that for originally mispredicted samples, the algorithm subsequently attends only to relevant regions and correctly correlates them with the respective diagnosis. We validate the efficacy of IMIL using radiology residents and compare its performance to state-of-the-art data augmentations. A 4.2% improvement in accuracy over ResNet-50 was observed when using IMIL on only 4% of the training set. Our study demonstrates the utility of clinician-guided interactive training to achieve meaningful data augmentations for medical image analysis algorithms.


title: Domain-Specific Block Selection and Paired-View Pseudo-Labeling for Online Test-Time Adaptation

abstract: Test-time adaptation (TTA) aims to adapt a pre-trained model to a new test domain without access to source data after deployment. Existing approaches typically rely on self-training with pseudo-labels since ground-truth cannot be obtained from test data. Although the quality of pseudo labels is important for stable and accurate long-term adaptation, it has not been previously addressed. In this work, we propose DPLOT, a simple yet effective TTA framework that consists of two components: (1) domain-specific block selection and (2) pseudo-label generation using paired-view images. Specifically, we select blocks that involve domain-specific feature extraction and train these blocks by entropy minimization. After blocks are adjusted for current test domain, we generate pseudo-labels by averaging given test images and corresponding flipped counterparts. By simply using flip augmentation, we prevent a decrease in the quality of the pseudo-labels, which can be caused by the domain gap resulting from strong augmentation. Our experimental results demonstrate that DPLOT outperforms previous TTA methods in CIFAR10-C, CIFAR100-C, and ImageNet-C benchmarks, reducing error by up to 5.4%, 9.1%, and 2.9%, respectively. Also, we provide an extensive analysis to demonstrate effectiveness of our framework. Code is available at https://github.com/gist-ailab/domain-specific-block-selection-and-paired-view-pseudo-labeling-for-online-TTA.


title: Tinker or Transfer? A Tale of Two Techniques in Teaching Visualization

abstract: In education there exists a tension between two modes of learning: traditional lecture-based instruction and more tinkering-based creative learning. In this paper, we outline our efforts as two Ph.D. students (who are skilled in visualization but are not, importantly, professionally trained visualization experts) to implement creative learning activities in an information visualization course in our home department. We describe our motivation for doing so, and how what began out of necessity turned into an endeavor whose utility we strongly believe in. In implementing these activities, we received largely positive reviews from students, along with constructive feedback which helped us iteratively improve the activities. Finally, we also detail our future plans for turning this work into a formal design inquiry with students to build a new class centered entirely around creative learning.


title: On Stability and Denominators of F-pure thresholds in Families of Diagonal Hypersurfaces

abstract: Given a prime number $p$ and a positive integer $m$, we provide a family of diagonal hypersurfaces $\{ f_n \}_{n = 1}^{\infty}$ in $m$ variables, for which the denominator of $\text{ fpt } (f_{n})$ (in lowest terms) is always $p$ and whose $F$-pure thresholds stabilize after a certain $n$. We also provide another family of diagonal hypersurfaces $\{ g_n \}_{n = 1}^{\infty}$ in $m$ variables, for which the power of $p$ in the denominator of $\text{ fpt } (g_{n})$ (in lowest terms) diverges to $\infty$ as $n \to \infty$. This behavior of the denominator of the $F$-pure thresholds is dependent on the congruence class of $p$ modulo the smallest two exponents of $\{ f_n \}$ and $\{ g_n \}$.


title: Integrated Communication, Navigation, and Remote Sensing in LEO Networks with Vehicular Applications

abstract: Traditionally, communication, navigation, and remote sensing (CNR) satellites are separately performed, leading to resource waste, information isolation, and independent optimization for each functionality. Taking future automated driving as an example, it faces great challenges in providing high-reliable and low-latency lane-level positioning, decimeter-level transportation observation, and huge traffic sensing information downloading. To this end, this article proposes an integrated CNR (ICNR) framework based on low earth orbit (LEO) satellite mega-constellations from the perspective of vehicular applications. After introducing the main working principles of the CNR functionalities to serve as the technological basis, we characterize the potentials of the integration gain in vehicular use cases. Then, we investigate the ICNR framework in different integration levels, which sheds strong light on qualitative performance improvement by sophisticatedly sharing orbit constellation, wireless resource, and data information towards meeting the requirements of vehicular applications. We also instantiate a fundamental numerical case study to demonstrate the integration gain and highlight the main tradeoffs in managing the ICNR networks from the perspective of vehicular applications.


title: Remote Breathing Monitoring Using LiDAR Technology

abstract: Breathing monitoring is crucial in healthcare for early detection of health issues, but traditional methods face challenges like invasiveness, privacy concerns, and limited applicability in daily settings. This paper introduces light detection and ranging (LiDAR) sensors as a remote, privacy-respecting alternative for monitoring breathing metrics, including inhalation/exhalation patterns, respiratory rates, breath depth, and detecting breathlessness. We highlight LiDARs ability to function across various postures, presenting empirical evidence of its accuracy and reliability. Our findings position LiDAR as an innovative solution in breathing monitoring, offering significant advantages over conventional methods.


title: Strategies for Machine Learning Applied to Noisy HEP Datasets: Modular Solid State Detectors from SuperCDMS

abstract: Background reduction in the SuperCDMS dark matter experiment depends on removing surface events within individual detectors by identifying the location of each incident particle interaction. Position reconstruction is achieved by combining pulse shape information over multiple phonon channels, a task well-suited to machine learning techniques. Data from an Am-241 scan of a SuperCDMS SNOLAB detector was used to study a selection of statistical approaches, including linear regression, artificial neural networks, and symbolic regression. Our results showed that simpler linear regression models were better able than artificial neural networks to generalize on such a noisy and minimal data set, but there are indications that certain architectures and training configurations can counter overfitting tendencies. This study will be repeated on a more complete SuperCDMS data set (in progress) to explore the interplay between data quality and the application of neural networks.


title: Well-posedness for viscosity solutions of the one-phase Muskat problem in all dimensions

abstract: In this article, we apply the viscosity solutions theory for integro-differential equations to the \emph{one-phase} Muskat equation (also known as the Hele-Shaw problem with gravity). We prove global well-posedness for the corresponding Hamilton-Jacobi-Bellmann equation with bounded, uniformly continuous initial data, in all dimensions.


title: Quantum delocalization on correlation landscape: The key to exponentially fast multipartite entanglement generation

abstract: Entanglement, a hallmark of quantum mechanics, is a vital resource for quantum technologies. Generating highly entangled multipartite states is a key goal in current quantum experiments. We unveil a novel framework for understanding entanglement generation dynamics in Hamiltonian systems by quantum delocalization of an effective operator wavefunction on a correlation landscape. Our framework establishes a profound connection between the exponentially fast generation of multipartite entanglement, witnessed by the quantum Fisher information, and the linearly increasing asymptotics of hopping amplitudes governing the delocalization dynamics in Krylov space. We illustrate this connection using the paradigmatic Lipkin-Meshkov-Glick model and highlight potential signatures in chaotic Feingold-Peres tops. Our results provide a transformative tool for understanding and harnessing rapid entanglement production in complex quantum systems, providing a pathway for quantum enhanced technologies by large-scale entanglement.


title: Compressive Bayesian non-negative matrix factorization for mutational signatures analysis

abstract: Non-negative matrix factorization (NMF) is widely used in many applications for dimensionality reduction. Inferring an appropriate number of factors for NMF is a challenging problem, and several approaches based on information criteria or sparsity-inducing priors have been proposed. However, inference in these models is often complicated and computationally challenging. In this paper, we introduce a novel methodology for overfitted Bayesian NMF models using "compressive hyperpriors" that force unneeded factors down to negligible values while only imposing mild shrinkage on needed factors. The method is based on using simple semi-conjugate priors to facilitate inference, while setting the strength of the hyperprior in a data-dependent way to achieve this compressive property. We apply our method to mutational signatures analysis in cancer genomics, where we find that it outperforms state-of-the-art alternatives. In particular, we illustrate how our compressive hyperprior enables the use of biologically informed priors on the signatures, yielding significantly improved accuracy. We provide theoretical results establishing the compressive property, and we demonstrate the method in simulations and on real data from a breast cancer application.


title: Procedural Dilemma Generation for Evaluating Moral Reasoning in Humans and Language Models

abstract: As AI systems like language models are increasingly integrated into decision-making processes affecting people's lives, it's critical to ensure that these systems have sound moral reasoning. To test whether they do, we need to develop systematic evaluations. We provide a framework that uses a language model to translate causal graphs that capture key aspects of moral dilemmas into prompt templates. With this framework, we procedurally generated a large and diverse set of moral dilemmas -- the OffTheRails benchmark -- consisting of 50 scenarios and 400 unique test items. We collected moral permissibility and intention judgments from human participants for a subset of our items and compared these judgments to those from two language models (GPT-4 and Claude-2) across eight conditions. We find that moral dilemmas in which the harm is a necessary means (as compared to a side effect) resulted in lower permissibility and higher intention ratings for both participants and language models. The same pattern was observed for evitable versus inevitable harmful outcomes. However, there was no clear effect of whether the harm resulted from an agent's action versus from having omitted to act. We discuss limitations of our prompt generation pipeline and opportunities for improving scenarios to increase the strength of experimental effects.


title: Group-Aware Coordination Graph for Multi-Agent Reinforcement Learning

abstract: Cooperative Multi-Agent Reinforcement Learning (MARL) necessitates seamless collaboration among agents, often represented by an underlying relation graph. Existing methods for learning this graph primarily focus on agent-pair relations, neglecting higher-order relationships. While several approaches attempt to extend cooperation modelling to encompass behaviour similarities within groups, they commonly fall short in concurrently learning the latent graph, thereby constraining the information exchange among partially observed agents. To overcome these limitations, we present a novel approach to infer the Group-Aware Coordination Graph (GACG), which is designed to capture both the cooperation between agent pairs based on current observations and group-level dependencies from behaviour patterns observed across trajectories. This graph is further used in graph convolution for information exchange between agents during decision-making. To further ensure behavioural consistency among agents within the same group, we introduce a group distance loss, which promotes group cohesion and encourages specialization between groups. Our evaluations, conducted on StarCraft II micromanagement tasks, demonstrate GACG's superior performance. An ablation study further provides experimental evidence of the effectiveness of each component of our method.


title: Methane Emission From a Cool Brown Dwarf

abstract: Beyond our solar system, aurorae have been inferred from radio observations of isolated brown dwarfs (e.g. Hallinan et al. 2006; Kao et al. 2023). Within our solar system, giant planets have auroral emission with signatures across the electromagnetic spectrum including infrared emission of H3+ and methane. Isolated brown dwarfs with auroral signatures in the radio have been searched for corresponding infrared features but have only had null detections (e.g. Gibbs et al. 2022). CWISEP J193518.59-154620.3. (W1935 for short) is an isolated brown dwarf with a temperature of ~482 K. Here we report JWST observations of strong methane emission from W1935 at 3.326 microns. Atmospheric modeling leads us to conclude that a temperature inversion of ~300 K centered at 1-10 millibar replicates the feature. This represents an atmospheric temperature inversion for a Jupiter-like atmosphere without irradiation from a host star. A plausible explanation for the strong inversion is heating by auroral processes, although other internal and/or external dynamical processes cannot be ruled out. The best fit model rules out the contribution of H3+ emission which is prominent in solar system gas giants however this is consistent with rapid destruction of H3+ at the higher pressure where the W1935 emission originates (e.g. Helling et al. 2019).


title: Leveraging 3D LiDAR Sensors to Enable Enhanced Urban Safety and Public Health: Pedestrian Monitoring and Abnormal Activity Detection

abstract: The integration of Light Detection and Ranging (LiDAR) and Internet of Things (IoT) technologies offers transformative opportunities for public health informatics in urban safety and pedestrian well-being. This paper proposes a novel framework utilizing these technologies for enhanced 3D object detection and activity classification in urban traffic scenarios. By employing elevated LiDAR, we obtain detailed 3D point cloud data, enabling precise pedestrian activity monitoring. To overcome urban data scarcity, we create a specialized dataset through simulated traffic environments in Blender, facilitating targeted model training. Our approach employs a modified Point Voxel-Region-based Convolutional Neural Network (PV-RCNN) for robust 3D detection and PointNet for classifying pedestrian activities, significantly benefiting urban traffic management and public health by offering insights into pedestrian behavior and promoting safer urban environments. Our dual-model approach not only enhances urban traffic management but also contributes significantly to public health by providing insights into pedestrian behavior and promoting safer urban environment.


title: Scales of Stability and Turbulence in the Molecular ISM

abstract: From the archival data of the BU-FCRAO $^{13}$ CO GRS, we measure the radial profiles of column density and turbulent velocity dispersion from the centers of molecular clouds outward into the surrounding diffuse molecular ISM. Averaged across spatial scales, the profiles are consistent with turbulence that is on average in hydrostatic equilibrium. We measure the turbulent kinetic energy (KE) and the gravitational potential energy (GE) within and the pressure energy (PE) outside the clouds. The distribution of the sum 2KE-|GE|-PE has a mean near zero indicating approximate virial equilibrium. The average pressure energy is consistent with estimates of the pressure of the multiphase ISM at the Galactic mid-plane. If the dynamical time scale of the turbulence scales with its crossing time, this apparent equilibrium may result from the rapid virialization of the KE and GE with respect to changes in PE. In a snapshot, the clouds appear to be in virial equilibrium within a confining pressure. However, the duration of the equilibrium is approximately the crossing time. An analysis of Larson's scaling relationships of line width and column density finds no correlation. Tthe inference of constant column density with cloud size is a misinterpretation of this lack of correlation.


title: Hyper Evidential Deep Learning to Quantify Composite Classification Uncertainty

abstract: Deep neural networks (DNNs) have been shown to perform well on exclusive, multi-class classification tasks. However, when different classes have similar visual features, it becomes challenging for human annotators to differentiate them. This scenario necessitates the use of composite class labels. In this paper, we propose a novel framework called Hyper-Evidential Neural Network (HENN) that explicitly models predictive uncertainty due to composite class labels in training data in the context of the belief theory called Subjective Logic (SL). By placing a grouped Dirichlet distribution on the class probabilities, we treat predictions of a neural network as parameters of hyper-subjective opinions and learn the network that collects both single and composite evidence leading to these hyper-opinions by a deterministic DNN from data. We introduce a new uncertainty type called vagueness originally designed for hyper-opinions in SL to quantify composite classification uncertainty for DNNs. Our results demonstrate that HENN outperforms its state-of-the-art counterparts based on four image datasets. The code and datasets are available at: https://github.com/Hugo101/HyperEvidentialNN.


title: A Survey on Retrieval-Augmented Text Generation for Large Language Models

abstract: Retrieval-Augmented Generation (RAG) merges retrieval methods with deep learning advancements to address the static limitations of large language models (LLMs) by enabling the dynamic integration of up-to-date external information. This methodology, focusing primarily on the text domain, provides a cost-effective solution to the generation of plausible but incorrect responses by LLMs, thereby enhancing the accuracy and reliability of their outputs through the use of real-world data. As RAG grows in complexity and incorporates multiple concepts that can influence its performance, this paper organizes the RAG paradigm into four categories: pre-retrieval, retrieval, post-retrieval, and generation, offering a detailed perspective from the retrieval viewpoint. It outlines RAG's evolution and discusses the field's progression through the analysis of significant studies. Additionally, the paper introduces evaluation methods for RAG, addressing the challenges faced and proposing future research directions. By offering an organized framework and categorization, the study aims to consolidate existing research on RAG, clarify its technological underpinnings, and highlight its potential to broaden the adaptability and applications of LLMs.


title: The Relationship Between Simulated Sub-Millimeter and Near-Infrared Images of Sagittarius A* from a Magnetically Arrested Black Hole Accretion Flow

abstract: Sagittarius A* (Sgr A*), the supermassive black hole at the center of the Milky Way, undergoes large-amplitude near-infrared (NIR) flares that can coincide with the continuous rotation of the NIR emission region. One promising explanation for this observed NIR behavior is a magnetic flux eruption, which occurs in three-dimensional General Relativistic Magneto-Hydrodynamic (3D GRMHD) simulations of magnetically arrested accretion flows. After running two-temperature 3D GRMHD simulations, where the electron temperature is evolved self-consistently along with the gas temperature, it is possible to calculate ray-traced images of the synchotron emission from thermal electrons in the accretion flow. Changes in the gas dominated ($\sigma=b^2/2\rho<1$) regions of the accretion flow during a magnetic flux eruption reproduce the NIR flaring and NIR emission region rotation of Sgr A* with durations consistent with observation. In this paper, we demonstrate that these models also predict that large (1.5x - 2x) size increases of the sub-millimeter (sub-mm) and millimeter (mm) emission region follow most NIR flares by 20 - 50 minutes. These size increases occur across a wide parameter space of black hole spin ($a=0.3,0.5,-0.5,0.9375$) and initial tilt angle between the accretion flow and black hole spin axes $\theta_0$ ($\theta_0=0^{\circ}$, $16^{\circ}$, $30^{\circ}$). We also calculate the sub-mm polarization angle rotation and the shift of the sub-mm spectral index from zero to -0.8 during a prominent NIR flare in our high spin ($a=0.9375$) simulation. We show that, during a magnetic flux eruption, a large ($\sim10r_g$), magnetically dominated $(\sigma>1)$, low density, and high temperature ``bubble'' forms in the accretion flow. The drop in density inside the bubble and additional electron heating in accretion flow between 15$r_g$ - 25$r_g$ leads to a sub-mm size increase in corresponding images.


title: Remote Cross-resonance Gate between Superconducting Fixed-frequency Qubits

abstract: High-fidelity quantum state transfer and remote entanglement between superconducting fixed-frequency qubits have not yet been realized. In this study, we propose an alternative remote cross-resonance gate. Considering multiple modes of a superconducting coaxial cable connecting qubits, we must find conditions under which the cross-resonance gate operates with a certain accuracy even in the presence of qubit frequency shifts due to manufacturing errors. For 0.25- and 0.5-m cables, remote cross-resonance gates with a concurrence of $>99.9\%$ in entanglement generation are obtained even with $\pm$10-MHz frequency shifts. For a 1-m cable with a narrow mode spacing, a concurrence of 99.5\% is achieved by reducing the coupling between the qubits and cable. The optimized echoed raised-cosine pulse duration is 150--400 ns, which is similar to the operation time of cross-resonance gates between neighboring qubits on a chip. The dissipation through the cable modes does not considerably affect the obtained results. Such high-precision quantum interconnects pave the way not only for scaling up quantum computer systems but also for nonlocal connections on a chip.


title: Graph Continual Learning with Debiased Lossless Memory Replay

abstract: Real-life graph data often expands continually, rendering the learning of graph neural networks (GNNs) on static graph data impractical. Graph continual learning (GCL) tackles this problem by continually adapting GNNs to the expanded graph of the current task while maintaining the performance over the graph of previous tasks. Memory replay-based methods, which aim to replay data of previous tasks when learning new tasks, have been explored as one principled approach to mitigate the forgetting of the knowledge learned from the previous tasks. In this paper we extend this methodology with a novel framework, called Debiased Lossless Memory replay (DeLoMe). Unlike existing methods that sample nodes/edges of previous graphs to construct the memory, DeLoMe learns small lossless synthetic node representations as the memory. The learned memory can not only preserve the graph data privacy but also capture the holistic graph information, for which the sampling-based methods are not viable. Further, prior methods suffer from bias toward the current task due to the data imbalance between the classes in the memory data and the current data. A debiased GCL loss function is devised in DeLoMe to effectively alleviate this bias. Extensive experiments on four graph datasets show the effectiveness of DeLoMe under both class- and task-incremental learning settings.


title: Pixel-Wise Symbol Spotting via Progressive Points Location for Parsing CAD Images

abstract: Parsing Computer-Aided Design (CAD) drawings is a fundamental step for CAD revision, semantic-based management, and the generation of 3D prototypes in both the architecture and engineering industries. Labeling symbols from a CAD drawing is a challenging yet notorious task from a practical point of view. In this work, we propose to label and spot symbols from CAD images that are converted from CAD drawings. The advantage of spotting symbols from CAD images lies in the low requirement of labelers and the low-cost annotation. However, pixel-wise spotting symbols from CAD images is challenging work. We propose a pixel-wise point location via Progressive Gaussian Kernels (PGK) to balance between training efficiency and location accuracy. Besides, we introduce a local offset to the heatmap-based point location method. Based on the keypoints detection, we propose a symbol grouping method to redraw the rectangle symbols in CAD images. We have released a dataset containing CAD images of equipment rooms from telecommunication industrial CAD drawings. Extensive experiments on this real-world dataset show that the proposed method has good generalization ability.


title: Melnikov Method for Perturbed Completely Integrable Systems

abstract: We consider a completely integrable system of differential equations in arbitrary dimensions whose phase space contains an open set foliated by periodic orbits. This research analyzes the persistence and stability of the periodic orbits under a nonlinear periodic perturbation. For this purpose, we use the Melnikov method and Floquet theory to establish conditions for the existence and stability of periodic orbits. Our approach considers periods of the unperturbed orbits depending on the integrals and constant periods. In the applications, we deal with both cases. Precisely, we study the existence of periodic orbits in a perturbed generalized Euler system. In the degenerate case, we analyze the existence and stability of periodic orbits for a perturbed harmonic oscillator.


title: A Relative Inexact Proximal Gradient Method With an Explicit Linesearch

abstract: This paper presents and investigates an inexact proximal gradient method for solving composite convex optimization problems characterized by an objective function composed of a sum of a full domain differentiable convex function and a non-differentiable convex function. We introduce an explicit linesearch strategy that requires only a relative inexact solution of the proximal subproblem per iteration. We prove the convergence of the sequence generated by our scheme and establish its iteration complexity, considering both the functional values and a residual associated with first-order stationary solutions. Additionally, we provide numerical experiments to illustrate the practical efficacy of our method.


title: From Paper to Platform: Evolution of a Novel Learning Environment for Tabletop Exercises

abstract: For undergraduate students of computing, learning to solve complex practical problems in a team is an essential skill for their future careers. This skill is needed in various fields, such as in cybersecurity and IT governance. Tabletop exercises are an innovative teaching method used in practice for training teams in incident response and evaluation of contingency plans. However, tabletop exercises are not yet widely established in university education. This paper presents data and teaching experience from a cybersecurity course that introduces tabletop exercises in classrooms using a novel technology: INJECT Exercise Platform (IXP), a web-based learning environment for delivering and evaluating the exercises. This technology substantially improves the prior practice, since tabletop exercises worldwide have usually been conducted using pen and paper. Unlike in traditional tabletop exercises, which are difficult to evaluate manually, IXP provides insights into students' behavior and learning based on automated analysis of interaction data. We demonstrate IXP's capabilities and evolution by comparing exercise sessions hosted throughout three years at different stages of the platform's readiness. The analysis of student data is supplemented by the discussion of the lessons learned from employing IXP in computing education contexts. The data analytics enabled a detailed comparison of the teams' performance and behavior. Instructors who consider innovating their classes with tabletop exercises may use IXP and benefit from the insights in this paper.


title: FairSSD: Understanding Bias in Synthetic Speech Detectors

abstract: Methods that can generate synthetic speech which is perceptually indistinguishable from speech recorded by a human speaker, are easily available. Several incidents report misuse of synthetic speech generated from these methods to commit fraud. To counter such misuse, many methods have been proposed to detect synthetic speech. Some of these detectors are more interpretable, can generalize to detect synthetic speech in the wild and are robust to noise. However, limited work has been done on understanding bias in these detectors. In this work, we examine bias in existing synthetic speech detectors to determine if they will unfairly target a particular gender, age and accent group. We also inspect whether these detectors will have a higher misclassification rate for bona fide speech from speech-impaired speakers w.r.t fluent speakers. Extensive experiments on 6 existing synthetic speech detectors using more than 0.9 million speech signals demonstrate that most detectors are gender, age and accent biased, and future work is needed to ensure fairness. To support future research, we release our evaluation dataset, models used in our study and source code at https://gitlab.com/viper-purdue/fairssd.


title: Automating Personalized Parsons Problems with Customized Contexts and Concepts

abstract: Parsons problems provide useful scaffolding for introductory programming students learning to write code. However, generating large numbers of high-quality Parsons problems that appeal to the diverse range of interests in a typical introductory course is a significant challenge for educators. Large language models (LLMs) may offer a solution, by allowing students to produce on-demand Parsons problems for topics covering the breadth of the introductory programming curriculum, and targeting thematic contexts that align with their personal interests. In this paper, we introduce PuzzleMakerPy, an educational tool that uses an LLM to generate unlimited contextualized drag-and-drop programming exercises in the form of Parsons Problems, which introductory programmers can use as a supplemental learning resource. We evaluated PuzzleMakerPy by deploying it in a large introductory programming course, and found that the ability to personalize the contextual framing used in problem descriptions was highly engaging for students, and being able to customize the programming topics was reported as being useful for their learning.


title: Function Approximation for Reinforcement Learning Controller for Energy from Spread Waves

abstract: The industrial multi-generator Wave Energy Converters (WEC) must handle multiple simultaneous waves coming from different directions called spread waves. These complex devices in challenging circumstances need controllers with multiple objectives of energy capture efficiency, reduction of structural stress to limit maintenance, and proactive protection against high waves. The Multi-Agent Reinforcement Learning (MARL) controller trained with the Proximal Policy Optimization (PPO) algorithm can handle these complexities. In this paper, we explore different function approximations for the policy and critic networks in modeling the sequential nature of the system dynamics and find that they are key to better performance. We investigated the performance of a fully connected neural network (FCN), LSTM, and Transformer model variants with varying depths and gated residual connections. Our results show that the transformer model of moderate depth with gated residual connections around the multi-head attention, multi-layer perceptron, and the transformer block (STrXL) proposed in this paper is optimal and boosts energy efficiency by an average of 22.1% for these complex spread waves over the existing spring damper (SD) controller. Furthermore, unlike the default SD controller, the transformer controller almost eliminated the mechanical stress from the rotational yaw motion for angled waves. Demo: https://tinyurl.com/yueda3jh


title: How to deal with glare for improved perception of Autonomous Vehicles

abstract: Vision sensors are versatile and can capture a wide range of visual cues, such as color, texture, shape, and depth. This versatility, along with the relatively inexpensive availability of machine vision cameras, played an important role in adopting vision-based environment perception systems in autonomous vehicles (AVs). However, vision-based perception systems can be easily affected by glare in the presence of a bright source of light, such as the sun or the headlights of the oncoming vehicle at night or simply by light reflecting off snow or ice-covered surfaces; scenarios encountered frequently during driving. In this paper, we investigate various glare reduction techniques, including the proposed saturated pixel-aware glare reduction technique for improved performance of the computer vision (CV) tasks employed by the perception layer of AVs. We evaluate these glare reduction methods based on various performance metrics of the CV algorithms used by the perception layer. Specifically, we considered object detection, object recognition, object tracking, depth estimation, and lane detection which are crucial for autonomous driving. The experimental findings validate the efficacy of the proposed glare reduction approach, showcasing enhanced performance across diverse perception tasks and remarkable resilience against varying levels of glare.


title: A Proximal Gradient Method with an Explicit Line search for Multiobjective Optimization

abstract: We present a proximal gradient method for solving convex multiobjective optimization problems, where each objective function is the sum of two convex functions, with one assumed to be continuously differentiable. The algorithm incorporates a backtracking line search procedure that requires solving only one proximal subproblem per iteration, and is exclusively applied to the differentiable part of the objective functions. Under mild assumptions, we show that the sequence generated by the method convergences to a weakly Pareto optimal point of the problem. Additionally, we establish an iteration complexity bound by showing that the method finds an $\varepsilon$-approximate weakly Pareto point in at most ${\cal O}(1/\varepsilon)$ iterations. Numerical experiments illustrating the practical behavior of the method is presented.


title: Quantum plasmonic sensing by Hong-Ou-Mandel interferometry

abstract: We propose a quantum plasmonic sensor using Hong-Ou-Mandel (HOM) interferometry that measures the refractive index of an analyte, embedded in a plasmonic beam splitter composed of a dual-Kretschmann configuration, which serves as a frustrated total internal reflection beamsplitter. The sensing performance of the HOM interferometry, combined with single-photon detectors, is evaluated through Fisher information for estimation of the refractive index of the analyte. This is subsequently compared with the classical benchmark that considers the injection of a coherent state of light into the plasmonic beamsplitter. By varying the wavelength of the single photons and the refractive index of the analyte, we identify a wide range where a 50 % quantum enhancement is achieved and discuss the observed behaviors in comparison with the classical benchmark. We expect this study to provide a useful insight into the advancement of quantum-enhanced sensing technologies, with direct implications for a wide range of nanophotonic beamsplitter structures.


title: Clipped SGD Algorithms for Privacy Preserving Performative Prediction: Bias Amplification and Remedies

abstract: Clipped stochastic gradient descent (SGD) algorithms are among the most popular algorithms for privacy preserving optimization that reduces the leakage of users' identity in model training. This paper studies the convergence properties of these algorithms in a performative prediction setting, where the data distribution may shift due to the deployed prediction model. For example, the latter is caused by strategical users during the training of loan policy for banks. Our contributions are two-fold. First, we show that the straightforward implementation of a projected clipped SGD (PCSGD) algorithm may converge to a biased solution compared to the performative stable solution. We quantify the lower and upper bound for the magnitude of the bias and demonstrate a bias amplification phenomenon where the bias grows with the sensitivity of the data distribution. Second, we suggest two remedies to the bias amplification effect. The first one utilizes an optimal step size design for PCSGD that takes the privacy guarantee into account. The second one uses the recently proposed DiceSGD algorithm [Zhang et al., 2024]. We show that the latter can successfully remove the bias and converge to the performative stable solution. Numerical experiments verify our analysis.


title: Forbidden subgraphs generating a finite set of graphs with minimum degree three and large girth

abstract: For a family $\mathcal{H}$ of graphs, a graph $G$ is said to be {\it $\mathcal{H}$-free} if $G$ contains no member of $\mathcal{H}$ as an induced subgraph. We let $\tilde{\mathcal{G}}_{3}(\mathcal{H})$ denote the family of connected $\mathcal{H}$-free graphs having minimum degree at least $3$. In this paper, we characterize the non-caterpillar trees $T$ having diameter at least $7$ such that $\tilde{\mathcal{G}}_{3}(\{C_{3},C_{4},T\})$ is a finite family, where $C_{n}$ is a cycle of order $n$.


title: Online Algorithms with Limited Data Retention

abstract: We introduce a model of online algorithms subject to strict constraints on data retention. An online learning algorithm encounters a stream of data points, one per round, generated by some stationary process. Crucially, each data point can request that it be removed from memory $m$ rounds after it arrives. To model the impact of removal, we do not allow the algorithm to store any information or calculations between rounds other than a subset of the data points (subject to the retention constraints). At the conclusion of the stream, the algorithm answers a statistical query about the full dataset. We ask: what level of performance can be guaranteed as a function of $m$? We illustrate this framework for multidimensional mean estimation and linear regression problems. We show it is possible to obtain an exponential improvement over a baseline algorithm that retains all data as long as possible. Specifically, we show that $m = \textsc{Poly}(d, \log(1/\epsilon))$ retention suffices to achieve mean squared error $\epsilon$ after observing $O(1/\epsilon)$ $d$-dimensional data points. This matches the error bound of the optimal, yet infeasible, algorithm that retains all data forever. We also show a nearly matching lower bound on the retention required to guarantee error $\epsilon$. One implication of our results is that data retention laws are insufficient to guarantee the right to be forgotten even in a non-adversarial world in which firms merely strive to (approximately) optimize the performance of their algorithms. Our approach makes use of recent developments in the multidimensional random subset sum problem to simulate the progression of stochastic gradient descent under a model of adversarial noise, which may be of independent interest.


title: Towards unveiling the Cosmic Reionization: the ionizing photon production efficiency ($\xi_{ion}$) of Low-mass H$\alpha$ emitters at $z \sim 2.3$

abstract: We investigate the galaxy properties of $\sim$400 low-mass ($<10^9\,M_{\odot}$) H$\alpha$ emitters (HAEs) at z $\sim$ 2.3 in the ZFOURGE survey. The selection of these HAEs is based on the excess in the observed $K_s$ broad-band flux compared to the stellar continuum estimated from the best-fit SED. These low-mass HAEs have elevated SFR(H$\alpha$) above the star formation main sequence (SFMS), making them potential analogs of the galaxies that reionized the universe during the epoch of reionization. The ionizing photon production efficiencies ($\xi_{ion}$) of the low-mass HAEs have a median value of $\mathrm{log}(\xi_{ion}/erg^{-1} Hz)=25.24^{+0.10}_{-0.13}\ (25.35^{+0.12}_{-0.15})$, assuming the Calzetti (SMC) curve for the stellar continuum dust correction. This value is higher than that of main sequence galaxies by $\sim$0.2 dex at similar redshift, indicating that the low-mass HAEs are more efficient in producing ionizing photons. Our results also consolidate the trend of increasing $\xi_{ion}$ with redshift, but reveal a "downsizing" relationship between $\xi_{ion}$ and stellar mass ($M_{\odot}$) with increasing redshift. We further explore the dependence of $\xi_{ion}$ on other galaxy properties, such as the UV spectral slope ($\beta_{\mathrm{UV}}$), the UV magnitude ($M_{\mathrm{UV}}$), the equivalent widths ($EWs$) of H$\alpha$ and [O{\sc iii}] emission lines. Galaxies with the bluer UV slopes, fainter UV luminosities and higher equivalent widths exhibit elevated $\xi_{ion}$ by a factor of $\sim$2 compared to the median $\xi_{ion}$ of our sample. JWST data will provide an opportunity to extend our method and further investigate the properties of low-mass galaxies at high redshifts.


title: Machine-Learning-Enhanced Soft Robotic System Inspired by Rectal Functions for Investigating Fecal incontinence

abstract: Fecal incontinence, arising from a myriad of pathogenic mechanisms, has attracted considerable global attention. Despite its significance, the replication of the defecatory system for studying fecal incontinence mechanisms remains limited largely due to social stigma and taboos. Inspired by the rectum's functionalities, we have developed a soft robotic system, encompassing a power supply, pressure sensing, data acquisition systems, a flushing mechanism, a stage, and a rectal module. The innovative soft rectal module includes actuators inspired by sphincter muscles, both soft and rigid covers, and soft rectum mold. The rectal mold, fabricated from materials that closely mimic human rectal tissue, is produced using the mold replication fabrication method. Both the soft and rigid components of the mold are realized through the application of 3D-printing technology. The sphincter muscles-inspired actuators featuring double-layer pouch structures are modeled and optimized based on multilayer perceptron methods aiming to obtain high contractions ratios (100%), high generated pressure (9.8 kPa), and small recovery time (3 s). Upon assembly, this defecation robot is capable of smoothly expelling liquid faeces, performing controlled solid fecal cutting, and defecating extremely solid long faeces, thus closely replicating the human rectum and anal canal's functions. This defecation robot has the potential to assist humans in understanding the complex defecation system and contribute to the development of well-being devices related to defecation.


title: OVAL-Prompt: Open-Vocabulary Affordance Localization for Robot Manipulation through LLM Affordance-Grounding

abstract: In order for robots to interact with objects effectively, they must understand the form and function of each object they encounter. Essentially, robots need to understand which actions each object affords, and where those affordances can be acted on. Robots are ultimately expected to operate in unstructured human environments, where the set of objects and affordances is not known to the robot before deployment (i.e. the open-vocabulary setting). In this work, we introduce OVAL-Prompt, a prompt-based approach for open-vocabulary affordance localization in RGB-D images. By leveraging a Vision Language Model (VLM) for open-vocabulary object part segmentation and a Large Language Model (LLM) to ground each part-segment-affordance, OVAL-Prompt demonstrates generalizability to novel object instances, categories, and affordances without domain-specific finetuning. Quantitative experiments demonstrate that without any finetuning, OVAL-Prompt achieves localization accuracy that is competitive with supervised baseline models. Moreover, qualitative experiments show that OVAL-Prompt enables affordance-based robot manipulation of open-vocabulary object instances and categories. Project Page: https://ekjt.github.io/OVAL-Prompt/


title: Modulation of the Octahedral Structure and Potential Superconductivity of La3Ni2O7 at Ambient Pressure by Compressive Strain

abstract: Superconductivity at Tc = 80 K has recently been reported above 14 GPa in La3Ni2O7, which thus introduces a new family of high-temperature superconductors. Using a first-principles calculation with Coulomb repulsion, we unveil a surprising new route to obtain superconductivity in La3Ni2O7 at ambient pressure by introducing compressive strain along the [001] direction. The shape of the NiO6 octahedra affect the Ni-3dz2 density of states (DOS) at Fermi level, and it can be modulated by applying compressive strain instead of hydrostatic pressure. Notably, when the octahedral regularity parameter defined herein is R ~ 4%, La3Ni2O7 acquires a high Ni-3dz2 DOS and hole Fermi pocket. Our study thus indicates a path for obtaining superconductivity in La3Ni2O7 at ambient pressure and elucidates the relationship between structural properties and superconductivity.


title: AdS Ellis wormholes with scalar field

abstract: In this paper, we study the spherically symmetric traversable wormholes with a scalar field supported by a phantom field in the anti-de Sitter (AdS) asymptotic spacetime. Despite coupling the scalar matter field, these wormholes remain massless and symmetric for reflection of the radial coordinate $r \rightarrow -r$. The solution possesses a finite Noether charge $Q$, which varies as a function of frequency $\omega$ with changes in the cosmological constant $\Lambda$ and the throat size $r_0$. Under specific conditions, an approximate ``event horizon'' will appear at the throat.


title: InfoMatch: Entropy Neural Estimation for Semi-Supervised Image Classification

abstract: Semi-supervised image classification, leveraging pseudo supervision and consistency regularization, has demonstrated remarkable success. However, the ongoing challenge lies in fully exploiting the potential of unlabeled data. To address this, we employ information entropy neural estimation to utilize the potential of unlabeled samples. Inspired by contrastive learning, the entropy is estimated by maximizing a lower bound on mutual information across different augmented views. Moreover, we theoretically analyze that the information entropy of the posterior of an image classifier is approximated by maximizing the likelihood function of the softmax predictions. Guided by these insights, we optimize our model from both perspectives to ensure that the predicted probability distribution closely aligns with the ground-truth distribution. Given the theoretical connection to information entropy, we name our method InfoMatch. Through extensive experiments, we show its superior performance. The source code is available at https://github.com/kunzhan/InfoMatch.


title: Robust and tractable multidimensional exponential analysis

abstract: Motivated by a number of applications in signal processing, we study the following question. Given samples of a multidimensional signal of the form \begin{align*} f(\bs\ell)=\sum_{k=1}^K a_k\exp(-i\langle \bs\ell, \w_k\rangle), \\ \w_1,\cdots,\w_k\in\mathbb{R}^q, \ \bs\ell\in \ZZ^q, \ |\bs\ell| <n, \end{align*} determine the values of the number $K$ of components, and the parameters $a_k$ and $\w_k$'s. We develop an algorithm to recuperate these quantities accurately using only a subsample of size $\O(qn)$ of this data. For this purpose, we use a novel localized kernel method to identify the parameters, including the number $K$ of signals. Our method is easy to implement, and is shown to be stable under a very low SNR range. We demonstrate the effectiveness of our resulting algorithm using 2 and 3 dimensional examples from the literature, and show substantial improvements over state-of-the-art techniques including Prony based, MUSIC and ESPRIT approaches.