title: A Framework for Guided Motion Planning

abstract: Randomized sampling based algorithms are widely used in robot motion planning due to the problem's intractability, and are experimentally effective on a wide range of problem instances. Most variants bias their sampling using various heuristics related to the known underlying structure of the search space. In this work, we formalize the intuitive notion of guided search by defining the concept of a guiding space. This new language encapsulates many seemingly distinct prior methods under the same framework, and allows us to reason about guidance, a previously obscured core contribution of different algorithms. We suggest an information theoretic method to evaluate guidance, which experimentally matches intuition when tested on known algorithms in a variety of environments. The language and evaluation of guidance suggests improvements to existing methods, and allows for simple hybrid algorithms that combine guidance from multiple sources.


title: Robust Pronoun Fidelity with English LLMs: Are they Reasoning, Repeating, or Just Biased?

abstract: Robust, faithful and harm-free pronoun use for individuals is an important goal for language models as their use increases, but prior work tends to study only one or two of these characteristics at a time. To measure progress towards the combined goal, we introduce the task of pronoun fidelity: given a context introducing a co-referring entity and pronoun, the task is to reuse the correct pronoun later. We present RUFF, a carefully-designed dataset of over 5 million instances to measure robust pronoun fidelity in English, and we evaluate 37 popular large language models across architectures (encoder-only, decoder-only and encoder-decoder) and scales (11M-70B parameters). When an individual is introduced with a pronoun, models can mostly faithfully reuse this pronoun in the next sentence, but they are significantly worse with she/her/her, singular they and neopronouns. Moreover, models are easily distracted by non-adversarial sentences discussing other people; even one additional sentence with a distractor pronoun causes accuracy to drop on average by 34%. Our results show that pronoun fidelity is neither robust, nor due to reasoning, in a simple, naturalistic setting where humans achieve nearly 100% accuracy. We encourage researchers to bridge the gaps we find and to carefully evaluate reasoning in settings where superficial repetition might inflate perceptions of model performance.


title: Spin-caloric resistance of Dirac plasma in graphene Corbino device

abstract: The thermal resistance of a spin-polarized hydrodynamic Dirac plasma in graphene is considered. A mechanism for the coupling of heat and spin flows is discussed, demonstrating that spin diffusion and spin thermocurrent modify viscous dissipation, leading to a significant enhancement of thermal resistance. Practical calculations are then presented for graphene devices in the Corbino geometry.


title: Promatch: Extending the Reach of Real-Time Quantum Error Correction with Adaptive Predecoding

abstract: Fault-tolerant quantum computing relies on Quantum Error Correction, which encodes logical qubits into data and parity qubits. Error decoding is the process of translating the measured parity bits into types and locations of errors. To prevent a backlog of errors, error decoding must be performed in real-time. Minimum Weight Perfect Matching (MWPM) is an accurate decoding algorithm for surface code, and recent research has demonstrated real-time implementations of MWPM (RT-MWPM) for a distance of up to 9. Unfortunately, beyond d=9, the number of flipped parity bits in the syndrome, referred to as the Hamming weight of the syndrome, exceeds the capabilities of existing RT-MWPM decoders. In this work, our goal is to enable larger distance RT-MWPM decoders by using adaptive predecoding that converts high Hamming weight syndromes into low Hamming weight syndromes, which are accurately decoded by the RT-MWPM decoder. An effective predecoder must balance both accuracy and coverage. In this paper, we propose Promatch, a real-time adaptive predecoder that predecodes both simple and complex patterns using a locality-aware, greedy approach. Our approach ensures two crucial factors: 1) high accuracy in prematching flipped bits, ensuring that the decoding accuracy is not hampered by the predecoder, and 2) enough coverage adjusted based on the main decoder's capability given the time constraints. Promatch represents the first real-time decoding framework capable of decoding surface codes of distances 11 and 13, achieving an LER of $2.6\times 10^{-14}$ for distance 13. Moreover, we demonstrate that running Promatch concurrently with the recently proposed Astrea-G achieves LER equivalent to MWPM LER, $3.4\times10^{-15}$, for distance 13, representing the first real-time accurate decoder for up-to a distance of 13.


title: Robust Partitioning and Operation for Maximal Uncertain-Load Delivery in Distribution Grids

abstract: To mitigate the vulnerability of distribution grids to severe weather events, some electric utilities use preemptive de-energization as the primary line of defense, causing significant power outages. In such instances, networked microgrids could improve resiliency and maximize load delivery, though the modeling of three-phase unbalanced network physics and computational complexity pose challenges. These challenges are further exacerbated by an increased penetration of uncertain loads. In this paper, we present a two-stage mixed-integer robust optimization problem that configures and operates networked microgrids, and is guaranteed to be robust and feasible to all realizations of loads within a specified uncertainty set, while maximizing load delivery. To solve this problem, we propose a cutting-plane algorithm, with convergence guarantees, which approximates a convex recourse function with sub-gradient cuts. Finally, we provide a detailed case study on the IEEE 37-bus test system to demonstrate the economic benefits of networking microgrids to maximize uncertain-load delivery.


title: Discontinuity-preserving Normal Integration with Auxiliary Edges

abstract: Many surface reconstruction methods incorporate normal integration, which is a process to obtain a depth map from surface gradients. In this process, the input may represent a surface with discontinuities, e.g., due to self-occlusion. To reconstruct an accurate depth map from the input normal map, hidden surface gradients occurring from the jumps must be handled. To model these jumps correctly, we design a novel discretization scheme for the domain of normal integration. Our key idea is to introduce auxiliary edges, which bridge between piecewise-smooth patches in the domain so that the magnitude of hidden jumps can be explicitly expressed. Using the auxiliary edges, we design a novel algorithm to optimize the discontinuity and the depth map from the input normal map. Our method optimizes discontinuities by using a combination of iterative re-weighted least squares and iterative filtering of the jump magnitudes on auxiliary edges to provide strong sparsity regularization. Compared to previous discontinuity-preserving normal integration methods, which model the magnitudes of jumps only implicitly, our method reconstructs subtle discontinuities accurately thanks to our explicit representation of jumps allowing for strong sparsity regularization.


title: Theoretical and Empirical Insights into the Origins of Degree Bias in Graph Neural Networks

abstract: Graph Neural Networks (GNNs) often perform better for high-degree nodes than low-degree nodes on node classification tasks. This degree bias can reinforce social marginalization by, e.g., sidelining authors of lowly-cited papers when predicting paper topics in citation networks. While researchers have proposed numerous hypotheses for why GNN degree bias occurs, we find via a survey of 38 degree bias papers that these hypotheses are often not rigorously validated, and can even be contradictory. Thus, we provide an analysis of the origins of degree bias in message-passing GNNs with different graph filters. We prove that high-degree test nodes tend to have a lower probability of misclassification regardless of how GNNs are trained. Moreover, we show that degree bias arises from a variety of factors that are associated with a node's degree (e.g., homophily of neighbors, diversity of neighbors). Furthermore, we show that during training, some GNNs may adjust their loss on low-degree nodes more slowly than on high-degree nodes; however, with sufficiently many epochs of training, message-passing GNNs can achieve their maximum possible training accuracy, which is not significantly limited by their expressive power. Throughout our analysis, we connect our findings to previously-proposed hypotheses for the origins of degree bias, supporting and unifying some while drawing doubt to others. We validate our theoretical findings on 8 common real-world networks, and based on our theoretical and empirical insights, describe a roadmap to alleviate degree bias.


title: A first extraction of the weak magnetism form factor and Fierz interference term from the $^{114}$In $\rightarrow$ $^{114}$Sn Gamow-Teller transition

abstract: Spectrum shape measurements in nuclear $\beta$ decay can be used to test physics beyond the Standard Model with results being complementary to high-energy collider experiments. In particular, Beyond Standard Model sensitivity of the weak interaction is expressed through the so-called Fierz interference term. Additionally, the $\beta$ spectrum shape is a useful tool to probe Standard Model effects, among which the most prominent is \textit{weak magnetism}, a higher-order recoil correction induced by nuclear pion exchange. To study effects in the $\beta$ spectrum shape at a precision level competitive with the LHC, a new spectrometer was designed and built. It consists of a 3D low-pressure gas electron tracker and a plastic scintillator used for triggering the data acquisition and recording the $\beta$ particle energy. In this Letter, the results from $\beta$ spectrum shape measurements on the allowed Gamow-Teller transition $^{114}\text{In} \rightarrow ^{114}\text{Sn}$ are presented, including a first extraction of the weak magnetism form factor in the high nuclear mass range and a new estimate of the $90\%$ confidence interval for the Fierz interference term.


title: The Role of Torsion in Trans-Planckian Physics

abstract: The torsion of spacetime, if exists, plays an important role at the very early universe when the spin density of particles was very high. It is generally believed that in extremely high energies of the early universe a new physics called trans-Planckian physics should be considered. Since the initial conditions for inflation are probably a result of this new physics, here we consider spin and torsion as trans- Planckian effects and analyze their influence on the power spectrum of scalar and tensor perturbations at the end of the inflationary era.


title: Affine Demazure Weight Polytopes and Twisted Bruhat Orders

abstract: For an untwisted affine Kac-Moody Lie algebra $\mathfrak{g}$ with Cartan and Borel subalgebras $\mathfrak{h} \subset \mathfrak{b} \subset \mathfrak{g}$, affine Demazure modules are certain $U(\mathfrak{b})$-submodules of the irreducible highest-weight representations of $\mathfrak{g}$. We introduce here the associated affine Demazure weight polytopes, given by the convex hull of the $\mathfrak{h}$-weights of such a module. Using methods of geometric invariant theory, we determine inequalities which define these polytopes; these inequalities come in three distinct flavors, specified by the standard, opposite, or semi-infinite Bruhat orders. We also give a combinatorial characterization of the vertices of these polytopes lying on an arbitrary face, utilizing the more general class of twisted Bruhat orders.


title: A model for galaxy-galaxy strong lensing statistics in surveys

abstract: Photometric wide-area observations in the next decade will be capable of detecting a large number of galaxy-scale strong gravitational lenses, increasing the gravitational lens sample size by orders of magnitude. To aid in forecasting and analysis of these surveys, we construct a flexible model based on observed distributions for the lens and source properties and test it on the results of past lens searches, including SL2S, SuGOHI and searches on the COSMOS HST and DES fields. We use this model to estimate the expected yields of some current and planned surveys, including Euclid Wide, Vera Rubin LSST, and Roman High Latitude Wide Area. The model proposed includes a set of free parameters to constrain on the identifiability of a lens in an image, allowing construction of prior probability distributions for different lens detection methods. The code used in this work is made publicly available.


title: Diverse and Tailored Image Generation for Zero-shot Multi-label Classification

abstract: Recently, zero-shot multi-label classification has garnered considerable attention for its capacity to operate predictions on unseen labels without human annotations. Nevertheless, prevailing approaches often use seen classes as imperfect proxies for unseen ones, resulting in suboptimal performance. Drawing inspiration from the success of text-to-image generation models in producing realistic images, we propose an innovative solution: generating synthetic data to construct a training set explicitly tailored for proxyless training on unseen labels. Our approach introduces a novel image generation framework that produces multi-label synthetic images of unseen classes for classifier training. To enhance diversity in the generated images, we leverage a pre-trained large language model to generate diverse prompts. Employing a pre-trained multi-modal CLIP model as a discriminator, we assess whether the generated images accurately represent the target classes. This enables automatic filtering of inaccurately generated images, preserving classifier accuracy. To refine text prompts for more precise and effective multi-label object generation, we introduce a CLIP score-based discriminative loss to fine-tune the text encoder in the diffusion model. Additionally, to enhance visual features on the target task while maintaining the generalization of original features and mitigating catastrophic forgetting resulting from fine-tuning the entire visual encoder, we propose a feature fusion module inspired by transformer attention mechanisms. This module aids in capturing global dependencies between multiple objects more effectively. Extensive experimental results validate the effectiveness of our approach, demonstrating significant improvements over state-of-the-art methods.


title: DreamWalk: Style Space Exploration using Diffusion Guidance

abstract: Text-conditioned diffusion models can generate impressive images, but fall short when it comes to fine-grained control. Unlike direct-editing tools like Photoshop, text conditioned models require the artist to perform "prompt engineering," constructing special text sentences to control the style or amount of a particular subject present in the output image. Our goal is to provide fine-grained control over the style and substance specified by the prompt, for example to adjust the intensity of styles in different regions of the image (Figure 1). Our approach is to decompose the text prompt into conceptual elements, and apply a separate guidance term for each element in a single diffusion process. We introduce guidance scale functions to control when in the diffusion process and \emph{where} in the image to intervene. Since the method is based solely on adjusting diffusion guidance, it does not require fine-tuning or manipulating the internal layers of the diffusion model's neural network, and can be used in conjunction with LoRA- or DreamBooth-trained models (Figure2). Project page: https://mshu1.github.io/dreamwalk.github.io/


title: Computational Study Based Prediction of New Photocatalysts for water splitting by systematic manipulation of MXene surfaces

abstract: The compositional and structural flexibility of functionalised two-dimensional metal carbonitrides or MXenes has been exploited through a combinatorial search for new materials that can act as catalysts for photo-assisted water splitting by absorbing sunlight with energy in the infra-red region. Detailed calculations on 49 Janus MXenes where two surfaces are of asymmetric nature are carried out by first-principles Density Functional Theory. A screening procedure is adopted to arrive at potential candidates. Our calculations predict four new materials whose surfaces can activate both hydrogen and oxygen evolution reactions upon splitting water, two out of which are infra-red active, and the rest are visible light-active. We have performed a detailed microscopic analysis to find out the interrelations of the structural model of surface functionalisation, the chemistry of the surfaces, the electronic structure, and the alignment of bands with respect to the reaction potentials that explain our results. Apart from these four compounds, we find thirteen other compounds that are suitable for either hydrogen evolution or oxygen reduction reactions. This study lays out a guideline for the systematic discovery of potential new catalysts for water splitting under sunlight irradiation.


title: Eigenpruning: an Interpretability-Inspired PEFT Method

abstract: We introduce eigenpruning, a method that removes singular values from weight matrices in an LLM to improve its performance in a particular task. This method is inspired by interpretability methods designed to automatically find subnetworks of a model which solve a specific task. In our tests, the pruned model outperforms the original model by a large margin, while only requiring minimal computation to prune the weight matrices. In the case of a small synthetic task in integer multiplication, the Phi-2 model can improve its accuracy in the test set from 13.75% to 97.50%. Interestingly, these results seem to indicate the existence of a computation path that can solve the task very effectively, but it was not being used by the original model. Finally, we publicly release our implementation.


title: Convexity and Osculation in Normed Spaces

abstract: Constructive properties of uniform convexity, strict convexity, near convexity, and metric convexity in real normed linear spaces are considered. Examples show that certain classical theorems, such as the existence of points of osculation, are constructively invalid. The methods used are in accord with principles introduced by Errett Bishop


title: Design and Evaluation of a Compact 3D End-effector Assistive Robot for Adaptive Arm Support

abstract: We developed a 3D end-effector type of upper limb assistive robot, named as Assistive Robotic Arm Extender (ARAE), that provides transparency movement and adaptive arm support control to achieve home-based therapy and training in the real environment. The proposed system composes five degrees of freedom, including three active motors and two passive joints at the end-effector module. The core structure of the system is based on a parallel mechanism. The kinematic and dynamic modeling are illustrated in detail. The proposed adaptive arm support control framework calculates the compensated force based on the estimated human arm posture in 3D space. It firstly estimates human arm joint angles using two proposed methods: fixed torso and sagittal plane models without using external sensors such as IMUs, magnetic sensors, or depth cameras. The experiments were carried out to evaluate the performance of the two proposed angle estimation methods. Then, the estimated human joint angles were input into the human upper limb dynamics model to derive the required support force generated by the robot. The muscular activities were measured to evaluate the effects of the proposed framework. The obvious reduction of muscular activities was exhibited when participants were tested with the ARAE under an adaptive arm gravity compensation control framework. The overall results suggest that the ARAE system, when combined with the proposed control framework, has the potential to offer adaptive arm support. This integration could enable effective training with Activities of Daily Living (ADLs) and interaction with real environments.


title: NLP at UC Santa Cruz at SemEval-2024 Task 5: Legal Answer Validation using Few-Shot Multi-Choice QA

abstract: This paper presents our submission to the SemEval 2024 Task 5: The Legal Argument Reasoning Task in Civil Procedure. We present two approaches to solving the task of legal answer validation, given an introduction to the case, a question and an answer candidate. Firstly, we fine-tuned pre-trained BERT-based models and found that models trained on domain knowledge perform better. Secondly, we performed few-shot prompting on GPT models and found that reformulating the answer validation task to be a multiple-choice QA task remarkably improves the performance of the model. Our best submission is a BERT-based model that achieved the 7th place out of 20.


title: Average Nodal Count and the Nodal Count Condition for Graphs

abstract: The nodal edge count of an eigenvector of the Laplacian of a graph is the number of edges on which it changes sign. This quantity extends to any real symmetric $n\times n$ matrix supported on a graph $G$ with $n$ vertices. The average nodal count, averaged over all eigenvectors of a given matrix, is known to be bounded between $\frac{n-1}{2}$ and $\frac{n-1}{2}+\beta(G)$, where $\beta(G)$ is the first Betti number of $G$ (a topological quantity), and it was believed that generically the average should be around $\frac{n-1}{2}+\beta(G)/2$. We prove that this is not the case: the average is bounded between $\frac{n-1}{2}+\beta(G)/n$ and $\frac{n-1}{2}+\beta(G)-\beta(G)/n$, and we provide graphs and matrices that attain the upper and lower bounds for any possible choice of $n$ and $\beta$. A natural condition on a matrix for defining the nodal count is that it has simple eigenvalues and non-vanishing eigenvectors. For any connected graph $G$, a generic real symmetric matrix supported on $G$ satisfies this nodal count condition. However, the situation for constant diagonal matrices is far more subtle. We completely characterize the graphs $G$ for which this condition is generically true, and show that if this is not the case, then any real symmetric matrix supported on $G$ with constant diagonal has a multiple eigenvalue or an eigenvector that vanishes somewhere. Finally, we discuss what can be said when this nodal count condition fails, and provide examples.


title: Orthogonal calibration via posterior projections with applications to the Schwarzschild model

abstract: The orbital superposition method originally developed by Schwarzschild (1979) is used to study the dynamics of growth of a black hole and its host galaxy, and has uncovered new relationships between the galaxy's global characteristics. Scientists are specifically interested in finding optimal parameter choices for this model that best match physical measurements along with quantifying the uncertainty of such procedures. This renders a statistical calibration problem with multivariate outcomes. In this article, we develop a Bayesian method for calibration with multivariate outcomes using orthogonal bias functions thus ensuring parameter identifiability. Our approach is based on projecting the posterior to an appropriate space which allows the user to choose any nonparametric prior on the bias function(s) instead of having to model it (them) with Gaussian processes. We develop a functional projection approach using the theory of Hilbert spaces. A finite-dimensional analogue of the projection problem is also considered. We illustrate the proposed approach using a BART prior and apply it to calibrate the Schwarzschild model illustrating how a multivariate approach may resolve discrepancies resulting from a univariate calibration.


title: Log-concavity And The Multiplicative Properties of Restricted Partition Functions

abstract: The partition function $p(n)$ and many of its related restricted partition functions have recently been shown independently to satisfy log-concavity: $p(n)^2 \geq p(n-1)p(n+1)$, and satisfy the inequality: $p(n)p(m) \geq p(n+m)$ with only finitely many instances of equality or failure. This paper proves that this is no coincidence, that any log-concave sequence $\{x_n\}$ satisfying a particular initial condition likewise satisfies the inequality $x_nx_m \geq x_{n+m}$. This paper further determines that these conditions are sufficient but not necessary and considers various examples to illuminate the situation.


title: Age-of-Information-Aware Distributed Task Offloading and Resource Allocation in Mobile Edge Computing Networks

abstract: The growth in artificial intelligence (AI) technology has attracted substantial interests in age-of-information (AoI)-aware task offloading of mobile edge computing (MEC)-namely, minimizing service latency. Additionally, the use of MEC systems poses an additional problem arising from limited battery resources of MDs. This paper tackles the pressing challenge of AoI-aware distributed task offloading optimization, where user association (UA), resource allocation (RA), full-task offloading, and battery of mobile devices (MDs) are jointly considered. In existing studies, joint optimization of overall task offloading and UA is seldom considered due to the complexity of combinatorial optimization problems, and in cases where it is considered, linear objective functions such as power consumption are adopted. Revolutionizing the realm of MEC, our objective includes all major components contributing to users' quality of experience, including AoI and energy consumption. To achieve this, we first formulate an NP-hard combinatorial problem, where the objective function comprises three elements: communication latency, computation latency, and battery usage. We derive a closed-form RA solution of the problem; next, we provide a distributed pricing-based UA solution. We simulate the proposed algorithm for various vision and language AI tasks. Our numerical results show that the proposed method Pareto-dominates baseline methods. More specifically, the results demonstrate that the proposed method can outperform baseline methods by 1.62 times smaller AoI with 41.2% less energy consumption.


title: TEGRA -- Scaling Up Terascale Graph Processing with Disaggregated Computing

abstract: Graphs are essential for representing relationships in various domains, driving modern AI applications such as graph analytics and neural networks across science, engineering, cybersecurity, transportation, and economics. However, the size of modern graphs are rapidly expanding, posing challenges for traditional CPUs and GPUs in meeting real-time processing demands. As a result, hardware accelerators for graph processing have been proposed. However, the largest graphs that can be handled by these systems is still modest often targeting Twitter graph(1.4B edges approximately). This paper aims to address this limitation by developing a graph accelerator capable of terascale graph processing. Scale out architectures, architectures where nodes are replicated to expand to larger datasets, are natural for handling larger graphs. We argue that this approach is not appropriate for very large-scale graphs because it leads to under utilization of both memory resources and compute resources. Additionally, vertex and edge processing have different access patterns. Communication overheads also pose further challenges in designing scalable architectures. To overcome these issues, this paper proposes TEGRA, a scale-up architecture for terascale graph processing. TEGRA leverages a composable computing system with disaggregated resources and a communication architecture inspired by Active Messages. By employing direct communication between cores and optimizing memory interconnect utilization, TEGRA effectively reduces communication overhead and improves resource utilization, therefore enabling efficient processing of terascale graphs.


title: The Dynamics of Debris Disk Creation in Neutron Star Mergers

abstract: The detection of GW170817/AT2017gfo inaugurated an era of multimessenger astrophysics, in which gravitational wave and multiwavelength photon observations complement one another to provide unique insight on astrophysical systems. A broad theoretical consensus exists in which the photon phenomenology of neutron star mergers largely rests upon the evolution of the small amount of matter left on bound orbits around the black hole or massive neutron star remaining after the merger. Because this accretion disk is far from inflow equilibrium, its subsequent evolution depends very strongly on its initial state, yet very little is known about how this state is determined. Using both snapshot and tracer particle data from a numerical relativity/MHD simulation of an equal-mass neutron star merger that collapses to a black hole, we show how gravitational forces arising in a non-axisymmetric, dynamical spacetime supplement hydrodynamical effects in shaping the initial structure of the bound debris disk. The work done by hydrodynamical forces is ${\sim}10$ times greater than that due to time-dependent gravity. Although gravitational torques prior to remnant relaxation are an order of magnitude larger than hydrodynamical torques, their intrinsic sign symmetry leads to strong cancellation; as a result, hydrodynamical and gravitational torques have comparable effect. We also show that the debris disk's initial specific angular momentum distribution is sharply peaked at roughly the specific angular momentum of the merged neutron star's outer layers, a few $r_g c$, and identify the regulating mechanism.


title: Irreducible symplectic varieties via relative Prym varieties

abstract: Generalizing work of Markushevich--Tikhomirov and Arbarello--Sacc\`a--Ferretti, we use relative Prym varieties to construct Lagrangian fibered symplectic varieties in infinitely many dimensions. We then give criteria for when the construction yields primitive symplectic varieties, respectively, irreducible symplectic varieties. The starting point of the construction is a K3 surface endowed with an anti-symplectic involution and an effective linear system on the quotient surface. We give sufficient conditions on the linear system to ensure that the relative Prym varieties satisfy the criteria above. As a consequence, we produce infinite series of irreducible symplectic varieties.


title: Stabilization in two-species chemotaxis systems with singular sensitivity and Lotka-Volterra competitive kinetics

abstract: The current paper is concerned with the stabilization in the following parabolic-parabolic-elliptic chemotaxis system with singular sensitivity and Lotka-Volterra competitive kinetics, \begin{equation} \begin{cases} u_t=\Delta u-\chi_1 \nabla\cdot (\frac{u}{w} \nabla w)+u(a_1-b_1u-c_1v) ,\quad &x\in \Omega\cr v_t=\Delta v-\chi_2 \nabla\cdot (\frac{v}{w} \nabla w)+v(a_2-b_2v-c_2u),\quad &x\in \Omega\cr 0=\Delta w-\mu w +\nu u+ \lambda v,\quad &x\in \Omega \cr \frac{\partial u}{\partial n}=\frac{\partial v}{\partial n}=\frac{\partial w}{\partial n}=0,\quad &x\in\partial\Omega, \end{cases} \end{equation} where $\Omega \subset \mathbb{R}^N$ is a bounded smooth domain, and $\chi_i,a_i, b_i, c_i$ ($i=1,2$) and $\mu,\, \nu, \, \lambda$ are positive constants. In [25], we proved that for any given nonnegative initial data $u_0,v_0\in C^0(\bar\Omega)$ with $u_0+v_0\not \equiv 0$, (0.1) has a unique globally defined classical solution provided that $\min\{a_1,a_2\}$ is large relative to $\chi_1,\chi_2$, and $u_0+v_0$ is not small in the case that $(\chi_1-\chi_2)^2\le \max\{4\chi_1,4\chi_2\}$ and $u_0+v_0$ is neither small nor big in the case that $(\chi_1-\chi_2)^2>\max\{4\chi_1,4\chi_2\}$. In this paper, we proved that (0.1) has a unique positive constant solution $(u^*,v^*,w^*)$, where $$ u^*=\frac{a_1b_2-c_1a_2}{b_1b_2-c_1c_2},\quad v^*=\frac{b_1a_2-a_1c_2}{b_1b_2-c_1c_2}, \quad w^*=\frac{\nu}{\mu}u^*+\frac{\lambda}{\mu} v^*. $$ We obtain some explicit conditions on $\chi_1,\chi_2$ which ensure that the positive constant solution $(u^*,v^*,w^*)$ is globally stable in the sense that for any given nonnegative initial data $u_0,v_0\in C^0(\bar\Omega)$ with $u_0\not \equiv 0$ and $v_0\not \equiv 0$, $$ \lim_{t\to\infty}\Big(\|u(t,\cdot;u_0,v_0)-u^*\|_\infty +\|v(t,\cdot;u_0,v_0)-v^*\|_\infty+\|w(t,\cdot;u_0,v_0)-w^*\|_\infty\Big)=0. $$


title: HandDiff: 3D Hand Pose Estimation with Diffusion on Image-Point Cloud

abstract: Extracting keypoint locations from input hand frames, known as 3D hand pose estimation, is a critical task in various human-computer interaction applications. Essentially, the 3D hand pose estimation can be regarded as a 3D point subset generative problem conditioned on input frames. Thanks to the recent significant progress on diffusion-based generative models, hand pose estimation can also benefit from the diffusion model to estimate keypoint locations with high quality. However, directly deploying the existing diffusion models to solve hand pose estimation is non-trivial, since they cannot achieve the complex permutation mapping and precise localization. Based on this motivation, this paper proposes HandDiff, a diffusion-based hand pose estimation model that iteratively denoises accurate hand pose conditioned on hand-shaped image-point clouds. In order to recover keypoint permutation and accurate location, we further introduce joint-wise condition and local detail condition. Experimental results demonstrate that the proposed HandDiff significantly outperforms the existing approaches on four challenging hand pose benchmark datasets. Codes and pre-trained models are publicly available at https://github.com/cwc1260/HandDiff.


title: Simultaneous clustering and estimation of additive shape invariant models for recurrent event data

abstract: Technological advancements have enabled the recording of spiking activities from large neuron ensembles, presenting an exciting yet challenging opportunity for statistical analysis. This project considers the challenges from a common type of neuroscience experiments, where randomized interventions are applied over the course of each trial. The objective is to identify groups of neurons with unique stimulation responses and estimate these responses. The observed data, however, comprise superpositions of neural responses to all stimuli, which is further complicated by varying response latencies across neurons. We introduce a novel additive shape invariant model that is capable of simultaneously accommodating multiple clusters, additive components, and unknown time-shifts. We establish conditions for the identifiability of model parameters, offering guidance for the design of future experiments. We examine the properties of the proposed algorithm through simulation studies, and apply the proposed method on neural data collected in mice.


title: BioVL-QR: Egocentric Biochemical Video-and-Language Dataset Using Micro QR Codes

abstract: This paper introduces a biochemical vision-and-language dataset, which consists of 24 egocentric experiment videos, corresponding protocols, and video-and-language alignments. The key challenge in the wet-lab domain is detecting equipment, reagents, and containers is difficult because the lab environment is scattered by filling objects on the table and some objects are indistinguishable. Therefore, previous studies assume that objects are manually annotated and given for downstream tasks, but this is costly and time-consuming. To address this issue, this study focuses on Micro QR Codes to detect objects automatically. From our preliminary study, we found that detecting objects only using Micro QR Codes is still difficult because the researchers manipulate objects, causing blur and occlusion frequently. To address this, we also propose a novel object labeling method by combining a Micro QR Code detector and an off-the-shelf hand object detector. As one of the applications of our dataset, we conduct the task of generating protocols from experiment videos and find that our approach can generate accurate protocols.


title: LTRDetector: Exploring Long-Term Relationship for Advanced Persistent Threats Detection

abstract: Advanced Persistent Threat (APT) is challenging to detect due to prolonged duration, infrequent occurrence, and adept concealment techniques. Existing approaches primarily concentrate on the observable traits of attack behaviors, neglecting the intricate relationships formed throughout the persistent attack lifecycle. Thus, we present an innovative APT detection framework named LTRDetector, implementing an end-to-end holistic operation. LTRDetector employs an innovative graph embedding technique to retain comprehensive contextual information, then derives long-term features from these embedded provenance graphs. During the process, we compress the data of the system provenance graph for effective feature learning. Furthermore, in order to detect attacks conducted by using zero-day exploits, we captured the system's regular behavior and detects abnormal activities without relying on predefined attack signatures. We also conducted extensive evaluations using five prominent datasets, the efficacy evaluation of which underscores the superiority of LTRDetector compared to existing state-of-the-art techniques.


title: Uncertainty in Language Models: Assessment through Rank-Calibration

abstract: Language Models (LMs) have shown promising performance in natural language generation. However, as LMs often generate incorrect or hallucinated responses, it is crucial to correctly quantify their uncertainty in responding to given inputs. In addition to verbalized confidence elicited via prompting, many uncertainty measures ($e.g.$, semantic entropy and affinity-graph-based measures) have been proposed. However, these measures can differ greatly, and it is unclear how to compare them, partly because they take values over different ranges ($e.g.$, $[0,\infty)$ or $[0,1]$). In this work, we address this issue by developing a novel and practical framework, termed $Rank$-$Calibration$, to assess uncertainty and confidence measures for LMs. Our key tenet is that higher uncertainty (or lower confidence) should imply lower generation quality, on average. Rank-calibration quantifies deviations from this ideal relationship in a principled manner, without requiring ad hoc binary thresholding of the correctness score ($e.g.$, ROUGE or METEOR). The broad applicability and the granular interpretability of our methods are demonstrated empirically.


title: Does Knowledge Graph Really Matter for Recommender Systems?

abstract: Recommender systems (RSs) are designed to provide personalized recommendations to users. Recently, knowledge graphs (KGs) have been widely introduced in RSs to improve recommendation accuracy. In this study, however, we demonstrate that RSs do not necessarily perform worse even if the KG is downgraded to the user-item interaction graph only (or removed). We propose an evaluation framework KG4RecEval to systematically evaluate how much a KG contributes to the recommendation accuracy of a KG-based RS, using our defined metric KGER (KG utilization efficiency in recommendation). We consider the scenarios where knowledge in a KG gets completely removed, randomly distorted and decreased, and also where recommendations are for cold-start users. Our extensive experiments on four commonly used datasets and a number of state-of-the-art KG-based RSs reveal that: to remove, randomly distort or decrease knowledge does not necessarily decrease recommendation accuracy, even for cold-start users. These findings inspire us to rethink how to better utilize knowledge from existing KGs, whereby we discuss and provide insights into what characteristics of datasets and KG-based RSs may help improve KG utilization efficiency.


title: Towards Collaborative Family-Centered Design for Online Safety, Privacy and Security

abstract: Traditional online safety technologies often overly restrict teens and invade their privacy, while parents often lack knowledge regarding their digital privacy. As such, prior researchers have called for more collaborative approaches on adolescent online safety and networked privacy. In this paper, we propose family-centered approaches to foster parent-teen collaboration in ensuring their mobile privacy and online safety while respecting individual privacy, to enhance open discussion and teens' self-regulation. However, challenges such as power imbalances and conflicts with family values arise when implementing such approaches, making parent-teen collaboration difficult. Therefore, attending the family-centered design workshop will provide an invaluable opportunity for us to discuss these challenges and identify best research practices for the future of collaborative online safety and privacy within families.


title: Searching for binary black hole sub-populations in gravitational wave data using binned Gaussian processes

abstract: Astrophysically motivated population models for binary black hole observables are often insufficient to capture the imprints of multiple formation channels. This is mainly due to the strongly parametrized nature of such investigations. Using a non-parametric model for the joint population-level distributions of binary black hole component masses and effective inspiral spins, we find hints of multiple subpopulations in the third gravitational wave transient catalog. The higher (more positive) spin subpopulation is found to have a mass-spectrum without any feature at the $30-40M_{\odot}$, which is consistent with the predictions of isolated stellar binary evolution, simulations for which place the pile up due to pulsational pair-instability supernovae near $50M_{\odot}$ or higher. The other sub-population with effective spins closer to zero shows a feature at $30-40M_{\odot}$ and is consistent with binary black holes formed dynamically in globular clusters, which are expected to peak around $30M_{\odot}$. We also compute merger rates for these two subpopulations and find that they are consistent with the theoretical predictions of the corresponding formation channels. We validate our results by checking their robustness against variations of several model configurations and by analyzing large simulated catalogs with the same model.


title: Non-variational Quantum Combinatorial Optimisation

abstract: This paper introduces a non-variational quantum algorithm designed to solve a wide range of combinatorial optimisation problems. The algorithm leverages an engineered interference process achieved through repeated application of two unitaries; one inducing phase-shifts dependent on objective function values, and the other mixing phase-shifted probability amplitudes via a continuous-time quantum walk (CTQW) on a problem-specific graph. The algorithm's versatility is demonstrated through its application to various problems, namely those for which solutions are characterised by either a vector of binary variables, a vector of non-binary integer variables, or permutations (a vector of integer variables without repetition). An efficient quantum circuit implementation of the CTQW for each of these problem types is also discussed. A penalty function approach for constrained problems is also introduced, including a method for optimising the penalty function. The algorithm's performance is demonstrated through numerical simulation for randomly generated instances of the following problems (and problem sizes): weighted maxcut (18 vertices), maximum independent set (18 vertices), k-means clustering (12 datapoints, 3 clusters), capacitated facility location (12 customers, 3 facility locations), and the quadratic assignment problem (9 locations). For each problem instance, the algorithm finds a globally optimal solution with a small number of iterations.


title: Asymptotic Purification of Quantum Trajectories under Random Generalized Measurements

abstract: We develop a general framework to study quantum trajectories resulting from repeated random measurements subject to stationary noise, and generalize results of K\"ummerer and Maassen to this setting. The resulting trajectory of quantum states is a time-inhomogeneous Markov chain in a random environment. K\"ummerer and Maassen introduced the concept of dark subspaces for noise-free processes, establishing that their absence is equivalent to asymptotic purification of the system state. We clarify the notion of dark subspaces in the disordered setting by defining a measurable correspondence consisting of a collection of random subspaces satisfying a darkness condition. We further prove that asymptotic purification occurs if and only if this collection of random dark subspaces is empty. Several examples of these phenomena are provided.


title: Maximal Entropy Measures for Non-Accessible Topological Skew Products

abstract: In this paper we establish a dichotomy for the ergodic measures of maximal entropy for partially hyperbolic diffeomorphisms with one-dimensional compact center leaves which are virtually skew products over (transitive) Anosov homeomorphism. We prove that if the whole manifold is the unique minimal invariant set saturated by unstable foliation, then either there exists a unique measure of maximal entropy which is non-hyperbolic or there are exactly two hyperbolic ergodic measures of maximal entropy.


title: A Dynamic Droplet Breakup Model for Eulerian-Lagrangian Simulation of Liquid-fueled Detonation

abstract: This study proposes a dynamic model to reflect the physical image of the droplet breakup process in two-phase detonation flows. This breakup model is implemented in a two-phase detonation solver developed based on an open-source computational fluid dynamic platform, OpenFOAM, and compared with three prevalent models (TAB, PilchErdman, and ReitzKH-RT model) under different droplet diameters in one- and two-dimensional detonation problems. The simulating results show that the present breakup model well predicts experimentally determined detonation parameters such as detonation velocities and post-wave temperature. In addition, the present model has the advantage of being free of the KH breakup time parameter, which is needed by the ReitzKH-RT model to fit the experimental data. The one-dimensional detonation simulations indicate that different breakup models have a slight impact on the detonation wave velocity because the droplet breakup process does not significantly affect the total heat release as long as it is sufficiently fast to sustain the detonation. However, the two-dimensional detonation simulations show that both the breakup model and the droplet initial diameter significantly affect the detonation cell size due to the different droplet distributions predicted by different models. The breakup length, which is the distance from the shock wave to the location at which sufficiently small child droplets appear, affects the chemical reaction zone thickness, which in turn affects the detonation cell size. A longer breakup length will result in a larger detonation cell size.


title: Multi-modal Learning for WebAssembly Reverse Engineering

abstract: The increasing adoption of WebAssembly (Wasm) for performance-critical and security-sensitive tasks drives the demand for WebAssembly program comprehension and reverse engineering. Recent studies have introduced machine learning (ML)-based WebAssembly reverse engineering tools. Yet, the generalization of task-specific ML solutions remains challenging, because their effectiveness hinges on the availability of an ample supply of high-quality task-specific labeled data. Moreover, previous works overlook the high-level semantics present in source code and its documentation. Acknowledging the abundance of available source code with documentation, which can be compiled into WebAssembly, we propose to learn representations of them concurrently and harness their mutual relationships for effective WebAssembly reverse engineering. In this paper, we present WasmRev, the first multi-modal pre-trained language model for WebAssembly reverse engineering. WasmRev is pre-trained using self-supervised learning on a large-scale multi-modal corpus encompassing source code, code documentation and the compiled WebAssembly, without requiring labeled data. WasmRev incorporates three tailored multi-modal pre-training tasks to capture various characteristics of WebAssembly and cross-modal relationships. WasmRev is only trained once to produce general-purpose representations that can broadly support WebAssembly reverse engineering tasks through few-shot fine-tuning with much less labeled data, improving data efficiency. We fine-tune WasmRev onto three important reverse engineering tasks: type recovery, function purpose identification and WebAssembly summarization. Our results show that WasmRev pre-trained on the corpus of multi-modal samples establishes a robust foundation for these tasks, achieving high task accuracy and outperforming the state-of-the-art ML methods for WebAssembly reverse engineering.


title: SEPE-SQED: Symbolic Quick Error Detection by Semantically Equivalent Program Execution

abstract: Symbolic quick error detection (SQED) has greatly improved efficiency in formal chip verification. However, it has a limitation in detecting single-instruction bugs due to its reliance on the self-consistency property. To address this, we propose a new variant called symbolic quick error detection by semantically equivalent program execution (SEPE-SQED), which utilizes program synthesis techniques to find sequences with equivalent meanings to original instructions. SEPE-SQED effectively detects single-instruction bugs by differentiating their impact on the original instruction and its semantically equivalent program (instruction sequence). To manage the search space associated with program synthesis, we introduce the CEGIS based on the highest priority first algorithm. The experimental results show that our proposed CEGIS approach improves the speed of generating the desired set of equivalent programs by 50% in time compared to previous methods. Compared to SQED, SEPE-SQED offers a wider variety of instruction combinations and can provide a shorter trace for triggering bugs in certain scenarios.


title: Centimeter-Scale Achromatic Hybrid Metalens Design: A New Paradigm Based on Differentiable Ray Tracing in the Visible Spectrum

abstract: Single metalenses are limited by their physical constraints, precluding themselves from achieving high numerical aperture across a wide visible spectral band in large-aperture applications. A hybrid system that integrates a metalens with a refractive lens can address this issue, yet previous designs lacked sufficient flexibility. Here, by reanalyzing the generalized Snell's law, we introduce a new paradigm for the hybrid metalens design based on differentiable ray tracing. Through joint optimization of the phase distribution of the metalens and refractive lens parameters, our system achieves achromatic performance within the broad spectral range of 440-700 nm, with an aperture of 1 cm and an f-number of 1.4. Owing to the differentiable nature of the proposed system, it can be seamlessly integrated as the optical front-end into any differentiable computational imaging system. Our system offers unprecedented opportunities for the advancement of metalenses in innovative optical design and computational imaging domains.


title: A comparison between the deflection angles of massive and massless particles in the Shchwarzschild space-time and their consequences on black hole shadows

abstract: We present comparisons of the deflection angles of massless and massive particles in the Schwarzschild space-time. For the case of photons in a general static space-time, we construct a spatial 3D equation of motion for their path that leads to an implicit formula for the deflection angle. We then compare our results with well known results of the literature in the Schwarzschild space-time. For the case of massive particles we calculate the deflection angle only in the Schwarzschild space-time. The end result is that as the velocity of any massive particle diminishes, the deflection angle increases. To show the relevance of these comparisons, we constructed different black hole shadows for massive particles in order to be compared with a shadow made by of photons.


title: Matching-star size Ramsey numbers under connectivity constraint

abstract: Recently, Caro, Patk\'os, and Tuza (2022) introduced the concept of connected Tur\'an number. We study a similar parameter in Ramsey theory. Given two graphs $G_1$ and $G_2$, the size Ramsey number $\hat{r}(G_1,G_2)$ refers to the smallest number of edges in a graph $G$ such that for any red-blue edge-coloring of $G$, either a red subgraph $G_1$ or a blue subgraph $G_2$ is present in $G$. If we further restrict the host graph $G$ to be connected, we obtain the connected size Ramsey number, denoted as $\hat{r}_c(G_1,G_2)$. Erd\H{o}s and Faudree (1984) proved that $\hat r(nK_2,K_{1,m})=mn$ for all positive integers $m,n$. In this paper, we concentrate on the connected analog of this result. Rahadjeng, Baskoro, and Assiyatun (2016) provided the exact values of $\hat r_c(nK_2,K_{1,m})$ for $n=2,3$. We establish a more general result: for all positive integers $m$ and $n$ with $m\ge (n^2+2pn+n-3)/2$, we have $\hat r_c(nK_{1,p},K_{1,m})=n(m+p)-1$. As a corollary, $\hat r_c(nK_2,K_{1,m})=nm+n-1$ for $m\ge (n^2+3n-3)/2$. We also propose a conjecture for the interested reader.


title: Information-Theoretic Generalization Bounds for Deep Neural Networks

abstract: Deep neural networks (DNNs) exhibit an exceptional capacity for generalization in practical applications. This work aims to capture the effect and benefits of depth for supervised learning via information-theoretic generalization bounds. We first derive two hierarchical bounds on the generalization error in terms of the Kullback-Leibler (KL) divergence or the 1-Wasserstein distance between the train and test distributions of the network internal representations. The KL divergence bound shrinks as the layer index increases, while the Wasserstein bound implies the existence of a layer that serves as a generalization funnel, which attains a minimal 1-Wasserstein distance. Analytic expressions for both bounds are derived under the setting of binary Gaussian classification with linear DNNs. To quantify the contraction of the relevant information measures when moving deeper into the network, we analyze the strong data processing inequality (SDPI) coefficient between consecutive layers of three regularized DNN models: Dropout, DropConnect, and Gaussian noise injection. This enables refining our generalization bounds to capture the contraction as a function of the network architecture parameters. Specializing our results to DNNs with a finite parameter space and the Gibbs algorithm reveals that deeper yet narrower network architectures generalize better in those examples, although how broadly this statement applies remains a question.


title: Direct visualization of local magnetic domain dynamics in a 2D Van der Walls material/ferromagnet interface

abstract: Exploring new strategies for controlling the magnetic domain propagation is the key to realize ultrafast, high-density domain wall-based memory and logic devices for next generation computing. These strategies include strain modulation in multiferroic devices, geometric confinement and area-selective pinning of domain wall. 2D Van der Waals materials introduce localized modifications to the interfacial magnetic order, enabling control over the propagation of magnetic domains. Here, using Lorentz-Transmission Electron Microscopy (L-TEM) along with the Modified Transport of Intensity equations (MTIE), we demonstrate controlled domain expansion with in-situ magnetic field in a ferromagnet (Permalloy, NiFe) interfacing with a 2D Van der Waals material Graphene (Gr). The Gr/NiFe interface exhibits distinctive domain expansion rate with magnetic field selectively near the interface which is further analyzed using micromagnetic simulations. Our findings are crucial for comprehending direct visualization of interface controlled magnetic domain expansion, offering insights for developing future domain wall-based technology.


title: Berezinskii-Kosterlitz-Thouless transitions in a ferromagnetic superfluid: effects of axial magnetization

abstract: An easy-plane ferromagnetic spin-1 Bose gas undergoes two Berezinskii-Kosterlitz-Thouless (BKT) transitions, associated with mass and spin superfluidity respectively. We study the effect of axial magnetization on the superfluid properties of this system. We find that nonzero axial magnetization couples mass and spin superflow, via a mechanism analogous to the Andreev-Bashkin effect present in two-component superfluids. With sufficiently large axial magnetization mass and spin superfluidity arise simultaneously. The cross-over to this phase provides a finite-temperature generalization of the zero-temperature broken-axisymmetric to easy-axis transition. We present analytic relations connecting mass and spin superfluidity with experimentally observable coherence of the three spinor components and local magnetization.


title: UniAV: Unified Audio-Visual Perception for Multi-Task Video Localization

abstract: Video localization tasks aim to temporally locate specific instances in videos, including temporal action localization (TAL), sound event detection (SED) and audio-visual event localization (AVEL). Existing methods over-specialize on each task, overlooking the fact that these instances often occur in the same video to form the complete video content. In this work, we present UniAV, a Unified Audio-Visual perception network, to achieve joint learning of TAL, SED and AVEL tasks for the first time. UniAV can leverage diverse data available in task-specific datasets, allowing the model to learn and share mutually beneficial knowledge across tasks and modalities. To tackle the challenges posed by substantial variations in datasets (size/domain/duration) and distinct task characteristics, we propose to uniformly encode visual and audio modalities of all videos to derive generic representations, while also designing task-specific experts to capture unique knowledge for each task. Besides, we develop a unified language-aware classifier by utilizing a pre-trained text encoder, enabling the model to flexibly detect various types of instances and previously unseen ones by simply changing prompts during inference. UniAV outperforms its single-task counterparts by a large margin with fewer parameters, achieving on-par or superior performances compared to state-of-the-art task-specific methods across ActivityNet 1.3, DESED and UnAV-100 benchmarks.


title: Goldfish: An Efficient Federated Unlearning Framework

abstract: With recent legislation on the right to be forgotten, machine unlearning has emerged as a crucial research area. It facilitates the removal of a user's data from federated trained machine learning models without the necessity for retraining from scratch. However, current machine unlearning algorithms are confronted with challenges of efficiency and validity. To address the above issues, we propose a new framework, named Goldfish. It comprises four modules: basic model, loss function, optimization, and extension. To address the challenge of low validity in existing machine unlearning algorithms, we propose a novel loss function. It takes into account the loss arising from the discrepancy between predictions and actual labels in the remaining dataset. Simultaneously, it takes into consideration the bias of predicted results on the removed dataset. Moreover, it accounts for the confidence level of predicted results. Additionally, to enhance efficiency, we adopt knowledge a distillation technique in the basic model and introduce an optimization module that encompasses the early termination mechanism guided by empirical risk and the data partition mechanism. Furthermore, to bolster the robustness of the aggregated model, we propose an extension module that incorporates a mechanism using adaptive distillation temperature to address the heterogeneity of user local data and a mechanism using adaptive weight to handle the variety in the quality of uploaded models. Finally, we conduct comprehensive experiments to illustrate the effectiveness of proposed approach.


title: MonoCD: Monocular 3D Object Detection with Complementary Depths

abstract: Monocular 3D object detection has attracted widespread attention due to its potential to accurately obtain object 3D localization from a single image at a low cost. Depth estimation is an essential but challenging subtask of monocular 3D object detection due to the ill-posedness of 2D to 3D mapping. Many methods explore multiple local depth clues such as object heights and keypoints and then formulate the object depth estimation as an ensemble of multiple depth predictions to mitigate the insufficiency of single-depth information. However, the errors of existing multiple depths tend to have the same sign, which hinders them from neutralizing each other and limits the overall accuracy of combined depth. To alleviate this problem, we propose to increase the complementarity of depths with two novel designs. First, we add a new depth prediction branch named complementary depth that utilizes global and efficient depth clues from the entire image rather than the local clues to reduce the correlation of depth predictions. Second, we propose to fully exploit the geometric relations between multiple depth clues to achieve complementarity in form. Benefiting from these designs, our method achieves higher complementarity. Experiments on the KITTI benchmark demonstrate that our method achieves state-of-the-art performance without introducing extra data. In addition, complementary depth can also be a lightweight and plug-and-play module to boost multiple existing monocular 3d object detectors. Code is available at https://github.com/elvintanhust/MonoCD.


title: Direct interpolative construction of the discrete Fourier transform as a matrix product operator

abstract: The quantum Fourier transform (QFT), which can be viewed as a reindexing of the discrete Fourier transform (DFT), has been shown to be compressible as a low-rank matrix product operator (MPO) or quantized tensor train (QTT) operator. However, the original proof of this fact does not furnish a construction of the MPO with a guaranteed error bound. Meanwhile, the existing practical construction of this MPO, based on the compression of a quantum circuit, is not as efficient as possible. We present a simple closed-form construction of the QFT MPO using the interpolative decomposition, with guaranteed near-optimal compression error for a given rank. This construction can speed up the application of the QFT and the DFT, respectively, in quantum circuit simulations and QTT applications. We also connect our interpolative construction to the approximate quantum Fourier transform (AQFT) by demonstrating that the AQFT can be viewed as an MPO constructed using a different interpolation scheme.


title: BodyMAP -- Jointly Predicting Body Mesh and 3D Applied Pressure Map for People in Bed

abstract: Accurately predicting the 3D human posture and the pressure exerted on the body for people resting in bed, visualized as a body mesh (3D pose & shape) with a 3D pressure map, holds significant promise for healthcare applications, particularly, in the prevention of pressure ulcers. Current methods focus on singular facets of the problem -- predicting only 2D/3D poses, generating 2D pressure images, predicting pressure only for certain body regions instead of the full body, or forming indirect approximations to the 3D pressure map. In contrast, we introduce BodyMAP, which jointly predicts the human body mesh and 3D applied pressure map across the entire human body. Our network leverages multiple visual modalities, incorporating both a depth image of a person in bed and its corresponding 2D pressure image acquired from a pressure-sensing mattress. The 3D pressure map is represented as a pressure value at each mesh vertex and thus allows for precise localization of high-pressure regions on the body. Additionally, we present BodyMAP-WS, a new formulation of pressure prediction in which we implicitly learn pressure in 3D by aligning sensed 2D pressure images with a differentiable 2D projection of the predicted 3D pressure maps. In evaluations with real-world human data, our method outperforms the current state-of-the-art technique by 25% on both body mesh and 3D applied pressure map prediction tasks for people in bed.


title: The Death of Feature Engineering? BERT with Linguistic Features on SQuAD 2.0

abstract: Machine reading comprehension is an essential natural language processing task, which takes into a pair of context and query and predicts the corresponding answer to query. In this project, we developed an end-to-end question answering model incorporating BERT and additional linguistic features. We conclude that the BERT base model will be improved by incorporating the features. The EM score and F1 score are improved 2.17 and 2.14 compared with BERT(base). Our best single model reaches EM score 76.55 and F1 score 79.97 in the hidden test set. Our error analysis also shows that the linguistic architecture can help model understand the context better in that it can locate answers that BERT only model predicted "No Answer" wrongly.


title: $\frac{5}{2}$ fractional quantum Hall state in GaAs with Landau level mixing

abstract: The Landau level mixing is the key in understanding the mysterious $5/2$ fractional quantum Hall effect in GaAs quantum well. Theoretical calculations with and without Landau level mixing show striking differences. However, the way to deal with the considerable strong Landau level mixing in GaAs is still unsatisfactory. We develop a method combining the screening and the perturbation theories to study the nature of the $5/2$ fractional quantum Hall effect in GaAs efficiently. The screening which has been succeed in explaining ZnO systems integrates out the low-energy Landau levels close to the related Landau level, while the other high-energy Landau levels are integrated out by the perturbation theory. We find that the ground states still hold the quasi-triplet degeneracy which implies the Pfaffian nature of the system. Furthermore, the particle-hole symmetry is only weakly violated since the particle-hole parity is close to unity. We propose that the ground state in the finite-size calculations can be approximated as a variational superposition of the Pfaffian and anit-Pfaffian states. In the experimental environment the symmetrized Pfaffian component is dominant, corresponding a thermal conductance around $2.5$ quanta can be understood consequently.


title: RAnGE: Reachability Analysis for Guaranteed Ergodicity

abstract: This paper investigates performance guarantees on coverage-based ergodic exploration methods in environments containing disturbances. Ergodic exploration methods generate trajectories for autonomous robots such that time spent in an area is proportional to the utility of exploring in the area. However, providing formal performance guarantees for ergodic exploration methods is still an open challenge due to the complexities in the problem formulation. In this work, we propose to formulate ergodic search as a differential game, in which a controller and external disturbance force seek to minimize and maximize the ergodic metric, respectively. Through an extended-state Bolza-form transform of the ergodic problem, we demonstrate it is possible to use techniques from reachability analysis to solve for optimal controllers that guarantee coverage and are robust against disturbances. Our approach leverages neural-network based methods to obtain approximate value function solutions for reachability problems that mitigate the increased computational scaling due to the extended state. As a result, we are able to compute continuous value functions for the ergodic exploration problem and provide performance guarantees for coverage under disturbances. Simulated and experimental results demonstrate the efficacy of our approach to generate robust ergodic trajectories for search and exploration with external disturbance force.


title: AGL-NET: Aerial-Ground Cross-Modal Global Localization with Varying Scales

abstract: We present AGL-NET, a novel learning-based method for global localization using LiDAR point clouds and satellite maps. AGL-NET tackles two critical challenges: bridging the representation gap between image and points modalities for robust feature matching, and handling inherent scale discrepancies between global view and local view. To address these challenges, AGL-NET leverages a unified network architecture with a novel two-stage matching design. The first stage extracts informative neural features directly from raw sensor data and performs initial feature matching. The second stage refines this matching process by extracting informative skeleton features and incorporating a novel scale alignment step to rectify scale variations between LiDAR and map data. Furthermore, a novel scale and skeleton loss function guides the network toward learning scale-invariant feature representations, eliminating the need for pre-processing satellite maps. This significantly improves real-world applicability in scenarios with unknown map scales. To facilitate rigorous performance evaluation, we introduce a meticulously designed dataset within the CARLA simulator specifically tailored for metric localization training and assessment. The code and dataset will be made publicly available.


title: Classification of Nasopharyngeal Cases using DenseNet Deep Learning Architecture

abstract: Nasopharyngeal carcinoma (NPC) is one of the understudied yet deadliest cancers in South East Asia. In Malaysia, the prevalence is identified mainly in Sarawak, among the ethnic of Bidayuh. NPC is often late-diagnosed because it is asymptomatic at the early stage. There are several tissue representations from the nasopharynx biopsy, such as nasopharyngeal inflammation (NPI), lymphoid hyperplasia (LHP), nasopharyngeal carcinoma (NPC) and normal tissue. This paper is our first initiative to identify the difference between NPC, NPI and normal cases. Seven whole slide images (WSIs) with gigapixel resolutions from seven different patients and two hospitals were experimented with using two test setups, consisting of a different set of images. The tissue regions are patched into smaller blocks and classified using DenseNet architecture with 21 dense layers. Two tests are carried out, each for proof of concept (Test 1) and real-test scenario (Test 2). The accuracy achieved for NPC class is 94.8% for Test 1 and 67.0% for Test 2.


title: The Probabilities Also Matter: A More Faithful Metric for Faithfulness of Free-Text Explanations in Large Language Models

abstract: In order to oversee advanced AI systems, it is important to understand their underlying decision-making process. When prompted, large language models (LLMs) can provide natural language explanations or reasoning traces that sound plausible and receive high ratings from human annotators. However, it is unclear to what extent these explanations are faithful, i.e., truly capture the factors responsible for the model's predictions. In this work, we introduce Correlational Explanatory Faithfulness (CEF), a metric that can be used in faithfulness tests based on input interventions. Previous metrics used in such tests take into account only binary changes in the predictions. Our metric accounts for the total shift in the model's predicted label distribution, more accurately reflecting the explanations' faithfulness. We then introduce the Correlational Counterfactual Test (CCT) by instantiating CEF on the Counterfactual Test (CT) from Atanasova et al. (2023). We evaluate the faithfulness of free-text explanations generated by few-shot-prompted LLMs from the Llama2 family on three NLP tasks. We find that our metric measures aspects of faithfulness which the CT misses.


title: Adaptive Discrete Disparity Volume for Self-supervised Monocular Depth Estimation

abstract: In self-supervised monocular depth estimation tasks, discrete disparity prediction has been proven to attain higher quality depth maps than common continuous methods. However, current discretization strategies often divide depth ranges of scenes into bins in a handcrafted and rigid manner, limiting model performance. In this paper, we propose a learnable module, Adaptive Discrete Disparity Volume (ADDV), which is capable of dynamically sensing depth distributions in different RGB images and generating adaptive bins for them. Without any extra supervision, this module can be integrated into existing CNN architectures, allowing networks to produce representative values for bins and a probability volume over them. Furthermore, we introduce novel training strategies - uniformizing and sharpening - through a loss term and temperature parameter, respectively, to provide regularizations under self-supervised conditions, preventing model degradation or collapse. Empirical results demonstrate that ADDV effectively processes global information, generating appropriate bins for various scenes and producing higher quality depth maps compared to handcrafted methods.


title: CORP: A Multi-Modal Dataset for Campus-Oriented Roadside Perception Tasks

abstract: Numerous roadside perception datasets have been introduced to propel advancements in autonomous driving and intelligent transportation systems research and development. However, it has been observed that the majority of their concentrates is on urban arterial roads, inadvertently overlooking residential areas such as parks and campuses that exhibit entirely distinct characteristics. In light of this gap, we propose CORP, which stands as the first public benchmark dataset tailored for multi-modal roadside perception tasks under campus scenarios. Collected in a university campus, CORP consists of over 205k images plus 102k point clouds captured from 18 cameras and 9 LiDAR sensors. These sensors with different configurations are mounted on roadside utility poles to provide diverse viewpoints within the campus region. The annotations of CORP encompass multi-dimensional information beyond 2D and 3D bounding boxes, providing extra support for 3D seamless tracking and instance segmentation with unique IDs and pixel masks for identifying targets, to enhance the understanding of objects and their behaviors distributed across the campus premises. Unlike other roadside datasets about urban traffic, CORP extends the spectrum to highlight the challenges for multi-modal perception in campuses and other residential areas.


title: Do Large Language Models Rank Fairly? An Empirical Study on the Fairness of LLMs as Rankers

abstract: The integration of Large Language Models (LLMs) in information retrieval has raised a critical reevaluation of fairness in the text-ranking models. LLMs, such as GPT models and Llama2, have shown effectiveness in natural language understanding tasks, and prior works (e.g., RankGPT) have also demonstrated that the LLMs exhibit better performance than the traditional ranking models in the ranking task. However, their fairness remains largely unexplored. This paper presents an empirical study evaluating these LLMs using the TREC Fair Ranking dataset, focusing on the representation of binary protected attributes such as gender and geographic location, which are historically underrepresented in search outcomes. Our analysis delves into how these LLMs handle queries and documents related to these attributes, aiming to uncover biases in their ranking algorithms. We assess fairness from both user and content perspectives, contributing an empirical benchmark for evaluating LLMs as the fair ranker.


title: Foundation of Floer homotopy theory I: Flow categories

abstract: We construct a stable infinity category with objects flow categories and morphisms flow bimodules; our construction has many flavors, related to a choice of bordism theory, and we discuss in particular framed bordism and the bordism theory of complex oriented derived orbifolds. In this setup, the construction of homotopy types associated to Floer-theoretic data is immediate: the moduli spaces of solutions to Floer's equation assemble into a flow category with respect to the appropriate bordism theory, and the associated Floer homotopy types arise as suitable mapping spectra in this category. The definition of these mapping spectra is sufficiently explicit to allow a direct interpretation of the Floer homotopy groups as Floer bordism groups. In the setting of framed bordism, we show that the category we construct is a model for the category of spectra. We implement the construction of Floer homotopy types in this new formalism for the case of Hamiltonian Floer theory.


title: Reservoir Sampling over Joins

abstract: Sampling over joins is a fundamental task in large-scale data analytics. Instead of computing the full join results, which could be massive, a uniform sample of the join results would suffice for many purposes, such as answering analytical queries or training machine learning models. In this paper, we study the problem of how to maintain a random sample over joins while the tuples are streaming in. Without the join, this problem can be solved by some simple and classical reservoir sampling algorithms. However, the join operator makes the problem significantly harder, as the join size can be polynomially larger than the input. We present a new algorithm for this problem that achieves a near-linear complexity. The key technical components are a generalized reservoir sampling algorithm that supports a predicate, and a dynamic index for sampling over joins. We also conduct extensive experiments on both graph and relational data over various join queries, and the experimental results demonstrate significant performance improvement over the state of the art.


title: On type-II Spacetimes and the Double Copy for Fluids Metrics

abstract: In our previous paper (arXiv:2005.04242) we discussed type-D and type-N fluid-dual spacetimes and provided their associated single copies in the context of the Weyl double copy. In this work we extend our analysis to more general fluids thereby requiring the application of the double copy picture to type-II space-times. By combining our previous type-D and type-N fluids via their associated stream functions we demonstrate an example of a viable type-II double copy. Further we use an explicitly perturbative approach in the near horizon expansion to generalize the type II double copy for the fluid-dual space-times. We show a Maxwell spinor ansatz containing a heterogeneous bi-spinor component is necessary to provide a viable type-II double copy at the lowest order.


title: Okay, Let's Do This! Modeling Event Coreference with Generated Rationales and Knowledge Distillation

abstract: In NLP, Event Coreference Resolution (ECR) is the task of connecting event clusters that refer to the same underlying real-life event, usually via neural systems. In this work, we investigate using abductive free-text rationales (FTRs) generated by modern autoregressive LLMs as distant supervision of smaller student models for cross-document coreference (CDCR) of events. We implement novel rationale-oriented event clustering and knowledge distillation methods for event coreference scoring that leverage enriched information from the FTRs for improved CDCR without additional annotation or expensive document clustering. Our model using coreference specific knowledge distillation achieves SOTA B3 F1 on the ECB+ and GVC corpora and we establish a new baseline on the AIDA Phase 1 corpus. Our code can be found at https://github.com/csu-signal/llama_cdcr


title: A Rolling Horizon Restoration Framework for Post-disaster Restoration of Electrical Distribution Networks

abstract: Severe weather events such as floods, hurricanes, earthquakes, and large wind or ice storms can cause extensive damage to electrical distribution networks, requiring a multi-day restoration effort. Complicating the recovery process is the lack of complete and accurate information regarding the extent and locations of damages, at least during the initial part of the recovery process. These factors make workforce planning challenging. In this paper, we adopt a rolling horizon restoration framework whereby repairs are planned for adjustable finite length restoration windows. Considering both repair times as well as travel times, we show that the optimal scheduling problem with multiple crews, each with their own time budget, can be recast in terms of a cost constrained reward maximizing mTSP (traveling salesman problem) on doubly weighted graphs, where the objective is to maximize the aggregate reward earned during the upcoming restoration window, provided no crew violates its time budget and certain electrical continuity constraints are met. We propose a mixed integer linear programming (MILP) model for solving the above problem which is validated on standard IEEE PES test feeder networks.


title: Delaunay Weighted Two-sample Test for High-dimensional Data by Incorporating Geometric Information

abstract: Two-sample hypothesis testing is a fundamental problem with various applications, which faces new challenges in the high-dimensional context. To mitigate the issue of the curse of dimensionality, high-dimensional data are typically assumed to lie on a low-dimensional manifold. To incorporate geometric informtion in the data, we propose to apply the Delaunay triangulation and develop the Delaunay weight to measure the geometric proximity among data points. In contrast to existing similarity measures that only utilize pairwise distances, the Delaunay weight can take both the distance and direction information into account. A detailed computation procedure to approximate the Delaunay weight for the unknown manifold is developed. We further propose a novel nonparametric test statistic using the Delaunay weight matrix to test whether the underlying distributions of two samples are the same or not. Applied on simulated data, the new test exhibits substantial power gain in detecting differences in principal directions between distributions. The proposed test also shows great power on a real dataset of human face images.


title: Negative-energy waves in the vertical threads of a solar prominence

abstract: Solar prominences, intricate structures on the Sun's limb, have been a subject of fascination due to their thread-like features and dynamic behaviors. Utilizing data from the New Vacuum Solar Telescope (NVST), Chinese H_alpha Solar Explorer (CHASE), and Solar Dynamics Observatory (SDO), this study investigates the transverse swaying motions observed in the vertical threads of a solar prominence during its eruption onset on May 11, 2023. The transverse swaying motions were observed to propagate upward, accompanied by upflowing materials at an inclination of 31 degrees relative to the plane of the sky. These motions displayed small-amplitude oscillations with corrected velocities of around 3-4 km/s and periods of 13-17 minutes. Over time, the oscillations of swaying motion exhibited an increasing pattern in displacement amplitudes, oscillatory periods, and projected velocity amplitudes. Their phase velocities are estimated to be about 26-34 km/s. An important finding is that these oscillations'phase velocities are comparable to the upward flow velocities, measured to be around 30-34 km/s. We propose that this phenomenon is associated with negative-energy wave instabilities, which require comparable velocities of the waves and flows, as indicated by our findings. This phenomenon may contribute to the instability and observed disruption of the prominence. By using prominence seismology, the Alfven speed and magnetic field strength of the vertical threads have been estimated to be approximately 21.5 km/s and 2 Gauss, respectively. This study reveals the dynamics and magnetic properties of solar prominences, contributing to our understanding of their behavior in the solar atmosphere.


title: Future-Proofing Class Incremental Learning

abstract: Exemplar-Free Class Incremental Learning is a highly challenging setting where replay memory is unavailable. Methods relying on frozen feature extractors have drawn attention recently in this setting due to their impressive performances and lower computational costs. However, those methods are highly dependent on the data used to train the feature extractor and may struggle when an insufficient amount of classes are available during the first incremental step. To overcome this limitation, we propose to use a pre-trained text-to-image diffusion model in order to generate synthetic images of future classes and use them to train the feature extractor. Experiments on the standard benchmarks CIFAR100 and ImageNet-Subset demonstrate that our proposed method can be used to improve state-of-the-art methods for exemplar-free class incremental learning, especially in the most difficult settings where the first incremental step only contains few classes. Moreover, we show that using synthetic samples of future classes achieves higher performance than using real data from different classes, paving the way for better and less costly pre-training methods for incremental learning.


title: Groundhog: Linearly-Scalable Smart Contracting via Commutative Transaction Semantics

abstract: Groundhog is a novel design for a smart contract execution engine based around concurrent execution of blocks of transactions. Unlike prior work, transactions within a block in Groundhog are not ordered relative to one another. Instead, our key design insights are first, to design a set of commutative semantics that lets the Groundhog runtime deterministically resolve concurrent accesses to shared data. Second, some storage accesses (such as withdrawing money from an account) conflict irresolvably; Groundhog therefore enforces validity constraints on persistent storage accesses via a reserve-commit process. These two ideas give Groundhog a set of semantics that, while not as powerful as traditional sequential semantics, are flexible enough to implement a wide variety of important applications, and are strictly more powerful than the semantics used in some production blockchains today. Unlike prior smart contract systems, transactions throughput never suffers from contention between transactions. Using 96 CPU cores, Groundhog can process more than half a million payment transactions per second, whether between 10M accounts or just 2.


title: OmniGS: Omnidirectional Gaussian Splatting for Fast Radiance Field Reconstruction using Omnidirectional Images

abstract: Photorealistic reconstruction relying on 3D Gaussian Splatting has shown promising potential in robotics. However, the current 3D Gaussian Splatting system only supports radiance field reconstruction using undistorted perspective images. In this paper, we present OmniGS, a novel omnidirectional Gaussian splatting system, to take advantage of omnidirectional images for fast radiance field reconstruction. Specifically, we conduct a theoretical analysis of spherical camera model derivatives in 3D Gaussian Splatting. According to the derivatives, we then implement a new GPU-accelerated omnidirectional rasterizer that directly splats 3D Gaussians onto the equirectangular screen space for omnidirectional image rendering. As a result, we realize differentiable optimization of the radiance field without the requirement of cube-map rectification or tangent-plane approximation. Extensive experiments conducted in egocentric and roaming scenarios demonstrate that our method achieves state-of-the-art reconstruction quality and high rendering speed using omnidirectional images. To benefit the research community, the code will be made publicly available once the paper is published.


title: Giant and controllable nonlinear magneto-optical effects in two-dimensional magnets

abstract: The interplay of polarization and magnetism in materials with light can create rich nonlinear magneto-optical (NLMO) effects, and the recent discovery of two-dimensional (2D) van der Waals magnets provides remarkable control over NLMO effects due to their superb tunability. Here, based on first-principles calculations, we reported giant NLMO effects in CrI3-based 2D magnets, including a dramatic change of second-harmonics generation (SHG) polarization direction (90 degrees) and intensity (on/off switch) under magnetization reversal, and a 100% SHG circular dichroism effect. We further revealed that these effects could not only be used to design ultra-thin multifunctional optical devices, but also to detect subtle magnetic orderings. Remarkably, we analytically derived conditions to achieve giant NLMO effects and propose general strategies to realize them in 2D magnets. Our work not only uncovers a series of intriguing NLMO phenomena, but also paves the way for both fundamental research and device applications of ultra-thin NLMO materials.


title: RALL-E: Robust Codec Language Modeling with Chain-of-Thought Prompting for Text-to-Speech Synthesis

abstract: We present RALL-E, a robust language modeling method for text-to-speech (TTS) synthesis. While previous work based on large language models (LLMs) shows impressive performance on zero-shot TTS, such methods often suffer from poor robustness, such as unstable prosody (weird pitch and rhythm/duration) and a high word error rate (WER), due to the autoregressive prediction style of language models. The core idea behind RALL-E is chain-of-thought (CoT) prompting, which decomposes the task into simpler steps to enhance the robustness of LLM-based TTS. To accomplish this idea, RALL-E first predicts prosody features (pitch and duration) of the input text and uses them as intermediate conditions to predict speech tokens in a CoT style. Second, RALL-E utilizes the predicted duration prompt to guide the computing of self-attention weights in Transformer to enforce the model to focus on the corresponding phonemes and prosody features when predicting speech tokens. Results of comprehensive objective and subjective evaluations demonstrate that, compared to a powerful baseline method VALL-E, RALL-E significantly improves the WER of zero-shot TTS from $5.6\%$ (without reranking) and $1.7\%$ (with reranking) to $2.5\%$ and $1.0\%$, respectively. Furthermore, we demonstrate that RALL-E correctly synthesizes sentences that are hard for VALL-E and reduces the error rate from $68\%$ to $4\%$.


title: Optimal Dynamical Gauge in the Quantum Rabi Model

abstract: In this paper, we investigate the gauge dependence of various physical observables in the quantum Rabi model (QRM) under different potential fields, arising from the Hilbert-space truncation of the atomic degree of freedom. We discover that in both the square-well potential and oscillator potential,the optimal gauges for the ground-state energy of the QRM vary with respect to the cavity frequency, with the dipole gauge being optimal in the low-frequency limit and the Coulomb gauge in the high-frequency limit of the cavity frequency. Additionally, for higher energy levels, the optimal gauge asymptotically approaches the dipole gauge. However, for the dynamical quantity out-time-order correlator (OTOC), we find the necessity to introduce an optimal dynamical gauge. We determine the optimal dynamical gauge by minimizing the mean error between the two-level OTOC and the full Hamiltonian one. We expect that this study will contribute to a more profound understanding of the subtle relation between gauge choice and the dynamics of QED systems.


title: NLP4Gov: A Comprehensive Library for Computational Policy Analysis

abstract: Formal rules and policies are fundamental in formally specifying a social system: its operation, boundaries, processes, and even ontology. Recent scholarship has highlighted the role of formal policy in collective knowledge creation, game communities, the production of digital public goods, and national social media governance. Researchers have shown interest in how online communities convene tenable self-governance mechanisms to regulate member activities and distribute rights and privileges by designating responsibilities, roles, and hierarchies. We present NLP4Gov, an interactive kit to train and aid scholars and practitioners alike in computational policy analysis. The library explores and integrates methods and capabilities from computational linguistics and NLP to generate semantic and symbolic representations of community policies from text records. Versatile, documented, and accessible, NLP4Gov provides granular and comparative views into institutional structures and interactions, along with other information extraction capabilities for downstream analysis.


title: Competitive coexistence of ferromagnetism and metal--insulator transition of VO$_2$ nanoparticles

abstract: We investigated the magnetic and electric properties of nanometer-sized vanadium dioxide (VO$_2$) particles. VO$_2$ nanoparticles were formed by milling VO$_2$ powder. We measured the magnetic field dependence of the magnetization of the VO$_2$ powder and nanoparticles. The VO$_2$ powder did not exhibit ferromagnetism, whereas the VO$_2$ nanoparticles exhibited ferromagnetism. In addition, we fabricated samples by bridging between electrodes with the VO$_2$ nanoparticles, and the temperature dependence of their resistance was measured. Metal-insulator transitions (MITs) were observed, and the temperature range where the MIT occurred was wider than that in a typical bulk VO$_2$. The VO$_2$ nanoparticles exhibited these properties of ferromagnetism and MIT possibly because of the surface and size effects of the VO$_2$ nanoparticles. These results indicate the first observation of the competitive coexistence of ferromagnetism and MIT of VO$_2$ nanoparticles.


title: HiMAL: A Multimodal Hierarchical Multi-task Auxiliary Learning framework for predicting and explaining Alzheimer disease progression

abstract: Objective: We aimed to develop and validate a novel multimodal framework HiMAL (Hierarchical, Multi-task Auxiliary Learning) framework, for predicting cognitive composite functions as auxiliary tasks that estimate the longitudinal risk of transition from Mild Cognitive Impairment (MCI) to Alzheimer Disease (AD). Methods: HiMAL utilized multimodal longitudinal visit data including imaging features, cognitive assessment scores, and clinical variables from MCI patients in the Alzheimer Disease Neuroimaging Initiative (ADNI) dataset, to predict at each visit if an MCI patient will progress to AD within the next 6 months. Performance of HiMAL was compared with state-of-the-art single-task and multi-task baselines using area under the receiver operator curve (AUROC) and precision recall curve (AUPRC) metrics. An ablation study was performed to assess the impact of each input modality on model performance. Additionally, longitudinal explanations regarding risk of disease progression were provided to interpret the predicted cognitive decline. Results: Out of 634 MCI patients (mean [IQR] age : 72.8 [67-78], 60% men), 209 (32%) progressed to AD. HiMAL showed better prediction performance compared to all single-modality singe-task baselines (AUROC = 0.923 [0.915-0.937]; AUPRC= 0.623 [0.605-0.644]; all p<0.05). Ablation analysis highlighted that imaging and cognition scores with maximum contribution towards prediction of disease progression. Discussion: Clinically informative model explanations anticipate cognitive decline 6 months in advance, aiding clinicians in future disease progression assessment. HiMAL relies on routinely collected EHR variables for proximal (6 months) prediction of AD onset, indicating its translational potential for point-of-care monitoring and managing of high-risk patients.


title: CSR-dMRI: Continuous Super-Resolution of Diffusion MRI with Anatomical Structure-assisted Implicit Neural Representation Learning

abstract: Deep learning-based dMRI super-resolution methods can effectively enhance image resolution by leveraging the learning capabilities of neural networks on large datasets. However, these methods tend to learn a fixed scale mapping between low-resolution (LR) and high-resolution (HR) images, overlooking the need for radiologists to scale the images at arbitrary resolutions. Moreover, the pixel-wise loss in the image domain tends to generate over-smoothed results, losing fine textures and edge information. To address these issues, we propose a novel continuous super-resolution of dMRI with anatomical structure-assisted implicit neural representation learning method, called CSR-dMRI. Specifically, the CSR-dMRI model consists of two components. The first is the latent feature extractor, which primarily extracts latent space feature maps from LR dMRI and anatomical images while learning structural prior information from the anatomical images. The second is the implicit function network, which utilizes voxel coordinates and latent feature vectors to generate voxel intensities at corresponding positions. Additionally, a frequency-domain-based loss is introduced to preserve the structural and texture information, further enhancing the image quality. Extensive experiments on the publicly available HCP dataset validate the effectiveness of our approach. Furthermore, our method demonstrates superior generalization capability and can be applied to arbitrary-scale super-resolution, including non-integer scale factors, expanding its applicability beyond conventional approaches.