title: Indefinitely Flat Circular Velocities and the Baryonic Tully-Fisher Relation from Weak Lensing

abstract: We use a new deprojection formula to infer the gravitational potential around isolated galaxies from weak gravitational lensing. The results imply circular velocity curves that remain flat for hundreds of kpc, greatly extending the classic result from 21 cm observations. Indeed, there is no clear hint of a decline out to 1 Mpc, well beyond the expected virial radii of dark matter halos. Binning the data by mass reveals a correlation with the flat circular speed that closely agrees with the Baryonic Tully-Fisher Relation known from kinematic data. These results apply to both early and late type galaxies, indicating a common universal behavior.


title: Enhancing Text Corpus Exploration with Post Hoc Explanations and Comparative Design

abstract: Text corpus exploration (TCE) spans the range of exploratory search tasks: it goes beyond simple retrieval to include item discovery and learning about the corpus and topic. Systems support TCE with tools such as similarity-based recommendations and embedding-based spatial maps. However, these tools address specific tasks; current systems lack the flexibility to support the range of tasks encountered in practice and the iterative, multiscale, workflows users employ. In this paper, we provide methods that enhance TCE tools with post hoc explanations and multiscale, comparative designs to provide flexible support for user needs. We introduce salience functions as a mechanism to provide post hoc explanations of similarity, recommendations, and spatial placement. This post hoc strategy allows our approach to complement a variety of underlying algorithms; the salience functions provide both exemplar- and feature-based explanations at scales ranging from individual documents through to the entire corpus. These explanations are incorporated into a set of views that operate at multiple scales. The views use design elements that explicitly support comparison to enable flexible integration. Together, these form an approach that provides a flexible toolset that can address a range of tasks. We demonstrate our approach in a prototype system that enables the exploration of corpora of paper abstracts and newspaper archives. Examples illustrate how our approach enables the system to flexibly support a wide range of tasks and workflows that emerge in user scenarios. A user study confirms that researchers are able to use our system to achieve a variety of tasks.


title: Interplay between topology and correlations in the second moir\'e band of twisted bilayer MoTe2

abstract: Topological flat bands formed in two-dimensional lattice systems offer unique opportunity to study the fractional phases of matter in the absence of an external magnetic field. Celebrated examples include fractional quantum anomalous Hall (FQAH) effects and fractional topological insulators. Recently, FQAH effects have been experimentally realized in both the twisted bilayer MoTe2 (tMoTe2) system and the rhombohedral stacked multilayer graphene/hBN moir\'e systems. To date, experimental studies mainly focus on the first moir\'e flat band, except a very recent work that reported the evidence of the integer and fractional quantum spin Hall effects in higher moir\'e bands of a 2.1{\deg} tMoTe2 device. Here, we present the systematical transport study of approximately 3{\deg} tMoTe2 devices, especially for the second moir\'e band. At {\nu} = -2 and -4, time-reversal-symmetric single and double quantum spin Hall states formed, consistent with the previous observation in 2.1{\deg} tMoTe2 device. On the other hand, we observed ferromagnetism in the second moir\'e band, and a Chern insulator state driven by out-of-plane magnetic fields at {\nu} = -3. At {\nu} = -2.5, nonmonotonic temperature dependence of resistivity and large out-of-plane negative magnetoresistance have been observed, which likely arises from the frustrated liquid-like ground state and weak effective Ruderman-Kittel-Kasuya-Yosida interactions. Applying out-of-plane electric field can induce quantum phase transitions at both integer and fractional filling factors. Our studies pave the way for realizing tunable topological states and other unexpected magnetic phases beyond the first moir\'e flat band based on twisted MoTe2 platform.


title: FreeCtrl: Constructing Control Centers with Feedforward Layers for Learning-Free Controllable Text Generation

abstract: Controllable text generation (CTG) seeks to craft texts adhering to specific attributes, traditionally employing learning-based techniques such as training, fine-tuning, or prefix-tuning with attribute-specific datasets. These approaches, while effective, demand extensive computational and data resources. In contrast, some proposed learning-free alternatives circumvent learning but often yield inferior results, exemplifying the fundamental machine learning trade-off between computational expense and model efficacy. To overcome these limitations, we propose FreeCtrl, a learning-free approach that dynamically adjusts the weights of selected feedforward neural network (FFN) vectors to steer the outputs of large language models (LLMs). FreeCtrl hinges on the principle that the weights of different FFN vectors influence the likelihood of different tokens appearing in the output. By identifying and adaptively adjusting the weights of attribute-related FFN vectors, FreeCtrl can control the output likelihood of attribute keywords in the generated content. Extensive experiments on single- and multi-attribute control reveal that the learning-free FreeCtrl outperforms other learning-free and learning-based methods, successfully resolving the dilemma between learning costs and model performance.


title: Physical networks become what they learn

abstract: Physical networks can develop diverse responses, or functions, by design, evolution or learning. We focus on electrical networks of nodes connected by resistive edges. Such networks can learn by adapting edge conductances to lower a cost function that penalizes deviations from a desired response. The network must also satisfy Kirchhoff's law, balancing currents at nodes, or, equivalently, minimizing total power dissipation by adjusting node voltages. The adaptation is thus a double optimization process, in which a cost function is minimized with respect to conductances, while dissipated power is minimized with respect to node voltages. Here we study how this physical adaptation couples the cost landscape, the landscape of the cost function in the high-dimensional space of edge conductances, to the physical landscape, the dissipated power in the high-dimensional space of node voltages. We show how adaptation links the physical and cost Hessian matrices, suggesting that the physical response of networks to perturbations holds significant information about the functions to which they are adapted.


title: Simulating Brown Dwarf Observations for Various Mass Functions, Birthrates, and Low-mass Cutoffs

abstract: After decades of brown dwarf discovery and follow-up, we can now infer the functional form of the mass distribution within 20 parsecs, which serves as a constraint on star formation theory at the lowest masses. Unlike objects on the main sequence that have a clear luminosity-to-mass correlation, brown dwarfs lack a correlation between an observable parameter (luminosity, spectral type, or color) and mass. A measurement of the brown dwarf mass function must therefore be procured through proxy measurements and theoretical models. We utilize various assumed forms of the mass function, together with a variety of birthrate functions, low-mass cutoffs, and theoretical evolutionary models, to build predicted forms of the effective temperature distribution. We then determine the best fit of the observed effective temperature distribution to these predictions, which in turn reveals the most likely mass function. We find that a simple power law ($dN/dM \propto M^{-\alpha}$) with $\alpha \approx 0.5$ is optimal. Additionally, we conclude that the low-mass cutoff for star formation is $\lesssim0.005M_{\odot}$. We corroborate the findings of Burgasser (2004) which state that the birthrate has a far lesser impact than the mass function on the form of the temperature distribution, but we note that our alternate birthrates tend to favor slightly smaller values of $\alpha$ than the constant birthrate. Our code for simulating these distributions is publicly available. As another use case for this code, we present findings on the width and location of the subdwarf temperature gap by simulating distributions of very old (8-10 Gyr) brown dwarfs.


title: The gravitational-wave emission from the explosion of a 15 solar mass star with rotation and magnetic fields

abstract: Gravitational waveform predictions from 3D simulations of explosions of non-rotating massive stars with no magnetic fields have been extensively studied. However, the impact of magnetic fields and rotation on the core-collapse supernova gravitational-wave signal is not well understood beyond the core-bounce phase. Therefore, we perform four magnetohydrodynamical simulations of the explosion of a $15\,M_{\odot}$ star with the SFHx and SFHo equations of state. All of the models start with a weak magnetic field strength of $10^{8}$\,G, and two of the models are rapidly rotating. We discuss the impact of the rotation and magnetic fields on the gravitational-wave signals. We find that the weak pre-collapse fields do not have a significant impact on the gravitational-wave signal amplitude. With rapid rotation, the f/g-mode trajectory can change in shape, and the dominant emission band becomes broader. We include the low-frequency memory component of the gravitational-wave signal from both matter motions and neutrino emission anisotropy. We show that including the gravitational waves from anisotropic neutrino emission increases the supernova detection distances for the Einstein Telescope, and would also be detectable out to Mpc distances by a moon-based gravitational-wave detector.


title: SplineGen: a generative model for B-spline approximation of unorganized points

abstract: This paper presents a learning-based method to solve the traditional parameterization and knot placement problems in B-spline approximation. Different from conventional heuristic methods or recent AI-based methods, the proposed method does not assume ordered or fixed-size data points as input. There is also no need for manually setting the number of knots. It casts the parameterization and knot placement problems as a sequence-to-sequence translation problem, a generative process automatically determining the number of knots, their placement, parameter values, and their ordering. Once trained, SplineGen demonstrates a notable improvement over existing methods, with a one to two orders of magnitude increase in approximation accuracy on test data.


title: Compressed Video Quality Enhancement with Temporal Group Alignment and Fusion

abstract: In this paper, we propose a temporal group alignment and fusion network to enhance the quality of compressed videos by using the long-short term correlations between frames. The proposed model consists of the intra-group feature alignment (IntraGFA) module, the inter-group feature fusion (InterGFF) module, and the feature enhancement (FE) module. We form the group of pictures (GoP) by selecting frames from the video according to their temporal distances to the target enhanced frame. With this grouping, the composed GoP can contain either long- or short-term correlated information of neighboring frames. We design the IntraGFA module to align the features of frames of each GoP to eliminate the motion existing between frames. We construct the InterGFF module to fuse features belonging to different GoPs and finally enhance the fused features with the FE module to generate high-quality video frames. The experimental results show that our proposed method achieves up to 0.05dB gain and lower complexity compared to the state-of-the-art method.


title: An Efficient Approach to Regression Problems with Tensor Neural Networks

abstract: This paper introduces a tensor neural network (TNN) to address nonparametric regression problems. Characterized by its distinct sub-network structure, the TNN effectively facilitates variable separation, thereby enhancing the approximation of complex, unknown functions. Our comparative analysis reveals that the TNN outperforms conventional Feed-Forward Networks (FFN) and Radial Basis Function Networks (RBN) in terms of both approximation accuracy and generalization potential, despite a similar scale of parameters. A key innovation of our approach is the integration of statistical regression and numerical integration within the TNN framework. This integration allows for the efficient computation of high-dimensional integrals associated with the regression function. The implications of this advancement extend to a broader range of applications, particularly in scenarios demanding precise high-dimensional data analysis and prediction.


title: Machine learning-based Near-field Emitter Localization via Grouped Hybrid Analog and Digital Massive MIMO Receive Array

abstract: A fully-digital massive MIMO receive array is promising to meet the high-resolution requirement of near-field (NF) emitter localization, but it also results in the significantly increasing of hardware costs and algorithm complexity. In order to meet the future demand for green communication while maintaining high performance, the grouped hybrid analog and digital (HAD) structure is proposed for NF DOA estimation, which divides the large-scale receive array into small-scale groups and each group contains several subarrays. Thus the NF direction-of-arrival (DOA) estimation problem is viewed as far-field (FF) within each group, and some existing methods such as MUSIC, Root-MUSIC, ESPRIT, etc., can be adopted. Then by angle calibration, a candidate position set is generated. To eliminate the phase ambiguity arising from the HAD structure and obtain the emitter position, two low-complexity clustering-based methods, minimum sample distance clustering (MSDC) and range scatter diagram (RSD) - angle scatter diagram (ASD)-based DBSCAN (RSD-ASD-DBSCAN), are proposed based on the distribution features of samples in the candidate position set. Then to further improve the localization accuracy, a model-driven regression network (RegNet) is designed, which consists of a multi-layer neural network (MLNN) for false solution elimination and a perceptron for angle fusion. Finally, the Cramer-Rao lower bound (CRLB) of NF emitter localization for the proposed grouped HAD structure is also derived. The simulation results show that the proposed methods can achieve CRLB at different SNR regions, the RegNet has great performance advantages at low SNR regions and the clustering-based methods have much lower complexity.


title: MoME: Mixture of Multimodal Experts for Cancer Survival Prediction

abstract: Survival analysis, as a challenging task, requires integrating Whole Slide Images (WSIs) and genomic data for comprehensive decision-making. There are two main challenges in this task: significant heterogeneity and complex inter- and intra-modal interactions between the two modalities. Previous approaches utilize co-attention methods, which fuse features from both modalities only once after separate encoding. However, these approaches are insufficient for modeling the complex task due to the heterogeneous nature between the modalities. To address these issues, we propose a Biased Progressive Encoding (BPE) paradigm, performing encoding and fusion simultaneously. This paradigm uses one modality as a reference when encoding the other. It enables deep fusion of the modalities through multiple alternating iterations, progressively reducing the cross-modal disparities and facilitating complementary interactions. Besides modality heterogeneity, survival analysis involves various biomarkers from WSIs, genomics, and their combinations. The critical biomarkers may exist in different modalities under individual variations, necessitating flexible adaptation of the models to specific scenarios. Therefore, we further propose a Mixture of Multimodal Experts (MoME) layer to dynamically selects tailored experts in each stage of the BPE paradigm. Experts incorporate reference information from another modality to varying degrees, enabling a balanced or biased focus on different modalities during the encoding process. Extensive experimental results demonstrate the superior performance of our method on various datasets, including TCGA-BLCA, TCGA-UCEC and TCGA-LUAD. Codes are available at https://github.com/BearCleverProud/MoME.


title: Determinants of Seidel Tournament Matrices

abstract: The Seidel matrix of a tournament on $n$ players is an $n\times n$ skew-symmetric matrix with entries in $\{0, 1, -1\}$ that encapsulates the outcomes of the games in the given tournament. It is known that the determinant of an $n\times n$ Seidel matrix is $0$ if $n$ is odd, and is an odd perfect square if $n$ is even. This leads to the study of the set \[ \mathcal{D}(n)= \{ \sqrt{\det S}: \mbox{ $S$ is an $n\times n$ Seidel matrix}\}. \] This paper studies various questions about $\mathcal{D}(n)$. It is shown that $\mathcal{D}(n)$ is a proper subset of $\mathcal{D}(n+2)$ for every positive even integer, and every odd integer in the interval $[1, 1+n^2/2]$ is in $\mathcal{D}(n)$ for $n$ even. The expected value and variance of $\det S$ over the $n\times n$ Seidel matrices chosen uniformly at random is determined, and upper bounds on $\max \mathcal{D}(n)$ are given, and related to the Hadamard conjecture. Finally, it is shown that for infinitely many $n$, $\mathcal{D}(n)$ contains a gap (that is, there are odd integers $k<\ell <m$ such that $k, m \in \mathcal{D}(n)$ but $\ell \notin \mathcal{D}(n)$) and several properties of the characteristic polynomials of Seidel matrices are established.


title: Projected background and sensitivity of AMoRE-II

abstract: AMoRE-II aims to search for neutrinoless double beta decay with an array of 423 Li$_2$$^{100}$MoO$_4$ crystals operating in the cryogenic system as the main phase of the Advanced Molybdenum-based Rare process Experiment (AMoRE). AMoRE has been planned to operate in three phases: AMoRE-pilot, AMoRE-I, and AMoRE-II. AMoRE-II is currently being installed at the Yemi Underground Laboratory, located approximately 1000 meters deep in Jeongseon, Korea. The goal of AMoRE-II is to reach up to $T^{0\nu\beta\beta}_{1/2}$ $\sim$ 6 $\times$ 10$^{26}$ years, corresponding to an effective Majorana mass of 15 - 29 meV, covering all the inverted mass hierarchy regions. To achieve this, the background level of the experimental configurations and possible background sources of gamma and beta events should be well understood. We have intensively performed Monte Carlo simulations using the GEANT4 toolkit in all the experimental configurations with potential sources. We report the estimated background level that meets the 10$^{-4}$counts/(keV$\cdot$kg$\cdot$yr) requirement for AMoRE-II in the region of interest (ROI) and show the projected half-life sensitivity based on the simulation study.


title: Differentiable Programming for Differential Equations: A Review

abstract: The differentiable programming paradigm is a cornerstone of modern scientific computing. It refers to numerical methods for computing the gradient of a numerical model's output. Many scientific models are based on differential equations, where differentiable programming plays a crucial role in calculating model sensitivities, inverting model parameters, and training hybrid models that combine differential equations with data-driven approaches. Furthermore, recognizing the strong synergies between inverse methods and machine learning offers the opportunity to establish a coherent framework applicable to both fields. Differentiating functions based on the numerical solution of differential equations is non-trivial. Numerous methods based on a wide variety of paradigms have been proposed in the literature, each with pros and cons specific to the type of problem investigated. Here, we provide a comprehensive review of existing techniques to compute derivatives of numerical solutions of differential equations. We first discuss the importance of gradients of solutions of differential equations in a variety of scientific domains. Second, we lay out the mathematical foundations of the various approaches and compare them with each other. Third, we cover the computational considerations and explore the solutions available in modern scientific software. Last but not least, we provide best-practices and recommendations for practitioners. We hope that this work accelerates the fusion of scientific models and data, and fosters a modern approach to scientific modelling.

categories: math.NA cs.NA math.DS physics.comp-ph stat.ML


title: Jointed Tails Enhance Control of Three-dimensional Body Rotation

abstract: Tails used as inertial appendages induce body rotations of animals and robots, a phenomenon that is governed largely by the ratio of the body and tail moments of inertia. However, vertebrate tails have more degrees of freedom (e.g., number of joints, rotational axes) than most current theoretical models and robotic tails. To understand how morphology affects inertial appendage function, we developed an optimization-based approach that finds the maximally effective tail trajectory and measures error from a target trajectory. For tails of equal total length and mass, increasing the number of equal-length joints increased the complexity of maximally effective tail motions. When we optimized the relative lengths of tail bones while keeping the total tail length, mass, and number of joints the same, this optimization-based approach found that the lengths match the pattern found in the tail bones of mammals specialized for inertial maneuvering. In both experiments, adding joints enhanced the performance of the inertial appendage, but with diminishing returns, largely due to the total control effort constraint. This optimization-based simulation can compare the maximum performance of diverse inertial appendages that dynamically vary in moment of inertia in 3D space, predict inertial capabilities from skeletal data, and inform the design of robotic inertial appendages.


title: Towards Effectively Detecting and Explaining Vulnerabilities Using Large Language Models

abstract: Software vulnerabilities pose significant risks to the security and integrity of software systems. Prior studies have proposed a series of approaches to vulnerability detection using deep learning or pre-trained models. However, there is still a lack of vulnerability's detailed explanation for understanding apart from detecting its occurrence. Recently, large language models (LLMs) have shown a remarkable capability in the comprehension of complicated context and content generation, which brings opportunities for the detection and explanation of vulnerabilities of LLMs. In this paper, we conduct a comprehensive study to investigate the capabilities of LLMs in detecting and explaining vulnerabilities and propose LLMVulExp, a framework that utilizes LLMs for vulnerability detection and explanation. Under specialized fine-tuning for vulnerability explanation, LLMVulExp not only detects the types of vulnerabilities in the code but also analyzes the code context to generate the cause, location, and repair suggestions for these vulnerabilities. We find that LLMVulExp can effectively enable the LLMs to perform vulnerability detection (e.g., over 90% F1 score on SeVC dataset) and explanation. We also explore the potential of using advanced strategies such as Chain-of-Thought (CoT) to guide the LLMs concentrating on vulnerability-prone code and achieve promising results.


title: Detecting Response Generation Not Requiring Factual Judgment

abstract: With the remarkable development of large language models (LLMs), ensuring the factuality of output has become a challenge. However, having all the contents of the response with given knowledge or facts is not necessarily a good thing in dialogues. This study aimed to achieve both attractiveness and factuality in a dialogue response for which a task was set to predict sentences that do not require factual correctness judgment such as agreeing, or personal opinions/feelings. We created a dataset, dialogue dataset annotated with fact-check-needed label (DDFC), for this task via crowdsourcing, and classification tasks were performed on several models using this dataset. The model with the highest classification accuracy could yield about 88% accurate classification results.


title: Axisymmetric predictions for mitigated and vertically unstable disruptions in ITER with runaway electrons

abstract: We present two-dimensional global simulations of mitigated and vertically unstable disruptions in ITER in the presence of runaway electrons. An elongated plasma in free-boundary equilibrium is subjected to an artificial thermal quench and current-profile flattening, followed by one or more massive material injections and RE avalanche. Scenarios of major disruptions as well as upward and downward vertical displacement events are considered. Results provide important insights into the effects of runaway electron formation, post thermal quench current-profile, injection quantities and timings, and impurity flushout on the overall evolution of disruption and the plasma vertical motion thereof. Interplay between the various effects offers scope for potentially beneficial runaway electron mitigation scenarios.


title: Data-Driven Strategy Synthesis for Stochastic Systems with Unknown Nonlinear Disturbances

abstract: In this paper, we introduce a data-driven framework for synthesis of provably-correct controllers for general nonlinear switched systems under complex specifications. The focus is on systems with unknown disturbances whose effects on the dynamics of the system is nonlinear. The specifications are assumed to be given as linear temporal logic over finite traces (LTLf) formulas. Starting from observations of either the disturbance or the state of the system, we first learn an ambiguity set that contains the unknown distribution of the disturbances with a user-defined confidence. Next, we construct a robust Markov decision process (RMDP) as a finite abstraction of the system. By composing the RMDP with the automaton obtained from the LTLf formula and performing optimal robust value iteration on the composed RMDP, we synthesize a strategy that yields a high probability that the uncertain system satisfies the specifications. Our empirical evaluations on systems with a wide variety of disturbances show that the strategies synthesized with our approach lead to high satisfaction probabilities and validate the theoretical guarantees.


title: Collective excitations in magnetic topological insulators and axion dark matter search

abstract: We investigate collective excitations in magnetic topological insulators (TIs) and their impact on particle axion detection. In the three-dimensional TI model with the Hubbard term, the effective action of magnons and amplitude modes is formulated by dynamical susceptibility under the antiferromagnetic and ferromagnetic states. One of the amplitude modes is identified as ``axionic'' quasi-particle and its effective coupling to the electromagnetic fields turns out to be enhanced by about four orders of magnitude larger than the previous estimate, which may drastically change the sensitivity of the particle axion search using ``axion'' in magnetic TIs.


title: A Multimodal Framework for the Assessment of the Schizophrenia Spectrum

abstract: This paper presents a novel multimodal framework to distinguish between different symptom classes of subjects in the schizophrenia spectrum and healthy controls using audio, video, and text modalities. We implemented Convolution Neural Network and Long Short Term Memory based unimodal models and experimented on various multimodal fusion approaches to come up with the proposed framework. We utilized a minimal Gated multimodal unit (mGMU) to obtain a bi-modal intermediate fusion of the features extracted from the input modalities before finally fusing the outputs of the bimodal fusions to perform subject-wise classifications. The use of mGMU units in the multimodal framework improved the performance in both weighted f1-score and weighted AUC-ROC scores.


title: Radial Projections in $\mathbb{R}^n$ Revisited

abstract: We generalize the recent results on radial projections by Orponen, Shmerkin, Wang using two different methods. In particular, we show that given $X,Y\subset \mathbb{R}^n$ Borel sets and $X\neq \emptyset$. If $\dim Y \in (k,k+1]$ for some $k\in \{1,\dots, n-1\}$, then \[ \sup_{x\in X} \dim \pi_x(Y\setminus \{x\}) \geq \min \{\dim X + \dim Y - k, k\}. \] Our results give a new approach to solving a conjecture of Lund-Pham-Thu in all dimensions and for all ranges of $\dim Y$. The first of our two methods for proving the above theorem is shorter, utilizing a result of the first author and Gan. Our second method, though longer, follows the original methodology of Orponen--Shmerkin--Wang, and requires a higher dimensional incidence estimate and a dual Furstenberg-set estimate for lines. These new estimates may be of independent interest.


title: Modeling the effect of vorticity on inhaled transport in the upper airway

abstract: Localized vortices can have significant influence on transport of inhaled particles through the upper respiratory tract. These vortices have complex three-dimensional structure with details dependent on the anatomical geometry. Using a highly simplified model, we demonstrate that changes in transport characteristics with geometric distortion can be estimated by accounting merely for the net strength and location of the vorticity in a two-dimensional projection. Test cases consider 30 L/min inhaled airflow containing suspended spherical water droplets from 1 micrometer to 30 micrometers in diameter through (1) a healthy upper respiratory tract and (2) a distorted variation mimicking a glottic tumor. The reduced-order model approximates the system by a two-dimensional potential flow with embedded point vortices having features derived from Large Eddy Simulations of inhaled airflow through anatomically realistic, tomography-based, three-dimensional tracts. The effects of vorticity and particle size on changes in particle transport are shown to be consistent between the reduced-order model and the full-scale simulations.


title: Evolutionary Map of the Universe (EMU): Observations of Filamentary Structures in the Abell S1136 Galaxy Cluster

abstract: We present radio observations of the galaxy cluster Abell S1136 at 888 MHz, using the Australian Square Kilometre Array Pathfinder radio telescope, as part of the Evolutionary Map of the Universe Early Science program. We compare these findings with data from the Murchison Widefield Array, XMM-Newton, the Wide-field Infrared Survey Explorer, the Digitised Sky Survey, and the Australia Telescope Compact Array. Our analysis shows the X-ray and radio emission in Abell S1136 are closely aligned and centered on the BCG, while the X-ray temperature profile shows a relaxed cluster with no evidence of a cool core. We find that the diffuse radio emission in the centre of the cluster shows more structure than seen in previous low-resolution observations of this source, which appeared formerly as an amorphous radio blob, similar in appearance to a radio halo; our observations show the diffuse emission in the Abell S1136 galaxy cluster contains three narrow filamentary structures visible at 888 MHz, between$\sim 80$ and 140 kpc in length; however the properties of the diffuse emission do not fully match that of a radio (mini-)halo or (fossil) tailed radio source.


title: Fine-Grained Urban Flow Inference with Multi-scale Representation Learning

abstract: Fine-grained urban flow inference (FUFI) is a crucial transportation service aimed at improving traffic efficiency and safety. FUFI can infer fine-grained urban traffic flows based solely on observed coarse-grained data. However, most of existing methods focus on the influence of single-scale static geographic information on FUFI, neglecting the interactions and dynamic information between different-scale regions within the city. Different-scale geographical features can capture redundant information from the same spatial areas. In order to effectively learn multi-scale information across time and space, we propose an effective fine-grained urban flow inference model called UrbanMSR, which uses self-supervised contrastive learning to obtain dynamic multi-scale representations of neighborhood-level and city-level geographic information, and fuses multi-scale representations to improve fine-grained accuracy. The fusion of multi-scale representations enhances fine-grained. We validate the performance through extensive experiments on three real-world datasets. The resutls compared with state-of-the-art methods demonstrate the superiority of the proposed model.


title: AnimalFormer: Multimodal Vision Framework for Behavior-based Precision Livestock Farming

abstract: We introduce a multimodal vision framework for precision livestock farming, harnessing the power of GroundingDINO, HQSAM, and ViTPose models. This integrated suite enables comprehensive behavioral analytics from video data without invasive animal tagging. GroundingDINO generates accurate bounding boxes around livestock, while HQSAM segments individual animals within these boxes. ViTPose estimates key body points, facilitating posture and movement analysis. Demonstrated on a sheep dataset with grazing, running, sitting, standing, and walking activities, our framework extracts invaluable insights: activity and grazing patterns, interaction dynamics, and detailed postural evaluations. Applicable across species and video resolutions, this framework revolutionizes non-invasive livestock monitoring for activity detection, counting, health assessments, and posture analyses. It empowers data-driven farm management, optimizing animal welfare and productivity through AI-powered behavioral understanding.


title: Numerical Modeling of Transient Absorption in Hybrid Dual-Plasmonic Au/CuS Nanostructures

abstract: Transient absorption in plasmonic materials has recently attracted attention of the chemistry and optics communities as a technique to understand dynamic processes and hot carriers generation on ultrafast timescales. In this context, hybrid Au/CuS nanostructures were recently investigated via ultrafast pump-probe transient absorption spectroscopy revealing an exotic dual-plasmonic behavior. Namely, the excitation of a localized surface plasmon resonance (LSPR) in Au (pump at 551 nm) or CuS (pump at 1051 nm), leads to a transient response in the counterpart. This phenomenon was attributed to Landau damping, which stems from hot carrier generation and injection mechanisms at the interface between the two materials. Here, we employ numerical modeling to further clarify the origin of such response in hybrid Au/CuS nanostructures. The geometry of the hybrid nanostructures is first investigated via steady-state simulations (only probe), confirming an UFO-shaped configuration. We provide clarification on the role of the size ratio between Au and CuS. Finally, we present the simulation of transient absorption in the pump-probe regime, which qualitatively replicates our experimental observations, thus identifying the plasmonic response modified via Landau damping as the main governing mechanism. Our numerical approach provides an important tool for the modeling of transient absorption spectroscopy and can support experimental research on dual-plasmonic materials for applications in spectroscopy, photocatalysis, thermoplasmonics, sensing, and energy harvesting.


title: Meta-Learning Loss Functions for Deep Neural Networks

abstract: Humans can often quickly and efficiently solve complex new learning tasks given only a small set of examples. In contrast, modern artificially intelligent systems often require thousands or millions of observations in order to solve even the most basic tasks. Meta-learning aims to resolve this issue by leveraging past experiences from similar learning tasks to embed the appropriate inductive biases into the learning system. Historically methods for meta-learning components such as optimizers, parameter initializations, and more have led to significant performance increases. This thesis aims to explore the concept of meta-learning to improve performance, through the often-overlooked component of the loss function. The loss function is a vital component of a learning system, as it represents the primary learning objective, where success is determined and quantified by the system's ability to optimize for that objective successfully.


title: Large language model validity via enhanced conformal prediction methods

abstract: We develop new conformal inference methods for obtaining validity guarantees on the output of large language models (LLMs). Prior work in conformal language modeling identifies a subset of the text that satisfies a high-probability guarantee of correctness. These methods work by filtering claims from the LLM's original response if a scoring function evaluated on the claim fails to exceed a threshold calibrated via split conformal prediction. Existing methods in this area suffer from two deficiencies. First, the guarantee stated is not conditionally valid. The trustworthiness of the filtering step may vary based on the topic of the response. Second, because the scoring function is imperfect, the filtering step can remove many valuable and accurate claims. We address both of these challenges via two new conformal methods. First, we generalize the conditional conformal procedure of Gibbs et al. (2023) in order to adaptively issue weaker guarantees when they are required to preserve the utility of the output. Second, we show how to systematically improve the quality of the scoring function via a novel algorithm for differentiating through the conditional conformal procedure. We demonstrate the efficacy of our approach on both synthetic and real-world datasets.


title: Contextuality in anomalous heat flow

abstract: In classical thermodynamics, heat must spontaneously flow from hot to cold systems. In quantum thermodynamics, the same law applies when considering multipartite product thermal states evolving unitarily. If initial correlations are present, anomalous heat flow can happen, temporarily making cold thermal states colder and hot thermal states hotter. Such effect can happen due to entanglement, but also because of classical randomness, hence lacking a direct connection with nonclassicality. In this work, we introduce scenarios where anomalous heat flow \emph{does} have a direct link to nonclassicality, defined to be the failure of noncontextual models to explain experimental data. We start by extending known noncontextuality inequalities to a setup where sequential transformations are considered. We then show a class of quantum prepare-transform-measure protocols, characterized by time intervals $(0,\tau_c)$ for a given critical time $\tau_c$, where anomalous heat flow happens only if a noncontextuality inequality is violated. We also analyze a recent experiment from Micadei et. al. [Nat. Commun. 10, 2456 (2019)] and find the critical time $\tau_c$ based on their experimental parameters. We conclude by investigating heat flow in the evolution of two qutrit systems, showing that our findings are not an artifact of using two-qubit systems.


title: Speed-up of Data Analysis with Kernel Trick in Encrypted Domain

abstract: Homomorphic encryption (HE) is pivotal for secure computation on encrypted data, crucial in privacy-preserving data analysis. However, efficiently processing high-dimensional data in HE, especially for machine learning and statistical (ML/STAT) algorithms, poses a challenge. In this paper, we present an effective acceleration method using the kernel method for HE schemes, enhancing time performance in ML/STAT algorithms within encrypted domains. This technique, independent of underlying HE mechanisms and complementing existing optimizations, notably reduces costly HE multiplications, offering near constant time complexity relative to data dimension. Aimed at accessibility, this method is tailored for data scientists and developers with limited cryptography background, facilitating advanced data analysis in secure environments.


title: UniBridge: A Unified Approach to Cross-Lingual Transfer Learning for Low-Resource Languages

abstract: In this paper, we introduce UniBridge (Cross-Lingual Transfer Learning with Optimized Embeddings and Vocabulary), a comprehensive approach developed to improve the effectiveness of Cross-Lingual Transfer Learning, particularly in languages with limited resources. Our approach tackles two essential elements of a language model: the initialization of embeddings and the optimal vocabulary size. Specifically, we propose a novel embedding initialization method that leverages both lexical and semantic alignment for a language. In addition, we present a method for systematically searching for the optimal vocabulary size, ensuring a balance between model complexity and linguistic coverage. Our experiments across multilingual datasets show that our approach greatly improves the F1-Score in several languages. UniBridge is a robust and adaptable solution for cross-lingual systems in various languages, highlighting the significance of initializing embeddings and choosing the right vocabulary size in cross-lingual environments.


title: Forest-skein groups III: simplicity

abstract: An Ore forest-skein category provides three forest-skein groups equipped with a powerful diagrammatic calculus analogous to Richard Thompson's groups F,T,V. We investigate when forest-skein groups have simple derived subgroups and establish two characterisations: a dynamical one and a categorical one. We then construct two classes of examples. The first associates two finitely presented simple groups to every finite binary tree and the second associates two simple groups to every n-ary Higman-Thompson group.


title: Self-Knowledge Distillation for Learning Ambiguity

abstract: Recent language models have shown remarkable performance on natural language understanding (NLU) tasks. However, they are often sub-optimal when faced with ambiguous samples that can be interpreted in multiple ways, over-confidently predicting a single label without consideration for its correctness. To address this issue, we propose a novel self-knowledge distillation method that enables models to learn label distributions more accurately by leveraging knowledge distilled from their lower layers. This approach also includes a learning phase that re-calibrates the unnecessarily strengthened confidence for training samples judged as extremely ambiguous based on the distilled distribution knowledge. We validate our method on diverse NLU benchmark datasets and the experimental results demonstrate its effectiveness in producing better label distributions. Particularly, through the process of re-calibrating the confidence for highly ambiguous samples, the issue of over-confidence when predictions for unseen samples do not match with their ground-truth labels has been significantly alleviated. This has been shown to contribute to generating better distributions than the existing state-of-the-art method. Moreover, our method is more efficient in training the models compared to the existing method, as it does not involve additional training processes to refine label distributions.


title: Total-Body Parametric Imaging Using Relative Patlak Plot

abstract: Standard Patlak plot is widely used to describe FDG kinetics for dynamic PET imaging. Whole-body Patlak parametric imaging remains constrained due to the need for a full-time input function. Here, we demonstrate the Relative Patlak (RP) plot, which eliminates the need for the early-time input function, for total-body parametric imaging and its application to clinical 20-min "static" scans. We demonstrated that the RP intercept b' is equivalent to a ratio of standardized uptake value relative to the blood, while the RP slope Ki' is equal to the standard Patlak Ki multiplied by a global scaling factor for each subject. One challenge in applying RP to a short scan duration (20 min) is the high noise in parametric images. We applied a deep kernel method for noise reduction. Using the standard Patlak plot as the reference, the RP method was evaluated for lesion quantification, lesion-to-background contrast, and myocardial visualization in total-body parametric imaging with uEXPLORER in 22 human subjects who underwent a 1-h dynamic 18F-FDG scan. The RP method was also applied to the dynamic data regenerated from a clinical standard 20-min "static" scan either at 1-h or 2-h post-injection for two cancer patients. We demonstrated that it is feasible to obtain high-quality parametric images from 20-min dynamic scans using the RP plot with a self-supervised deep-kernel noise reduction strategy. The RP Ki' highly correlated with Ki in lesions and major organs, demonstrating its quantitative potential across subjects. Compared to conventional SUVs, the Ki' images significantly improved lesion contrast and enabled visualization of the myocardium for potential cardiac assessment. The application of RP parametric imaging to two "static" scans also showed similar benefits. Total-body PET with the RP plot is feasible to generate parametric images from the dynamic data of a 20-min clinical "static" scan.


title: Synergetic effect of edge states and point defects to tune ferromagnetism in CVD-grown vertical nanostructured MoS2: A correlation between electronic structure and theoretical study

abstract: Room-temperature ferromagnetism (RTFM) exhibited by nanostructured two-dimensional semiconductors for spintronics applications is a fascinating area of research. The present work reports on the correlation between the electronic structure and magnetic properties of defect-engineered nano-structured MoS2 thin films. Low-energy light and heavy-mass ion irradiation have been performed to create defects and tune magnetic properties. Vertical nanosheets with edge state termination in the pristine sample have been examined by field emission scanning electron microscopy (FESEM). Deterioration of vertical nanosheets is observed in low-energy Ar+ and Xe+ irradiated samples. An appreciably high magnetization value of 1.7 emu/g was observed for edge-oriented nanostructured pristine MoS2 thin films, which decreased after ion irradiation. From X-ray photoelectron spectroscopy (XPS) data, it is evident that, due to oxygen incorporation in the sulfur vacancy sites, Mo5+ and 6+ states increase after ion irradiation. The density functional theory (DFT) calculations suggest that the edge-oriented spins of the prismatic edges of the vertical nanosheets are primarily responsible for the high magnetic moment in the pristine film, and the edge degradation and reduction in sulfur vacancies by the incorporation of oxygen upon irradiation result in a decrease in the magnetic moment.


title: Cross-view geo-localization: a survey

abstract: Cross-view geo-localization has garnered notable attention in the realm of computer vision, spurred by the widespread availability of copious geotagged datasets and the advancements in machine learning techniques. This paper provides a thorough survey of cutting-edge methodologies, techniques, and associated challenges that are integral to this domain, with a focus on feature-based and deep learning strategies. Feature-based methods capitalize on unique features to establish correspondences across disparate viewpoints, whereas deep learning-based methodologies deploy convolutional neural networks to embed view-invariant attributes. This work also delineates the multifaceted challenges encountered in cross-view geo-localization, such as variations in viewpoints and illumination, the occurrence of occlusions, and it elucidates innovative solutions that have been formulated to tackle these issues. Furthermore, we delineate benchmark datasets and relevant evaluation metrics, and also perform a comparative analysis of state-of-the-art techniques. Finally, we conclude the paper with a discussion on prospective avenues for future research and the burgeoning applications of cross-view geo-localization in an intricately interconnected global landscape.


title: When Will Gradient Regularization Be Harmful?

abstract: Gradient regularization (GR), which aims to penalize the gradient norm atop the loss function, has shown promising results in training modern over-parameterized deep neural networks. However, can we trust this powerful technique? This paper reveals that GR can cause performance degeneration in adaptive optimization scenarios, particularly with learning rate warmup. Our empirical and theoretical analyses suggest this is due to GR inducing instability and divergence in gradient statistics of adaptive optimizers at the initial training stage. Inspired by the warmup heuristic, we propose three GR warmup strategies, each relaxing the regularization effect to a certain extent during the warmup course to ensure the accurate and stable accumulation of gradients. With experiments on Vision Transformer family, we confirm the three GR warmup strategies can effectively circumvent these issues, thereby largely improving the model performance. Meanwhile, we note that scalable models tend to rely more on the GR warmup, where the performance can be improved by up to 3\% on Cifar10 compared to baseline GR. Code is available at \href{https://github.com/zhaoyang-0204/gnp}{https://github.com/zhaoyang-0204/gnp}.


title: Chow Groups: A Structure Theorem, RIEMANN-ROCH without denominators and ARTIN approximation

abstract: The focus of this note is on the Chow group problem over ramified regular local rings $(R, m)$. Our goal is threefold: i) to introduce a characterization of a ramified regular local ring essentially of finite type over a dvr, ii) to address the question whether $(i-1)!$ $\mathbb{A}^i(U)=0$ for specific open subsets $U$ of Spec$R$ and iii) to establish a constructive relation between Chow groups of the henselization $(R^h, m^h)$ and Chow groups of the completion $(\hat{R}, \hat{m})$ of $(R, m)$.


title: Some things never change: how far generative AI can really change software engineering practice

abstract: Generative Artificial Intelligence (GenAI) has become an emerging technology with the availability of several tools that could impact Software Engineering (SE) activities. As any other disruptive technology, GenAI led to the speculation that its full potential can deeply change SE. However, an overfocus on improving activities for which GenAI is more suitable could negligent other relevant areas of the process. In this paper, we aim to explore which SE activities are not expected to be profoundly changed by GenAI. To achieve this goal, we performed a survey with SE practitioners to identify their expectations regarding GenAI in SE, including impacts, challenges, ethical issues, and aspects they do not expect to change. We compared our results with previous roadmaps proposed in SE literature. Our results show that although practitioners expect an increase in productivity, coding, and process quality, they envision that some aspects will not change, such as the need for human expertise, creativity, and project management. Our results point to SE areas for which GenAI is probably not so useful, and future research could tackle them to improve SE practice.


title: PixRO: Pixel-Distributed Rotational Odometry with Gaussian Belief Propagation

abstract: Visual sensors are not only becoming better at capturing high-quality images but also they have steadily increased their capabilities in processing data on their own on-chip. Yet the majority of VO pipelines rely on the transmission and processing of full images in a centralized unit (e.g. CPU or GPU), which often contain much redundant and low-quality information for the task. In this paper, we address the task of frame-to-frame rotational estimation but, instead of reasoning about relative motion between frames using the full images, distribute the estimation at pixel-level. In this paradigm, each pixel produces an estimate of the global motion by only relying on local information and local message-passing with neighbouring pixels. The resulting per-pixel estimates can then be communicated to downstream tasks, yielding higher-level, informative cues instead of the original raw pixel-readings. We evaluate the proposed approach on real public datasets, where we offer detailed insights about this novel technique and open-source our implementation for the future benefit of the community.


title: FGM modeling considering preferential diffusion, flame stretch, and non-adiabatic effects for hydrogen-air premixed flame wall flashback

abstract: Preferential diffusion plays an important role especially in hydrogen flames. Flame stretch significantly affects the flame structure and induces preferential diffusion. A problematic phenomenon occurring in real combustion devices is flashback, which is influenced by non-adiabatic effects, such as wall heat loss. In this paper, an extended flamelet-generated manifold (FGM) method that explicitly considers the preferential diffusion, flame stretch, and non-adiabatic effects is proposed. In this method, the diffusion terms in the transport equations of scalars, viz. the progress variable, mixture fraction, and enthalpy, are formulated employing non-unity Lewis numbers that are variable in space and different for each chemical species. The applicability of the extended FGM method to hydrogen flames is investigated using two- and three-dimensional numerical simulations of hydrogen-air flame flashback in channel flows. The results of the extended FGM method are compared with those of detailed calculations and other FGM methods. The two-dimensional numerical simulations show that considering both preferential diffusion and flame stretch improves the prediction accuracy of the mixture fraction distribution and flashback speed. The three-dimensional numerical simulations show that the prediction accuracy of the flashback speed, backflow region, and distributions of physical quantities near the flame front is improved by employing the extended FGM method, compared with the FGM method that considers only the heat loss effect. In particular, the extended FGM method successfully reproduced the relationship between the reaction rate and curvature. These results demonstrate the effectiveness of the extended FGM method.


title: Neural Pose Representation Learning for Generating and Transferring Non-Rigid Object Poses

abstract: We propose a novel method for learning representations of poses for 3D deformable objects, which specializes in 1) disentangling pose information from the object's identity, 2) facilitating the learning of pose variations, and 3) transferring pose information to other object identities. Based on these properties, our method enables the generation of 3D deformable objects with diversity in both identities and poses, using variations of a single object. It does not require explicit shape parameterization such as skeletons or joints, point-level or shape-level correspondence supervision, or variations of the target object for pose transfer. To achieve pose disentanglement, compactness for generative models, and transferability, we first design the pose extractor to represent the pose as a keypoint-based hybrid representation and the pose applier to learn an implicit deformation field. To better distill pose information from the object's geometry, we propose the implicit pose applier to output an intrinsic mesh property, the face Jacobian. Once the extracted pose information is transferred to the target object, the pose applier is fine-tuned in a self-supervised manner to better describe the target object's shapes with pose variations. The extracted poses are also used to train a cascaded diffusion model to enable the generation of novel poses. Our experiments with the DeformThings4D and Human datasets demonstrate state-of-the-art performance in pose transfer and the ability to generate diverse deformed shapes with various objects and poses.


title: Nonlinear chiral metasurfaces based on structured van der Waals materials

abstract: Nonlinear chiral photonics explores nonlinear response of chiral structures, and it offers a pathway to novel optical functionalities not accessible through linear or achiral systems. Here we present the first application of nanostructured van der Waals materials to nonlinear chiral photonics. We demonstrate the three orders of magnitude enhancement of the third-harmonic generation from hBN metasurfaces driven by quasi-bound states in the continuum, accompanied by a strong nonlinear circular dichroism in the resonant metasurface varying from the values -0.5 to +0.5. This novel platform for chiral metaphotonics can be employed for achieving large circular dichroism combined with high-efficiency harmonic generation in a broad frequency range.


title: Ultra-bright and energy-efficient quantum-dot LEDs by idealizing charge injection

abstract: Lighting and display, relying on electric and optical down-conversion emission with sluggish power efficiency, account for >15% global electricity consumption1,2. In 2014, quantum-dot (QD) LEDs (QLEDs) with near-optimal external quantum efficiency emerged3 and promised a pathway to avoid the vast down-conversion energy loss4,5. Despite a decade of progress4-22, fabrication of energy-efficient QLEDs with application-relevant brightness remains elusive. Here, the main roadblock is identified as the oxidative species adsorbed in the nanocrystalline electron-injection layer of QLEDs, which is then addressed by a simple reductive treatment to simultaneously boosts electron conductivity and hole blockage of the electron-injection layer. The resulting sub-bandgap-driven QLEDs with optimal efficiency achieve ultra-high brightness across the entire visible spectrum at least 2.6-fold higher than existing benchmarks. The brightness fully satisfies the demands of various forms of lighting and display, which surges to a remarkable level sufficient for QD laser diodes with a moderate bias (~9 V). Optimized electron injection further enables new types of QD-blend LEDs for diffuse white-light sources surpassing the 2035 R&D targets set by the U.S. Department of Energy. Our findings open a door for understanding and optimizing carrier transport in nanocrystalline semiconductors shared by various types of solution-processed optoelectronic devices.


title: Automated GIS-Based Framework for Detecting Crosswalk Changes from Bi-Temporal High-Resolution Aerial Images

abstract: Identification of changes in pavement markings has become crucial for infrastructure monitoring, maintenance, development, traffic management, and safety. Automated extraction of roadway geometry is critical in helping with this, given the increasing availability of high-resolution images and advancements in computer vision and object detection. Specifically, due to the substantial volume of satellite and high-resolution aerial images captured at different time instances, change detection has become a viable solution. In this study, an automated framework is developed to detect changes in crosswalks of Orange, Osceola, and Seminole counties in Florida, utilizing data extracted from high-resolution images obtained at various time intervals. Specifically, for Orange County, crosswalk changes between 2019 and 2021 were manually extracted, verified, and categorized as either new or modified crosswalks. For Seminole County, the developed model was used to automatically extract crosswalk changes between 2018 and 2021, while for Osceola County, changes between 2019 and 2020 were extracted. Findings indicate that Orange County witnessed approximately 2,094 crosswalk changes, with 312 occurring on state roads. In Seminole and Osceola counties, on the other hand, 1,040 and 1,402 crosswalk changes were observed on both local and state roads, respectively. Among these, 340 and 344 were identified on state roads in Seminole and Osceola, respectively. Spatiotemporal changes observed in crosswalks can be utilized to regularly update the existing crosswalk inventories, which is essential for agencies engaged in traffic and safety studies. Data extracted from these crosswalk changes can be combined with traffic and crash data to provide valuable insights to policymakers.


title: Finding pure Nash equilibria in large random games

abstract: Best Response Dynamics (BRD) is a class of strategy updating rules to find Pure Nash Equilibria (PNE) in a game. At each step, a player is randomly picked and they switches to a "best response" strategy based on the strategies chosen by others, so that the new strategy profile maximises their payoff. If no such strategy exists, a different player will be chosen randomly. When no player wants to change their strategy anymore, the process reaches a PNE and will not deviate from it. On the other hand, either PNE could not exist, or BRD could be "trapped" within a subgame that has no PNE. We prove that BRD typically converges to PNE when the game has $N$ players, each having two actions. Our results are more general and are described as follows. We study a class of random walks in a random medium on the $N$-dimensional hypercube. The medium is determined by a random game with $N$ players, each with two actions available, and i.i.d. payoffs. The medium contains obstacles that can be of two types. The first type is composed of the PNE of the game, while the other obstacles are known in the literature as traps or sink equilibria. The class of processes we analyze includes BRD, simple random walks on the hypercube, and many other nearest neighbour processes. We prove that, with high probability, these processes reach a PNE before hitting any trap.


title: Unified Gaussian Primitives for Scene Representation and Rendering

abstract: Searching for a unified scene representation remains a research challenge in computer graphics. Traditional mesh-based representations are unsuitable for dense, fuzzy elements, and introduce additional complexity for filtering and differentiable rendering. Conversely, voxel-based representations struggle to model hard surfaces and suffer from intensive memory requirement. We propose a general-purpose rendering primitive based on 3D Gaussian distribution for unified scene representation, featuring versatile appearance ranging from glossy surfaces to fuzzy elements, as well as physically based scattering to enable accurate global illumination. We formulate the rendering theory for the primitive based on non-exponential transport and derive efficient rendering operations to be compatible with Monte Carlo path tracing. The new representation can be converted from different sources, including meshes and 3D Gaussian splatting, and further refined via transmittance optimization thanks to its differentiability. We demonstrate the versatility of our representation in various rendering applications such as global illumination and appearance editing, while supporting arbitrary lighting conditions by nature. Additionally, we compare our representation to existing volumetric representations, highlighting its efficiency to reproduce details.


title: Embracing the Enemy

abstract: We study an organization with a principal and two agents. All three have a long-run agenda which drives their repeated interactions. The principal can influence the competition for agency by endorsing an agent. Her agenda is more aligned with her ``friend'' than with her ``enemy.'' Even when fully aligned with the friend, the principal embraces the enemy by persistently endorsing him once an initial ``cordon sanitaire'' to exclude the enemy breaks exogenously. A dynamically optimizing principal with extreme agenda either implements the commitment solution or reverts to static Nash. For less extreme principals, losing commitment power has more gradual effects.


title: Spontaneous fission half-life in Fm isotopes with nuclear energy density functional

abstract: A microscopic description of fission dynamics is important to understand the decay properties of neutron-rich heavy nuclei that are relevant to $r$-process nucleosynthesis. To provide a reliable and efficient method to evaluate the spontaneous fission half-life, we develop a method, called the constrained Hartree--Fock--Bogoliubov (CHFB) plus local quasiparticle random-phase approximation (LQRPA), to include dynamical residual effects in the collective inertia. With the CHFB + LQRPA, we evaluate the collective potential and the collective inertia along a mass-symmetric fission path in Fm isotopes with the neutron numbers $N=158$--164. The obtained LQRPA inertia is much larger than the cranking one that ignores dynamical residual effects and shows a remarkable variation along the fission path. We estimate the fission half-life of the Fm isotopes using the action integral with the obtained collective potential and inertia. A large difference between the fission half-lives obtained with the LQRPA inertia and with the cranking inertia is observed. This indicates the importance of evaluating the collective inertia for estimating the fission half-life.


title: Geometry of Generalized Augmented Braids

abstract: A generalized augmented link of a knot $K$ is a link obtained by adding trivial components to $K$ that bound $n$-punctured disks. In this paper we consider that $K$ is given by a positive braid with at least one full twist. We characterize when the generalized augmented links of $K$ have hyperbolic geometry.


title: A Multivocal Review of MLOps Practices, Challenges and Open Issues

abstract: With the increasing trend of Machine Learning (ML) enabled software applications, the paradigm of ML Operations (MLOps) has gained tremendous attention of researchers and practitioners. MLOps encompasses the practices and technologies for streamlining the resources and monitoring needs of operationalizing ML models. Software development practitioners need access to the detailed and easily understandable knowledge of MLOps workflows, practices, challenges and solutions to effectively and efficiently support the adoption of MLOps. Whilst the academic and industry literature on the MLOps has been growing rapidly, there have been relatively a few attempts at systematically synthesizing and analyzing the vast amount of existing literature of MLOps for improving ease of access and understanding. We conducted a Multivocal Literature Review (MLR) of 150 relevant academic studies and 48 gray literature to provide a comprehensive body of knowledge on MLOps. Through this MLR, we identified the emerging MLOps practices, adoption challenges and solutions related to various areas, including development and operation of complex pipelines, managing production at scale, managing artifacts, and ensuring quality, security, governance, and ethical aspects. We also report the socio-technical aspect of MLOps relating to diverse roles involved and collaboration practices across them through the MLOps lifecycle. We assert that this MLR provides valuable insights to researchers and practitioners seeking to navigate the rapidly evolving landscape of MLOps. We also identify the open issues that need to be addressed in order to advance the current state-of-the-art of MLOps.


title: Contrastive Imitation Learning for Language-guided Multi-Task Robotic Manipulation

abstract: Developing robots capable of executing various manipulation tasks, guided by natural language instructions and visual observations of intricate real-world environments, remains a significant challenge in robotics. Such robot agents need to understand linguistic commands and distinguish between the requirements of different tasks. In this work, we present Sigma-Agent, an end-to-end imitation learning agent for multi-task robotic manipulation. Sigma-Agent incorporates contrastive Imitation Learning (contrastive IL) modules to strengthen vision-language and current-future representations. An effective and efficient multi-view querying Transformer (MVQ-Former) for aggregating representative semantic information is introduced. Sigma-Agent shows substantial improvement over state-of-the-art methods under diverse settings in 18 RLBench tasks, surpassing RVT by an average of 5.2% and 5.9% in 10 and 100 demonstration training, respectively. Sigma-Agent also achieves 62% success rate with a single policy in 5 real-world manipulation tasks. The code will be released upon acceptance.


title: Decoupling Forgery Semantics for Generalizable Deepfake Detection

abstract: In this paper, we propose a novel method for detecting DeepFakes, enhancing the generalization of detection through semantic decoupling. There are now multiple DeepFake forgery technologies that not only possess unique forgery semantics but may also share common forgery semantics. The unique forgery semantics and irrelevant content semantics may promote over-fitting and hamper generalization for DeepFake detectors. For our proposed method, after decoupling, the common forgery semantics could be extracted from DeepFakes, and subsequently be employed for developing the generalizability of DeepFake detectors. Also, to pursue additional generalizability, we designed an adaptive high-pass module and a two-stage training strategy to improve the independence of decoupled semantics. Evaluation on FF++, Celeb-DF, DFD, and DFDC datasets showcases our method's excellent detection and generalization performance. Code is available at: https://anonymous.4open.science/r/DFS-GDD-0F42.


title: Deep Symbolic Optimization for Combinatorial Optimization: Accelerating Node Selection by Discovering Potential Heuristics

abstract: Combinatorial optimization (CO) is one of the most fundamental mathematical models in real-world applications. Traditional CO solvers, such as Branch-and-Bound (B&B) solvers, heavily rely on expert-designed heuristics, which are reliable but require substantial manual tuning. Recent studies have leveraged deep learning (DL) models as an alternative to capture rich feature patterns for improved performance on GPU machines. Nonetheless, the drawbacks of high training and inference costs, as well as limited interpretability, severely hinder the adoption of DL methods in real-world applications. To address these challenges, we propose a novel deep symbolic optimization learning framework that combines their advantages. Specifically, we focus on the node selection module within B&B solvers -- namely, deep symbolic optimization for node selection (Dso4NS). With data-driven approaches, Dso4NS guides the search for mathematical expressions within the high-dimensional discrete symbolic space and then incorporates the highest-performing mathematical expressions into a solver. The data-driven model captures the rich feature information in the input data and generates symbolic expressions, while the expressions deployed in solvers enable fast inference with high interpretability. Experiments demonstrate the effectiveness of Dso4NS in learning high-quality expressions, outperforming existing approaches on a CPU machine. Encouragingly, the learned CPU-based policies consistently achieve performance comparable to state-of-the-art GPU-based approaches.


title: Phantom chain simulations for fracture of star polymer networks with various strand densities

abstract: Despite many attempts, the relation between fracture and structure of polymer networks is yet to be clarified. For this problem, a recent study for phantom chain simulations [Macromolecules, 56, 9359 (2023)] has demonstrated that the fracture characteristics obtained for polymer networks with various node functionalities and conversion ratios lie on master curves if they are plotted against cycle rank. In this study, we extended the simulation to the effect of prepolymer concentration on the relationships between cycle rank and fracture characteristics within the concentration range of 1<c/c^*<8, concerning the overlapping concentration c^*. We created networks from sols of star-branched phantom bead-spring chains via end-linking reaction between different chains through Brownian dynamics simulations with varying the number of branching arms f from 1 to 8, and the conversion ratio {\phi}_c from 0.6 to 0.95. For the resultant networks, cycle rank {\xi} was consistent with the mean-field theory. The networks were uniaxially stretched with energy minimization until break to obtain modulus G, strain at break {\epsilon}_b, stress at break {\sigma}_b, and work for fracture W_b. With the branch point density \u{psion}_br, G/\u{psion}_br, {\epsilon}_b, {\sigma}_b/\u{psion}_br, and W_b/\u{psion}_br of the data for various f and {\phi}_c draw master curves if plotted against {\xi}. The master curves depend on c; as c increases, all the mechanical characteristics monotonically increase. If we plot {\sigma}_b/\u{psion}_br and W_b/\u{psion}_br against G/\u{psion}_br, the data for various f and {\phi}_c lie on master curves but depending on c. Consequently, the fracture characteristics are not solely described by modulus for the examined energy-minimized phantom chain networks.


title: IFA: Interaction Fidelity Attention for Entire Lifelong Behaviour Sequence Modeling

abstract: The lifelong user behavior sequence provides abundant information of user preference and gains impressive improvement in the recommendation task, however increases computational consumption significantly. To meet the severe latency requirement in online service, a short sub-sequence is sampled based on similarity to the target item. Unfortunately, items not in the sub-sequence are abandoned, leading to serious information loss. In this paper, we propose a new efficient paradigm to model the full lifelong sequence, which is named as \textbf{I}nteraction \textbf{F}idelity \textbf{A}ttention (\textbf{IFA}). In IFA, we input all target items in the candidate set into the model at once, and leverage linear transformer to reduce the time complexity of the cross attention between the candidate set and the sequence without any interaction information loss. We also additionally model the relationship of all target items for optimal set generation, and design loss function for better consistency of training and inference. We demonstrate the effectiveness and efficiency of our model by off-line and online experiments in the recommender system of Kuaishou.


title: Stability of the Toda equations related to a perturbed $R_i$ type recurrence relation

abstract: In this manuscript, a modified $R_I$ type recurrence relation is considered whose recurrence coefficients are perturbed by addition or multiplication of a constant. The perturbed system of recurrence coefficients is represented by Toda lattice equations, which are derived. These equations are then represented in a matrix form. With the help of this matrix representation, a known Lax pair is recovered. Inferences about the stability of resulting perturbed system of Toda equations are drawn based on numerical experiments.


title: The Cost and Complexity of Minimizing Envy in House Allocation

abstract: We study almost-envy-freeness in house allocation, where $m$ houses are to be allocated among $n$ agents so that every agent receives exactly one house. An envy-free allocation need not exist, and therefore we may have to settle for relaxations of envy-freeness. But typical relaxations such as envy-free up to one good do not make sense for house allocation, as every agent is required to receive exactly one house. Hence we turn to different aggregate measures of envy as markers of fairness. In particular, we define the amount of envy experienced by an agent $a$ w.r.t. an allocation to be the number of agents that agent $a$ envies under that allocation. We quantify the envy generated by an allocation using three different metrics: 1) the number of agents who are envious; 2) the maximum amount of envy experienced by any agent; and 3) the total amount of envy experienced by all agents, and look for allocations that minimize one of the three metrics. We thus study three computational problems corresponding to each of the three metrics and prove a host of algorithmic and hardness results. We also suggest practical approaches for these problems via integer linear program (ILP) formulations and report the findings of our experimental evaluation of ILPs. Finally, we study the price of fairness (PoF), which quantifies the loss of welfare we must suffer due to the fairness requirements, and we prove a number of results on PoF, including tight bounds as well as algorithms that simultaneously optimize both welfare and fairness.


title: How Does Distribution Matching Help Domain Generalization: An Information-theoretic Analysis

abstract: Domain generalization aims to learn invariance across multiple training domains, thereby enhancing generalization against out-of-distribution data. While gradient or representation matching algorithms have achieved remarkable success, these methods generally lack generalization guarantees or depend on strong assumptions, leaving a gap in understanding the underlying mechanism of distribution matching. In this work, we formulate domain generalization from a novel probabilistic perspective, ensuring robustness while avoiding overly conservative solutions. Through comprehensive information-theoretic analysis, we provide key insights into the roles of gradient and representation matching in promoting generalization. Our results reveal the complementary relationship between these two components, indicating that existing works focusing solely on either gradient or representation alignment are insufficient to solve the domain generalization problem. In light of these theoretical findings, we introduce IDM to simultaneously align the inter-domain gradients and representations. Integrated with the proposed PDM method for complex distribution matching, IDM achieves superior performance over various baseline methods.


title: Complex zeros of Bessel function derivatives and associated orthogonal polynomials

abstract: We introduce a sequence of orthogonal polynomials whose associated moments are the Rayleigh-type sums, involving the zeros of the Bessel derivative $J_\nu'$ of order $\nu$. We also discuss the fundamental properties of those polynomials such as recurrence, orthogonality, etc. Consequently, we obtain a formula for the Hankel determinant, elements of which are chosen as the aforementioned Rayleigh-type sums. As an application, we complete the Hurwitz-type theorem for $J_\nu'$, which deals with the number of complex zeros of $J_\nu'$ depending on the range of $\nu$.


title: Hybrid atom-photon entangling gates via Gaussian soft control

abstract: Hybrid atom-photon gates play an important role for the realization of a quantum interface capable of mapping atomic states to photons for communication across quantum networks. Here, we propose a feasible theoretical scheme for implementing a hybrid atom-photon controlled-Z gate between an atom and a microwave photon in a superconducting coplanar waveguide resonator based on the Gaussian soft control technique. The gate protocol employs a classical auxiliary field that induces an atomic transition between one state of the atomic qubit and Rydberg states for obtaining strong coupling of the atom and microwave resonator. By tailoring the amplitude of this field with Gaussian temporal modulation, the gate performances are improved in various aspects. Numerical simulations demonstrate that the controlled-Z gate based on Gaussian soft control is resilient to the variation of the atom-photon coupling strength, deviation in the gate time, and less sensitive to the Rydberg level shifts caused by stray electric fields.


title: On the small boundary property, $\mathcal Z$-stability, and Bauer simplexes

abstract: Let $X$ be a compact metrizable space, and let $\Delta$ be a closed set of Borel probability measures on $X$. We study the small boundary property of the pair $(X, \Delta)$. In particular, it is shown that $(X, \Delta)$ has the small boundary property if it has a restricted version of property Gamma. As an application, it is shown that, if $A$ is the crossed product C*-algebra $\mathrm{C}(X)\rtimes\mathbb Z^d$, where $(X, \mathbb Z^d)$ is a free minimal topological dynamical system, or if $A$ is an AH algebra with diagonal maps, then, $A$ is $\mathcal Z$-stable if the set of extreme tracial states is compact, regardless of its dimension.


title: Substrate$-$bias driven Sputter deposited $\beta-$phase dominated Tungsten film for Spintronic applications

abstract: $\beta$-Tungsten ($\beta$-W), a A15 cubic phase of Tungsten exhibits giant spin hall angle as compared to its bcc-phase $\alpha$-Tungsten ($\alpha$-W), making high quality $\beta$-W film desirable for spin-based application. We report on the substrate bias driven on-demand growth of $\beta$-W film on SiO$_2$ coated silicon (SiO$_2$/Si) using DC sputtering. GIXRD plots and SEM images are used to show a systematic change on the structure and grain size of the deposited films with the application of substrate bias. It is observed that zero bias film are amorphous in nature and changes phase from $\alpha$ to $\beta$ or mixed ($\alpha$ + $\beta$) depending upon the sign and magnitude of the substrate bias. We performed One-Dimensional Power spectrum density of the AFM images which revealed that the pure $\beta$-W film grown at a positive bias of +50V has the minimum roughness as compared to films grown at different substrate bias. We further confirm the metallic surface homogeneity using the room temperature STM. Our results shows that the substrate bias which controls the energy of the deposited atom, is a crucial parameter for an on demand growth of $\beta$-W, an important material for spintronic applications.


title: ControlVAR: Exploring Controllable Visual Autoregressive Modeling

abstract: Conditional visual generation has witnessed remarkable progress with the advent of diffusion models (DMs), especially in tasks like control-to-image generation. However, challenges such as expensive computational cost, high inference latency, and difficulties of integration with large language models (LLMs) have necessitated exploring alternatives to DMs. This paper introduces ControlVAR, a novel framework that explores pixel-level controls in visual autoregressive (VAR) modeling for flexible and efficient conditional generation. In contrast to traditional conditional models that learn the conditional distribution, ControlVAR jointly models the distribution of image and pixel-level conditions during training and imposes conditional controls during testing. To enhance the joint modeling, we adopt the next-scale AR prediction paradigm and unify control and image representations. A teacher-forcing guidance strategy is proposed to further facilitate controllable generation with joint modeling. Extensive experiments demonstrate the superior efficacy and flexibility of ControlVAR across various conditional generation tasks against popular conditional DMs, \eg, ControlNet and T2I-Adaptor.


title: Nonclassicality in Two-Mode New Generalized Binomial State

abstract: The study of nonclassical properties of two-mode quantum states is particularly useful in quantum information theory because of the possibilities of obtaining entanglement and other two-mode quantum correlations in these states. Here we have investigated the possibilities of the existence of nonclassicality in a two-mode New generalized binomial state (TMNGBS). Specifically two-mode antibunching, Quadrature squeezing, sum \& difference squeezing, and various entanglement criteria e.g Shchukin-Vogel entanglement criterion, the uncertainty relation of SU(1,1) Algebra and EPR entanglement criterion are explored in two mode particular example of quantum state named as New generalized binomial state. Earlier we studied nonclassicality in single-mode NGBS, here we are extending our study toward the two-mode version of a quantum state. Here we provide the general expressions of moments for a two-mode quantum state (Fock basis) and explore the quantification in a particular example NGBS. It is found that antibunching, squeezing, and SV entanglement are possible with different limits of depending parameters but the entanglement criteria (EPR, SU (1,1) algebra and Cauchy - Schwarz inequality based)for NGBS are not possible. This study opens up the possibility of exploring the two-mode nonclassicality in other states too.


title: Swampland Bounds on Magnetized Extra Dimensions

abstract: We consider a six-dimensional $U(1)$ gauge theory compactified on two-dimensional manifolds. The number of chiral fermions is determined by the flux quantization number on the two-dimensional compact manifolds. Using the Swampland Conjectures, we find constraints among the parameters of the theory: the flux quantization number, the compactification scale, and the string scale. Specifically, the Weak Gravity Conjecture and the Trans-Planckian Censorship Conjecture give non-trivial bounds.


title: Interior-Point-based H2 Controller Synthesis for Compartmental Systems

abstract: This paper addresses the problem of the optimal $H_2$ controller design for compartmental systems. In other words, we aim to enhance system robustness while maintaining the law of mass conservation. We perform a novel problem transformation and establish that the original problem is equivalent to an new optimization problem with a closed polyhedron constraint. Existing works have developed various first-order methods to tackle inequality constraints. However, the performance of the first-order method is limited in terms of convergence speed and precision, restricting its potential in practical applications. Therefore, developing a novel algorithm with fast speed and high precision is critical. In this paper, we reformulate the problem using log-barrier functions and introduce two separate approaches to address the problem: the first-order interior point method (FIPM) and the second-order interior point method (SIPM). We show they converge to a stationary point of the new problem. In addition, we propose an initialization method to guarantee the interior property of initial values. Finally, we compare FIPM and SIPM through a room temperature control example and show their pros and cons.


title: LAVIB: A Large-scale Video Interpolation Benchmark

abstract: This paper introduces a LArge-scale Video Interpolation Benchmark (LAVIB) for the low-level video task of video frame interpolation (VFI). LAVIB comprises a large collection of high-resolution videos sourced from the web through an automated pipeline with minimal requirements for human verification. Metrics are computed for each video's motion magnitudes, luminance conditions, frame sharpness, and contrast. The collection of videos and the creation of quantitative challenges based on these metrics are under-explored by current low-level video task datasets. In total, LAVIB includes 283K clips from 17K ultra-HD videos, covering 77.6 hours. Benchmark train, val, and test sets maintain similar video metric distributions. Further splits are also created for out-of-distribution (OOD) challenges, with train and test splits including videos of dissimilar attributes.


title: Mix Q-learning for Lane Changing: A Collaborative Decision-Making Method in Multi-Agent Deep Reinforcement Learning

abstract: Lane-changing decisions, which are crucial for autonomous vehicle path planning, face practical challenges due to rule-based constraints and limited data. Deep reinforcement learning has become a major research focus due to its advantages in data acquisition and interpretability. However, current models often overlook collaboration, which affects not only impacts overall traffic efficiency but also hinders the vehicle's own normal driving in the long run. To address the aforementioned issue, this paper proposes a method named Mix Q-learning for Lane Changing(MQLC) that integrates a hybrid value Q network, taking into account both collective and individual benefits for the greater good. At the collective level, our method coordinates the individual Q and global Q networks by utilizing global information. This enables agents to effectively balance their individual interests with the collective benefit. At the individual level, we integrated a deep learning-based intent recognition module into our observation and enhanced the decision network. These changes provide agents with richer decision information and more accurate feature extraction for improved lane-changing decisions. This strategy enables the multi-agent system to learn and formulate optimal decision-making strategies effectively. Our MQLC model, through extensive experimental results, impressively outperforms other state-of-the-art multi-agent decision-making methods, achieving significantly safer and faster lane-changing decisions.


title: Grounding Image Matching in 3D with MASt3R

abstract: Image Matching is a core component of all best-performing algorithms and pipelines in 3D vision. Yet despite matching being fundamentally a 3D problem, intrinsically linked to camera pose and scene geometry, it is typically treated as a 2D problem. This makes sense as the goal of matching is to establish correspondences between 2D pixel fields, but also seems like a potentially hazardous choice. In this work, we take a different stance and propose to cast matching as a 3D task with DUSt3R, a recent and powerful 3D reconstruction framework based on Transformers. Based on pointmaps regression, this method displayed impressive robustness in matching views with extreme viewpoint changes, yet with limited accuracy. We aim here to improve the matching capabilities of such an approach while preserving its robustness. We thus propose to augment the DUSt3R network with a new head that outputs dense local features, trained with an additional matching loss. We further address the issue of quadratic complexity of dense matching, which becomes prohibitively slow for downstream applications if not carefully treated. We introduce a fast reciprocal matching scheme that not only accelerates matching by orders of magnitude, but also comes with theoretical guarantees and, lastly, yields improved results. Extensive experiments show that our approach, coined MASt3R, significantly outperforms the state of the art on multiple matching tasks. In particular, it beats the best published methods by 30% (absolute improvement) in VCRE AUC on the extremely challenging Map-free localization dataset.


title: Evaluating LLM-driven User-Intent Formalization for Verification-Aware Languages

abstract: Verification-aware programming languages such as Dafny and F* provide means to formally specify and prove properties of programs. Although the problem of checking an implementation against a specification can be defined mechanically, there is no algorithmic way of ensuring the correctness of the user-intent formalization for programs -- that a specification adheres to the user's intent behind the program. The intent or requirement is expressed informally in natural language and the specification is a formal artefact. The advent of large language models (LLMs) has made strides bridging the gap between informal intent and formal program implementations recently, driven in large parts due to benchmarks and automated metrics for evaluation. Recent work has proposed evaluating {\it user-intent formalization} problem for mainstream programming languages~\cite{endres-fse24}. However, such an approach does not readily extend to verification-aware languages that support rich specifications (containing quantifiers and ghost variables) that cannot be evaluated through dynamic execution. Previous work also required generating program mutants using LLMs to create the benchmark. We advocate an alternate approach of {\it symbolically testing specifications} to provide an intuitive metric for evaluating the quality of specifications for verification-aware languages. We demonstrate that our automated metric agrees closely with mostly GPT-4 generated and human-labeled dataset of roughly 150 Dafny specifications for the popular MBPP code-generation benchmark, yet demonstrates cases where the human labeling is not perfect. We believe our work provides a stepping stone to enable the establishment of a benchmark and research agenda for the problem of user-intent formalization for programs.


title: Defect Induced Heavy Meson Dynamics in the QCD Conformal Window

abstract: Upon introducing an heavy quark in the perturbative regime of the QCD conformal window we precisely determine the associated heavy meson spectrum and wave functions in terms of the number of light flavours and mass. We then compute the conformal Isgur-Wise function which is a central quantity in heavy quark physics. We further determine the impact of the residual low energy confining dynamics on the heavy meson spectrum. As a working framework, we adapt the heavy quark effective theory to the perturbative conformal window dynamics. Our work lays the foundations to systematically go beyond the infinite mass defect approximation in conformal field theories.


title: Autonomous Constellation Fault Monitoring with Inter-satellite Links: A Rigidity-Based Approach

abstract: To address the need for robust positioning, navigation, and timing services in lunar and Martian environments, this paper proposes a novel fault detection framework for satellite constellations using inter-satellite ranging (ISR). Traditional fault monitoring methods rely on intense monitoring from ground-based stations, which are impractical for lunar and Martian missions due to cost constraints. Our approach leverages graph-rigidity theory to detect faults without relying on precise ephemeris. We model satellite constellations as graphs where satellites are vertices and inter-satellite links are edges. By analyzing the Euclidean Distance Matrix (EDM) derived from ISR measurements, we identify faults through the singular values of the geometric-centered EDM (GCEDM). A neural network predictor is employed to handle the diverse geometry of the graph, enhancing fault detection robustness. The proposed method is validated through simulations of constellations around Mars and the Moon, demonstrating its effectiveness in various configurations. This research contributes to the reliable operation of satellite constellations for future lunar and Martian exploration missions.


title: Bootstrapping Language Models with DPO Implicit Rewards

abstract: Human alignment in large language models (LLMs) is an active area of research. A recent groundbreaking work, direct preference optimization (DPO), has greatly simplified the process from past work in reinforcement learning from human feedback (RLHF) by bypassing the reward learning stage in RLHF. DPO, after training, provides an implicit reward model. In this work, we make a novel observation that this implicit reward model can by itself be used in a bootstrapping fashion to further align the LLM. Our approach is to use the rewards from a current LLM model to construct a preference dataset, which is then used in subsequent DPO rounds. We incorporate refinements that debias the length of the responses and improve the quality of the preference dataset to further improve our approach. Our approach, named self-alignment with DPO ImpliCit rEwards (DICE), shows great improvements in alignment and achieves superior performance than Gemini Pro on AlpacaEval 2, reaching 27.55% length-controlled win rate against GPT-4 Turbo, but with only 8B parameters and no external feedback. Our code is available at https://github.com/sail-sg/dice.


title: Towards Full Integration of Artificial Intelligence in Colon Capsule Endoscopy's Pathway

abstract: Despite recent surge of interest in deploying colon capsule endoscopy (CCE) for early diagnosis of colorectal diseases, there remains a large gap between the current state of CCE in clinical practice, and the state of its counterpart optical colonoscopy (OC). Our study is aimed at closing this gap, by focusing on the full integration of AI in CCE's pathway, where image processing steps linked to the detection, localization and characterisation of important findings are carried out autonomously using various AI algorithms. We developed a recognition network, that with an impressive sensitivity of 99.9%, a specificity of 99.4%, and a negative predictive value (NPV) of 99.8%, detected colorectal polyps. After recognising a polyp within a sequence of images, only those images containing polyps were fed into two parallel independent networks for characterisation, and estimation of the size of those important findings. The characterisation network reached a sensitivity of 82% and a specificity of 80% in classifying polyps to two groups, namely neoplastic vs. non-neoplastic. The size estimation network reached an accuracy of 88% in correctly segmenting the polyps. By automatically incorporating this crucial information into CCE's pathway, we moved a step closer towards the full integration of AI in CCE's routine clinical practice.


title: Full-reference Point Cloud Quality Assessment Using Spectral Graph Wavelets

abstract: Point clouds in 3D applications frequently experience quality degradation during processing, e.g., scanning and compression. Reliable point cloud quality assessment (PCQA) is important for developing compression algorithms with good bitrate-quality trade-offs and techniques for quality improvement (e.g., denoising). This paper introduces a full-reference (FR) PCQA method utilizing spectral graph wavelets (SGWs). First, we propose novel SGW-based PCQA metrics that compare SGW coefficients of coordinate and color signals between reference and distorted point clouds. Second, we achieve accurate PCQA by integrating several conventional FR metrics and our SGW-based metrics using support vector regression. To our knowledge, this is the first study to introduce SGWs for PCQA. Experimental results demonstrate the proposed PCQA metric is more accurately correlated with subjective quality scores compared to conventional PCQA metrics.