title: Revisiting the Last-Iterate Convergence of Stochastic Gradient Methods

abstract: In the past several years, the last-iterate convergence of the Stochastic Gradient Descent (SGD) algorithm has triggered people's interest due to its good performance in practice but lack of theoretical understanding. For Lipschitz convex functions, different works have established the optimal $O(\log(1/\delta)\log T/\sqrt{T})$ or $O(\sqrt{\log(1/\delta)/T})$ high-probability convergence rates for the final iterate, where $T$ is the time horizon and $\delta$ is the failure probability. However, to prove these bounds, all the existing works are either limited to compact domains or require almost surely bounded noises. It is natural to ask whether the last iterate of SGD can still guarantee the optimal convergence rate but without these two restrictive assumptions. Besides this important question, there are still lots of theoretical problems lacking an answer. For example, compared with the last-iterate convergence of SGD for non-smooth problems, only few results for smooth optimization have yet been developed. Additionally, the existing results are all limited to a non-composite objective and the standard Euclidean norm. It still remains unclear whether the last-iterate convergence can be provably extended to wider composite optimization and non-Euclidean norms. In this work, to address the issues mentioned above, we revisit the last-iterate convergence of stochastic gradient methods and provide the first unified way to prove the convergence rates both in expectation and in high probability to accommodate general domains, composite objectives, non-Euclidean norms, Lipschitz conditions, smoothness, and (strong) convexity simultaneously. Additionally, we extend our analysis to obtain the last-iterate convergence under heavy-tailed noises.


title: Cooperative Learning for Cost-Adaptive Inference

abstract: We propose a cooperative training framework for deep neural network architectures that enables the runtime network depths to change to satisfy dynamic computing resource requirements. In our framework, the number of layers participating in computation can be chosen dynamically to meet performance-cost trade-offs at inference runtime. Our method trains two Teammate nets and a Leader net, and two sets of Teammate sub-networks with various depths through knowledge distillation. The Teammate nets derive sub-networks and transfer knowledge to them, and to each other, while the Leader net guides Teammate nets to ensure accuracy. The approach trains the framework atomically at once instead of individually training various sizes of models; in a sense, the various-sized networks are all trained at once, in a "package deal." The proposed framework is not tied to any specific architecture but can incorporate any existing models/architectures, therefore it can maintain stable results and is insensitive to the size of a dataset's feature map. Compared with other related approaches, it provides comparable accuracy to its full network while various sizes of models are available.


title: World Models via Policy-Guided Trajectory Diffusion

abstract: World models are a powerful tool for developing intelligent agents. By predicting the outcome of a sequence of actions, world models enable policies to be optimised via on-policy reinforcement learning (RL) using synthetic data, i.e. in "in imagination". Existing world models are autoregressive in that they interleave predicting the next state with sampling the next action from the policy. Prediction error inevitably compounds as the trajectory length grows. In this work, we propose a novel world modelling approach that is not autoregressive and generates entire on-policy trajectories in a single pass through a diffusion model. Our approach, Policy-Guided Trajectory Diffusion (PolyGRAD), leverages a denoising model in addition to the gradient of the action distribution of the policy to diffuse a trajectory of initially random states and actions into an on-policy synthetic trajectory. We analyse the connections between PolyGRAD, score-based generative models, and classifier-guided diffusion models. Our results demonstrate that PolyGRAD outperforms state-of-the-art baselines in terms of trajectory prediction error for short trajectories, with the exception of autoregressive diffusion. For short trajectories, PolyGRAD obtains similar errors to autoregressive diffusion, but with lower computational requirements. For long trajectories, PolyGRAD obtains comparable performance to baselines. Our experiments demonstrate that PolyGRAD enables performant policies to be trained via on-policy RL in imagination for MuJoCo continuous control domains. Thus, PolyGRAD introduces a new paradigm for accurate on-policy world modelling without autoregressive sampling.


title: Temporal Entanglement Entropy as a probe of Renormalization Group Flow

abstract: The recently introduced concept of timelike entanglement entropy has sparked a lot of interest. Unlike the traditional spacelike entanglement entropy, timelike entanglement entropy involves tracing over a timelike subsystem. In this work, we propose an extension of timelike entanglement entropy to Euclidean space ("temporal entanglement entropy"), and relate it to the renormalization group (RG) flow. Specifically, we show that tracing over a period of Euclidean time corresponds to coarse-graining the system and can be connected to momentum space entanglement. We employ Holography, a framework naturally embedding RG flow, to illustrate our proposal. Within cutoff holography, we establish a direct link between the UV cutoff and the smallest resolvable time interval within the effective theory through the irrelevant $T\bar T$ deformation. Increasing the UV cutoff results in an enhanced capability to resolve finer time intervals, while reducing it has the opposite effect. Moreover, we show that tracing over a larger Euclidean time interval is formally equivalent to integrating out more UV degrees of freedom (or lowering the temperature). As an application, we point out that the temporal entanglement entropy can detect the critical Lifshitz exponent $z$ in non-relativistic theories which is not accessible from spatial entanglement at zero temperature and density.


title: Occupancy Detection Based on Electricity Consumption

abstract: This article presents a new methodology for extracting intervals when a home is vacant from low-frequency electricity consumption data. The approach combines multiple algorithms, including change point detection, classification, period detection, and periodic spikes retrieval. It shows encouraging results on both simulated and real consumption curves. This approach offers practical insights for optimizing energy use and holds potential benefits for residential consumers and utility companies in terms of energy cost reduction and sustainability. Further research is needed to enhance its applicability in diverse settings and with larger datasets.


title: Markov Decision Processes with Noisy State Observation

abstract: This paper addresses the challenge of a particular class of noisy state observations in Markov Decision Processes (MDPs), a common issue in various real-world applications. We focus on modeling this uncertainty through a confusion matrix that captures the probabilities of misidentifying the true state. Our primary goal is to estimate the inherent measurement noise, and to this end, we propose two novel algorithmic approaches. The first, the method of second-order repetitive actions, is designed for efficient noise estimation within a finite time window, providing identifiable conditions for system analysis. The second approach comprises a family of Bayesian algorithms, which we thoroughly analyze and compare in terms of performance and limitations. We substantiate our theoretical findings with simulations, demonstrating the effectiveness of our methods in different scenarios, particularly highlighting their behavior in environments with varying stationary distributions. Our work advances the understanding of reinforcement learning in noisy environments, offering robust techniques for more accurate state estimation in MDPs.


title: Object-Centric Conformance Alignments with Synchronization (Extended Version)

abstract: Real-world processes operate on objects that are inter-dependent. To accurately reflect the nature of such processes, object-centric process mining techniques are needed, notably conformance checking. However, while the object-centric perspective has recently gained traction, few concrete process mining techniques have been presented so far. Moreover, existing approaches are severely limited in their abilities to keep track of object identity and object dependencies. Consequently, serious problems in logs remain undetected. In this paper, we present a new formalism that combines the key modelling features of two existing approaches, in particular the ability of object-centric Petri nets to capture one-to-many relations and the one of Petri nets with identifiers to compare and synchronize objects based on their identity. We call the resulting formalism 'object-centric Petri nets with identifiers', and define alignments and the conformance checking task for this setting. We propose a conformance checking approach for such nets based on an encoding in satisfiability modulo theories (SMT), and illustrate how it can be effectively used to overcome shortcomings of earlier work. To assess its practicality, we perform an evaluation on data from the literature.


title: Contractive error feedback for gradient compression

abstract: On-device memory concerns in distributed deep learning have become severe due to (i) the growth of model size in multi-GPU training, and (ii) the wide adoption of deep neural networks for federated learning on IoT devices which have limited storage. In such settings, communication efficient optimization methods are attractive alternatives, however they still struggle with memory issues. To tackle these challenges, we propose an communication efficient method called contractive error feedback (ConEF). As opposed to SGD with error-feedback (EFSGD) that inefficiently manages memory, ConEF obtains the sweet spot of convergence and memory usage, and achieves communication efficiency by leveraging biased and all-reducable gradient compression. We empirically validate ConEF on various learning tasks that include image classification, language modeling, and machine translation and observe that ConEF saves 80\% - 90\% of the extra memory in EFSGD with almost no loss on test performance, while also achieving 1.3x - 5x speedup of SGD. Through our work, we also demonstrate the feasibility and convergence of ConEF to clear up the theoretical barrier of integrating ConEF to popular memory efficient frameworks such as ZeRO-3.


title: On Searching for Minimal Integer Representation of Undirected Graphs

abstract: Minimal and efficient graph representations are key to store, communicate, and sample the search space of graphs and networks while meeting user-defined criteria. In this paper, we investigate the feasibility of gradient-free optimization heuristics based on Differential Evolution to search for minimal integer representations of undirected graphs. The class of Differential Evolution algorithms are population-based gradient-free optimization heuristics having found a relevant attention in the nonconvex and nonlinear optimization communities. Our computational experiments using eight classes of Differential Evolution schemes and graph instances with varying degrees of sparsity have shown the merit of attaining minimal numbers for graph encoding/representation rendered by exploration-oriented strategies within few function evaluations. Our results have the potential to elucidate new number-based encoding and sample-based algorithms for graph representation, network design and optimization.


title: Covering Rectilinear Polygons with Area-Weighted Rectangles

abstract: Representing a polygon using a set of simple shapes has numerous applications in different use-case scenarios. We consider the problem of covering the interior of a rectilinear polygon with holes by a set of area-weighted, axis-aligned rectangles such that the total weight of the rectangles in the cover is minimized. Already the unit-weight case is known to be NP-hard and the general problem has, to the best of our knowledge, not been studied experimentally before. We show a new basic property of optimal solutions of the weighted problem. This allows us to speed up existing algorithms for the unit-weight case, obtain an improved ILP formulation for both the weighted and unweighted problem, and develop several approximation algorithms and heuristics for the weighted case. All our algorithms are evaluated in a large experimental study on 186 837 polygons combined with six cost functions, which provides evidence that our algorithms are both fast and yield close-to-optimal solutions in practice.


title: Emergence of Disordered Hyperuniformity in Melts of Linear Diblock Copolymers

abstract: Disordered hyperuniform (DHU) systems are recently discovered exotic states of matter, where (normalized) large-scale density fluctuations are completely suppressed as in crystals, even though the systems are isotropic and lack conventional long-range order. Despite recent success, realizing such systems using bottom-up approaches remains challenging. Here, we study the large-scale behavior of neat melts of linear diblock copolymers using large-cell self-consistent field theory (SCFT) simulations. We initialize SCFT simulations using point patterns that correspond to the local energy minimum of the so-called Quantizer energy, a geometric functional related to the free energy of copolymeric self-assemblies. Upon relaxation via the SCFT simulations, we obtain a new class of metastable disordered micelle mesophases that are hyperuniform. Moreover, we find that DHU micelle mesophases possess very similar free energies to the thermodynamically stable body-centered cubic sphere mesophases and are also much more favorable energetically than previously obtained liquid-like packings. Our findings shed light on the design of novel disordered hyperuniform materials using bottom-up approaches, and suggest new possibilities for technological applications, e.g., novel non-iridescent structural colors.


title: Tensions in cosmology: a discussion of statistical tools to determine inconsistencies

abstract: We present a comprehensive analysis of statistical tools for evaluating tensions in cosmological parameter estimates arising from distinct datasets. Focusing on the unresolved Hubble constant ($H_0$) tension, we explore the Pantheon Plus + SH0ES (PPS) compilation, which includes low-redshift Cepheid data from the SH0ES collaboration, and the Cosmic Chronometers (CC) dataset. Employing various tension metrics, we quantitatively assess the inconsistencies in parameter estimates, emphasizing the importance of capturing multidimensional tensions. Our results reveal substantial tension between PPS and Planck 2018 datasets. We highlight the importance of the adoption of these metrics to enhance the precision of future cosmological analyses and facilitate the resolution of existing tensions.


title: Unveiling Diversity: Empowering OSS Project Leaders with Community Diversity and Turnover Dashboards

abstract: Managing open-source software (OSS) projects requires managing communities of contributors. In particular, it is essential for project leaders to understand their community's diversity and turnover. We present CommunityTapestry, a dynamic real-time community dashboard, which presents key diversity and turnover signals that we identified from the literature and through participatory design sessions with stakeholders. We evaluated CommunityTapestry with an OSS project's contributors and Project Management Committee members, who explored the dashboard using their own project data. Our study results demonstrate that CommunityTapestry increased participants' awareness of their community composition and the diversity and turnover rates in the project. It helped them identify areas of improvement and gave them actionable information.


title: A counterexample to Hildebrand's conjecture on stable sets

abstract: We provide a counterexample to a conjecture of Hildebrand which states that if $\mathcal{S}$ has positive lower density and for all $d$, $n$ is in $\mathcal{S}$ if and only if $dn$ is in $\mathcal{S}$ for almost all $n$, then $\mathcal{S} \cap (\mathcal{S}+1) \cap (\mathcal{S}+2)$ has positive lower density and in particular is nonempty. Heuristically, we define $\mathcal{S}$ by $3^\ell n \in \mathcal{S}$ if and only if $\text{Re}(n^{iT} \chi(n)) > 0$ where $\chi$ is the nontrivial multiplicative character mod 3 and $T$ is chosen such that $p^{iT} \approx \chi(p)$.


title: Representational constraints underlying similarity between task-optimized neural systems

abstract: Neural systems, artificial and biological, show similar representations of inputs when optimized to perform similar tasks. In visual systems optimized for tasks similar to object recognition, we propose that representation similarities arise from the constraints imposed by the development of abstractions in the representation across the processing stages. To study the effect of abstraction hierarchy of representations across different visual systems, we constructed a two-dimensional space in which each neural representation is positioned based on its distance from the pixel space and the class space. Trajectories of representations in all the task-optimized visual neural networks start close to the pixel space and gradually move towards higher abstract representations, such as object categories. We also observe that proximity in this abstraction space predicts the similarity of neural representations between visual systems. The gradual similar change of the representations suggests that the similarity across different task-optimized systems could arise from constraints on representational trajectories.


title: Heat kernel estimates for boundary trace of reflected diffusions on uniform domains

abstract: We study boundary trace process of a reflected diffusion for uniform domains. We obtain stable-like heat kernel estimates for the boundary trace process of a reflected diffusion for uniform domains when the diffusion on the underlying ambient space satisfies sub-Gaussian heat kernel estimates. Our arguments rely on new results of independent interest such as sharp estimates and doubling properties of the harmonic measure, continuous extension of Na\"im kernel to the topological boundary, and the Doob-Na\"im formula for the Dirichlet energy of boundary trace process.


title: One inch LaBr3:Ce detectors, with temperature control and improved time resolution for low energy X-rays spectroscopy

abstract: Large area LaBr3:Ce detectors with a SiPM array readout have been developed for the FAMU experiment at RAL. The aim was to have a good energy resolution for low energy X-rays detection (around 100 keV) and good timing properties of the signal pulse. Sixteen 1" detectors and twelve 1/2" detectors have been presently installed in the FAMU experiment and are taking data since March 2023, at RIKEN RAL Port 1.


title: EVP: Enhanced Visual Perception using Inverse Multi-Attentive Feature Refinement and Regularized Image-Text Alignment

abstract: This work presents the network architecture EVP (Enhanced Visual Perception). EVP builds on the previous work VPD which paved the way to use the Stable Diffusion network for computer vision tasks. We propose two major enhancements. First, we develop the Inverse Multi-Attentive Feature Refinement (IMAFR) module which enhances feature learning capabilities by aggregating spatial information from higher pyramid levels. Second, we propose a novel image-text alignment module for improved feature extraction of the Stable Diffusion backbone. The resulting architecture is suitable for a wide variety of tasks and we demonstrate its performance in the context of single-image depth estimation with a specialized decoder using classification-based bins and referring segmentation with an off-the-shelf decoder. Comprehensive experiments conducted on established datasets show that EVP achieves state-of-the-art results in single-image depth estimation for indoor (NYU Depth v2, 11.8% RMSE improvement over VPD) and outdoor (KITTI) environments, as well as referring segmentation (RefCOCO, 2.53 IoU improvement over ReLA). The code and pre-trained models are publicly available at https://github.com/Lavreniuk/EVP.


title: A COLREGs-Compliant Conflict Resolution Strategy for Autonomous Surface Vehicles

abstract: This paper presents a novel conflict resolution strategy for autonomous surface vehicles (ASVs) to safely navigate and avoid collisions in a multi-vessel environment at sea. Collisions between two or more marine vessels must be avoided by following the International Regulations for Preventing Collisions at Sea (COLREGs). We propose strategy a two-phase strategy called as COLREGs Compliant Conflict-Resolving (COMCORE) strategy, that generates collision-free trajectories for ASVs while complying with COLREGs. In phase-1, a shortest path for each agent is determined, while in phase-2 conflicts are detected and resolved by modifying the path in compliance with COLREGs. COMCORE solution optimises vessel trajectories for lower costs while also providing a safe and collision-free plan for each vessel. Simulation results are presented to show the applicability of COMCORE for larger number agents with very low computational requirement and hence scalable. Further, we experimentally demonstrate COMCORE for two ASVs in a lake to show its ability to determine solution and implementation capability in the real-world.


title: Harmonics of Learning: Universal Fourier Features Emerge in Invariant Networks

abstract: In this work, we formally prove that, under certain conditions, if a neural network is invariant to a finite group then its weights recover the Fourier transform on that group. This provides a mathematical explanation for the emergence of Fourier features -- a ubiquitous phenomenon in both biological and artificial learning systems. The results hold even for non-commutative groups, in which case the Fourier transform encodes all the irreducible unitary group representations. Our findings have consequences for the problem of symmetry discovery. Specifically, we demonstrate that the algebraic structure of an unknown group can be recovered from the weights of a network that is at least approximately invariant within certain bounds. Overall, this work contributes to a foundation for an algebraic learning theory of invariant neural network representations.


title: Coexistence of Satellite-borne Passive Radiometry and Terrestrial NextG Wireless Networks in the Restricted L-Band

abstract: The rapid growth of active wireless communications technologies has fostered research on spectrum coexistence worldwide. One idea that is gaining attention is sharing frequency bands solely devoted to passive applications, such as passive remote sensing. One such option is the 27 MHz L-band spectrum from 1.400 to 1.427 GHz. Active wireless transmissions are prohibited in this passive band due to radio regulations aimed at preventing Radio Frequency Interference (RFI) on highly sensitive passive radiometry instruments. The Soil Moisture Active Passive (SMAP) satellite, launched by the National Aeronautics and Space Administration (NASA), is a recent space-based remote sensing mission that passively scans the Earth's electromagnetic emissions in this 27 MHz band to assess soil moisture on a global scale periodically. In this paper, leveraging stochastic geometry, we assess the feasibility of using this passive band for the downlink (base station to user equipment) of a large-scale terrestrial NextG wireless network exposed to SMAP, while ensuring that the error induced on SMAP's measurements due to RFI is below a given threshold. Although the methodology established here is based on SMAP's specifications, it is adaptable to various passive sensing satellites regardless of their orbits or operating frequencies.


title: Crystalline finite-size topology

abstract: Topological phases stabilized by crystalline point group symmetry protection are a large class of symmetry-protected topological phases subjected to considerable experimental scrutiny. Here, we show that the canonical three-dimensional (3D) crystalline topological insulator protected by time-reversal symmetry $\mathcal{T}$ and four-fold rotation symmetry $\mathcal{C}_4$ individually or the product symmetry $\mathcal{C}_4 \mathcal{T}$, generically realizes finite-size crystalline topological phases in thin film geometry (a quasi-(3-1)-dimensional, or q(3-1)D, geometry): response signatures of the 3D bulk topology co-exist with topologically-protected, quasi-(3-2)D and quasi-(3-3)D boundary modes within the energy gap resulting from strong hybridisation of the Dirac cone surface states of the underlying 3D crystalline topological phase. Importantly, we find qualitative distinctions between these gapless boundary modes and those of strictly 2D crystalline topological states with the same symmetry-protection, and develop a low-energy, analytical theory of the finite-size topological magnetoelectric response.


title: USM-Lite: Quantization and Sparsity Aware Fine-tuning for Speech Recognition with Universal Speech Models

abstract: End-to-end automatic speech recognition (ASR) models have seen revolutionary quality gains with the recent development of large-scale universal speech models (USM). However, deploying these massive USMs is extremely expensive due to the enormous memory usage and computational cost. Therefore, model compression is an important research topic to fit USM-based ASR under budget in real-world scenarios. In this study, we propose a USM fine-tuning approach for ASR, with a low-bit quantization and N:M structured sparsity aware paradigm on the model weights, reducing the model complexity from parameter precision and matrix topology perspectives. We conducted extensive experiments with a 2-billion parameter USM on a large-scale voice search dataset to evaluate our proposed method. A series of ablation studies validate the effectiveness of up to int4 quantization and 2:4 sparsity. However, a single compression technique fails to recover the performance well under extreme setups including int2 quantization and 1:4 sparsity. By contrast, our proposed method can compress the model to have 9.4% of the size, at the cost of only 7.3% relative word error rate (WER) regressions. We also provided in-depth analyses on the results and discussions on the limitations and potential solutions, which would be valuable for future studies.


title: Adaptive Robot Coordination: A Subproblem-based Approach for Hybrid Multi-Robot Motion Planning

abstract: This work presents Adaptive Robot Coordination (ARC), a novel hybrid framework for multi-robot motion planning (MRMP) that employs local subproblems to resolve inter-robot conflicts. ARC creates subproblems centered around conflicts, and the solutions represent the robot motions required to resolve these conflicts. The use of subproblems enables an inexpensive hybrid exploration of the multi-robot planning space. ARC leverages the hybrid exploration by dynamically adjusting the coupling and decoupling of the multi-robot planning space. This allows ARC to adapt the levels of coordination efficiently by planning in decoupled spaces, where robots can operate independently, and in coupled spaces where coordination is essential. ARC is probabilistically complete, can be used for any robot, and produces efficient cost solutions in reduced planning times. Through extensive evaluation across representative scenarios with different robots requiring various levels of coordination, ARC demonstrates its ability to provide simultaneous scalability and precise coordination. ARC is the only method capable of solving all the scenarios and is competitive with coupled, decoupled, and hybrid baselines.


title: KDAS: Knowledge Distillation via Attention Supervision Framework for Polyp Segmentation

abstract: Polyp segmentation, a contentious issue in medical imaging, has seen numerous proposed methods aimed at improving the quality of segmented masks. While current state-of-the-art techniques yield impressive results, the size and computational cost of these models create challenges for practical industry applications. To address this challenge, we present KDAS, a Knowledge Distillation framework that incorporates attention supervision, and our proposed Symmetrical Guiding Module. This framework is designed to facilitate a compact student model with fewer parameters, allowing it to learn the strengths of the teacher model and mitigate the inconsistency between teacher features and student features, a common challenge in Knowledge Distillation, via the Symmetrical Guiding Module. Through extensive experiments, our compact models demonstrate their strength by achieving competitive results with state-of-the-art methods, offering a promising approach to creating compact models with high accuracy for polyp segmentation and in the medical imaging field. The implementation is available on https://github.com/huyquoctrinh/KDAS.


title: Capacity planning of renewable energy systems using stochastic dual dynamic programming

abstract: We present a capacity expansion model for deciding the new electricity generation and transmission capacity to complement an existing hydroelectric reservoir system. The objective is to meet a forecast demand at least expected cost, namely the capital cost of the investment plus the expected discounted operating cost of the system. The optimal operating policy for any level of capacity investment can be computed using stochastic dual dynamic programming. We show how to combine a multistage stochastic operational model of the hydro system with a capacity expansion model to create a single model that can be solved by existing open-source solvers for multistage stochastic programs without the need for customized decomposition algorithms. We illustrate our method by applying it to a model of the New Zealand electricity system and comparing the solutions obtained with those found in a previous study.


title: Creating and Querying Data Cubes in Python using pyCube

abstract: Data cubes are used for analyzing large data sets usually contained in data warehouses. The most popular data cube tools use graphical user interfaces (GUI) to do the data analysis. Traditionally this was fine since data analysts were not expected to be technical people. However, in the subsequent decades the data landscape changed dramatically requiring companies to employ large teams of highly technical data scientists in order to manage and use the ever increasing amount of data. These data scientists generally use tools like Python, interactive notebooks, pandas, etc. while modern data cube tools are still GUI based. This paper proposes a Python-based data cube tool called pyCube. pyCube is able to semi-automatically create data cubes for data stored in an RDBMS and manages the data cube metadata. pyCube's programmatic interface enables data scientist to query data cubes by specifying the expected metadata of the result. pyCube is experimentally evaluated on Star Schema Benchmark (SSB). The results show that pyCube vastly outperforms different implementations of SSB queries in pandas in both runtime and memory while being easier to read and write.


title: G-MEMP: Gaze-Enhanced Multimodal Ego-Motion Prediction in Driving

abstract: Understanding the decision-making process of drivers is one of the keys to ensuring road safety. While the driver intent and the resulting ego-motion trajectory are valuable in developing driver-assistance systems, existing methods mostly focus on the motions of other vehicles. In contrast, we focus on inferring the ego trajectory of a driver's vehicle using their gaze data. For this purpose, we first collect a new dataset, GEM, which contains high-fidelity ego-motion videos paired with drivers' eye-tracking data and GPS coordinates. Next, we develop G-MEMP, a novel multimodal ego-trajectory prediction network that combines GPS and video input with gaze data. We also propose a new metric called Path Complexity Index (PCI) to measure the trajectory complexity. We perform extensive evaluations of the proposed method on both GEM and DR(eye)VE, an existing benchmark dataset. The results show that G-MEMP significantly outperforms state-of-the-art methods in both benchmarks. Furthermore, ablation studies demonstrate over 20% improvement in average displacement using gaze data, particularly in challenging driving scenarios with a high PCI. The data, code, and models can be found at https://eth-ait.github.io/g-memp/.


title: Fair Active Learning in Low-Data Regimes

abstract: In critical machine learning applications, ensuring fairness is essential to avoid perpetuating social inequities. In this work, we address the challenges of reducing bias and improving accuracy in data-scarce environments, where the cost of collecting labeled data prohibits the use of large, labeled datasets. In such settings, active learning promises to maximize marginal accuracy gains of small amounts of labeled data. However, existing applications of active learning for fairness fail to deliver on this, typically requiring large labeled datasets, or failing to ensure the desired fairness tolerance is met on the population distribution. To address such limitations, we introduce an innovative active learning framework that combines an exploration procedure inspired by posterior sampling with a fair classification subroutine. We demonstrate that this framework performs effectively in very data-scarce regimes, maximizing accuracy while satisfying fairness constraints with high probability. We evaluate our proposed approach using well-established real-world benchmark datasets and compare it against state-of-the-art methods, demonstrating its effectiveness in producing fair models, and improvement over existing methods.


title: Feynman rules for Scalars at the Bestest Little Higgs Model

abstract: The Bestest Little Higgs Model (BLHM) has attracted increasing attention in recent years, mainly because it can explain the hierarchy problem without fine-tuning by introducing one-loop corrections to the Higgs boson mass through heavy top-quark partners and gauge bosons. In this paper, we lay the groundwork for future research in the BLHM, derive and present Feynman rules for scalars ($h_0, H_0, \phi^{0}, \eta^{0}, \sigma, H^{\pm}, \phi^{\pm}, \eta^{\pm}, A_0$) and include the self-interactions of Higgs bosons. We also provide the Mathematica notebooks used to obtain the Feynman rules. These Feynman rules help investigate new physics beyond the Standard Model. The calculations are performed using FeynCalc, and all model files are publicly available online at http://ricaxcan.uaz.edu.mx/jspui/simple-search. Export of the Lagrangians to FeynArt is also posible.


title: A data-driven approach for modeling large-amplitude aeroelastic oscillations of pitching wings

abstract: We propose and validate a data-driven approach for modeling large-amplitude flow-induced oscillations of elastically mounted pitching wings. We first train a neural networks regression model for the nonlinear aerodynamic moment using data obtained from purely prescribed oscillations and static measurements. We then embed this model into an ordinary differential equation solver to solve for the governing equation of the passive aeroelastic system with desired structural parameters. The system dynamics predicted by the proposed data-driven method are characterized and compared with those obtained from physical experiments. The predicted and experimental pitching amplitude, frequency and aerodynamic moment responses are found to be in excellent agreement. Both the structural mode of high-inertia wings and the hydrodynamic mode of low-inertia wings are successfully predicted. The transient growth and saturation of the oscillation amplitude and the aerodynamic moment are also faithfully captured by the proposed method. Additional test cases demonstrate the broad applicability of this approach.


title: The covariant functoriality of graph algebras

abstract: In the standard category of directed graphs, graph morphisms map edges to edges. By allowing graph morphisms to map edges to finite paths (path homomorphisms of graphs), we obtain an ambient category in which we determine subcategories enjoying covariant functors to categories of algebras given by constructions of path algebras, Cohn path algebras, and Leavitt path algebras, respectively. Thus we obtain new tools to unravel homomorphisms between Leavitt path algebras and graph C*-algebras. In particular, a graph-algebraic presentation of the inclusion of the C*-algebra of a quantum real projective plane into the Toeplitz algebra allows us to determine a quantum CW-complex structure of the former. It comes as a mixed-pullback theorem where two $*$-homomorphisms are covariantly induced from path homomorphisms of graphs and the remaining two are contravariantly induced by admissible inclusions of graphs. As a main result and an application of new covariant-induction tools, we prove such a mixed-pullback theorem for arbitrary graphs whose all vertex-simple loops have exits, which substantially enlarges the scope of examples coming from noncommutative topology.


title: Efficient-NeRF2NeRF: Streamlining Text-Driven 3D Editing with Multiview Correspondence-Enhanced Diffusion Models

abstract: The advancement of text-driven 3D content editing has been blessed by the progress from 2D generative diffusion models. However, a major obstacle hindering the widespread adoption of 3D content editing is its time-intensive processing. This challenge arises from the iterative and refining steps required to achieve consistent 3D outputs from 2D image-based generative models. Recent state-of-the-art methods typically require optimization time ranging from tens of minutes to several hours to edit a 3D scene using a single GPU. In this work, we propose that by incorporating correspondence regularization into diffusion models, the process of 3D editing can be significantly accelerated. This approach is inspired by the notion that the estimated samples during diffusion should be multiview-consistent during the diffusion generation process. By leveraging this multiview consistency, we can edit 3D content at a much faster speed. In most scenarios, our proposed technique brings a 10$\times$ speed-up compared to the baseline method and completes the editing of a 3D scene in 2 minutes with comparable quality.


title: Collisionless cooling of perpendicular electron temperature in the thermal quench of a magnetized plasma

abstract: Thermal quench of a nearly collisionless plasma against a cooling boundary or region is an undesirable off-normal event in magnetic fusion experiments, but an ubiquitous process of cosmological importance in astrophysical plasmas. There is a well-known mismatch that what experimentally diagnosed is the drop in perpendicular electron temperature $T_{e\perp},$ but the parallel transport theory of ambipolar-constrained tail electron loss produces parallel electron temperature $T_{e\parallel}$ cooling. Here two collisionless mechanisms, dilutional cooling by infalling cold electrons and wave-particle interaction by two families of whistler instabilities, are shown to enable fast $T_{e\perp}$ cooling that closely tracks the mostly collisionless crash of $T_{e\parallel}.$


title: On a binary Diophantine inequality involving primes of a special type

abstract: Let $1<c<\frac{1787}{1502}$ and $N$ be a sufficiently large real number. In this paper, it is proved that for any arbitrarily large number $E>0$ and for almost all real $R \in (N,2N]$, the Diophantine inequality $$|p_{1}^{c}+p_{2}^{c}-R|<(log N)^{-E}$$ is solvable in prime variables $p_1,p_2$ such that, each of the numbers $p_{1}+2,p_{2}+2$ has at most $[\frac{79606}{35740-30040c}]$ prime factors, counted with multiplicity. Moreover, we prove that the Diophantine inequality $$|p_{1}^{c}+p_{2}^{c}+p_{3}^{c}+p_{4}^{c}-N|<(log N)^{-E}$$ is solvable in prime variables $p_1,p_2,p_3,p_4$ such that, each of the numbers $p_{i}+2(i=1,2,3,4)$ has at most $[\frac{93801402}{35740000-30040000c}]$ prime factors, counted with multiplicity.


title: Learning adaptive planning representations with natural language guidance

abstract: Effective planning in the real world requires not only world knowledge, but the ability to leverage that knowledge to build the right representation of the task at hand. Decades of hierarchical planning techniques have used domain-specific temporal action abstractions to support efficient and accurate planning, almost always relying on human priors and domain knowledge to decompose hard tasks into smaller subproblems appropriate for a goal or set of goals. This paper describes Ada (Action Domain Acquisition), a framework for automatically constructing task-specific planning representations using task-general background knowledge from language models (LMs). Starting with a general-purpose hierarchical planner and a low-level goal-conditioned policy, Ada interactively learns a library of planner-compatible high-level action abstractions and low-level controllers adapted to a particular domain of planning tasks. On two language-guided interactive planning benchmarks (Mini Minecraft and ALFRED Household Tasks), Ada strongly outperforms other approaches that use LMs for sequential decision-making, offering more accurate plans and better generalization to complex tasks.


title: ConFormer: A Novel Collection of Deep Learning Models to Assist Cardiologists in the Assessment of Cardiac Function

abstract: Cardiovascular diseases, particularly heart failure, are a leading cause of death globally. The early detection of heart failure through routine echocardiogram screenings is often impeded by the high cost and labor-intensive nature of these procedures, a barrier that can mean the difference between life and death. This paper presents ConFormer, a novel deep learning model designed to automate the estimation of Ejection Fraction (EF) and Left Ventricular Wall Thickness from echocardiograms. The implementation of ConFormer has the potential to enhance preventative cardiology by enabling cost-effective, accessible, and comprehensive heart health monitoring, thereby saving countless lives. The source code is available at https://github.com/Aether111/ConFormer.


title: NViST: In the Wild New View Synthesis from a Single Image with Transformers

abstract: We propose NViST, a transformer-based model for efficient and generalizable novel-view synthesis from a single image for real-world scenes. In contrast to many methods that are trained on synthetic data, object-centred scenarios, or in a category-specific manner, NViST is trained on MVImgNet, a large-scale dataset of casually-captured real-world videos of hundreds of object categories with diverse backgrounds. NViST transforms image inputs directly into a radiance field, conditioned on camera parameters via adaptive layer normalisation. In practice, NViST exploits fine-tuned masked autoencoder (MAE) features and translates them to 3D output tokens via cross-attention, while addressing occlusions with self-attention. To move away from object-centred datasets and enable full scene synthesis, NViST adopts a 6-DOF camera pose model and only requires relative pose, dropping the need for canonicalization of the training data, which removes a substantial barrier to it being used on casually captured datasets. We show results on unseen objects and categories from MVImgNet and even generalization to casual phone captures. We conduct qualitative and quantitative evaluations on MVImgNet and ShapeNet to show that our model represents a step forward towards enabling true in-the-wild generalizable novel-view synthesis from a single image. Project webpage: https://wbjang.github.io/nvist_webpage.


title: Theory of quantum super impulses

abstract: A quantum impulse is a brief but strong perturbation that produces a sudden change in a wavefunction $\psi(x)$. We develop a theory of quantum impulses, distinguishing between ordinary and super impulses. An ordinary impulse paints a phase onto $\psi$, while a super impulse -- the main focus of this paper -- deforms the wavefunction under an invertible map, $\mu: x -> x'$. Borrowing tools from optimal mass transport theory and shortcuts to adiabaticity, we show how to design a super impulse that deforms a wavefunction under a desired map $\mu$, and we illustrate our results using solvable examples. We point out a strong connection between quantum and classical super impulses, expressed in terms of the path integral formulation of quantum mechanics. We briefly discuss hybrid impulses, in which ordinary and super impulses are applied simultaneously. While our central results are derived for evolution under the time-dependent Schrodinger equation, they apply equally well to the time-dependent Gross-Pitaevskii equation, and thus may be relevant for the manipulation of Bose-Einstein condensates.


title: (Re-)reading Sklar (1959) -- A personal view on Sklar's theorem

abstract: Some personal thoughts on Sklar's theorem and copulas after reading the original paper (Sklar, 1959) in French.


title: PhasePerturbation: Speech Data Augmentation via Phase Perturbation for Automatic Speech Recognition

abstract: Most of the current speech data augmentation methods operate on either the raw waveform or the amplitude spectrum of speech. In this paper, we propose a novel speech data augmentation method called PhasePerturbation that operates dynamically on the phase spectrum of speech. Instead of statically rotating a phase by a constant degree, PhasePerturbation utilizes three dynamic phase spectrum operations, i.e., a randomization operation, a frequency masking operation, and a temporal masking operation, to enhance the diversity of speech data. We conduct experiments on wav2vec2.0 pre-trained ASR models by fine-tuning them with the PhasePerturbation augmented TIMIT corpus. The experimental results demonstrate 10.9\% relative reduction in the word error rate (WER) compared with the baseline model fine-tuned without any augmentation operation. Furthermore, the proposed method achieves additional improvements (12.9\% and 15.9\%) in WER by complementing the Vocal Tract Length Perturbation (VTLP) and the SpecAug, which are both amplitude spectrum-based augmentation methods. The results highlight the capability of PhasePerturbation to improve the current amplitude spectrum-based augmentation methods.


title: Asymptotic quasisymmetric high-beta 3D MHD equilibria near axisymmetry

abstract: Quasisymmetry (QS), a hidden symmetry of the magnetic field strength, is known to support nested flux surfaces and provide superior particle confinement in stellarators. In this work, we study the ideal MHD equilibrium and stability of high-beta plasma in a large aspect-ratio stellarator. In particular, we show that the lowest-order description of a near-axisymmetric equilibrium vastly simplifies the problem of 3D quasisymmetric MHD equilibria, which can be reduced to a standard elliptic Grad-Shafranov equation for the flux function. We show that any large aspect-ratio tokamak, deformed periodically in the vertical direction, is a stellarator with approximate volumetric QS. We discuss exact analytical solutions and numerical benchmarks. Finally, we discuss the ideal ballooning and interchange stability of some of our equilibrium configurations.


title: Probably approximately correct stability of allocations in uncertain coalitional games with private sampling

abstract: We study coalitional games with exogenous uncertainty in the coalition value, in which each agent is allowed to have private samples of the uncertainty. As a consequence, the agents may have a different perception of stability of the grand coalition. In this context, we propose a novel methodology to study the out-of-sample coalitional rationality of allocations in the set of stable allocations (i.e., the core). Our analysis builds on the framework of probably approximately correct learning. Initially, we state a priori and a posteriori guarantees for the entire core. Furthermore, we provide a distributed algorithm to compute a compression set that determines the generalization properties of the a posteriori statements. We then refine our probabilistic robustness bounds by specialising the analysis to a single payoff allocation, taking, also in this case, both a priori and a posteriori approaches. Finally, we consider a relaxed $\zeta$-core to include nearby allocations and also address the case of empty core. For this case, probabilistic statements are given on the eventual stability of allocations in the $\zeta$-core.


title: Transport through a monolayer-tube junction: sheet-to-tube spin current in silicene

abstract: A method is developed to calculate the electron flow between an atomic monolayer sheet and a tube with use of tunneling matrix elements between monolayer sheets and applied to the spin current from monolayer silicene with sublattice-staggered current-induced spin polarization to silicene tube. Calculated sheet-to-tube spin current exhibits an oscillation as a function of the tube circumferential length since the Fermi points in the tube cross the Fermi circle in the sheet. It is also shown that the spin current with spin in the out-of-plane direction, which is absent in the sheet-sheet junction (including twisted sheets) with the $C_3$ rotational symmetry, appears in an oscillating form owing to the broken $C_3$ symmetry in the tube-sheet junction.


title: Betti splittings and multigraded Betti numbers of cover ideals of bipartite graphs

abstract: In this note, we study Betti splittings of cover ideals of bipartite graphs. We prove that if $J \subset \Bbbk [x_1,\dots,x_n]$ is the cover ideal of a bipartite graph then the $x_i$-partition of $J$ is a Betti splitting for any $i$. We also prove that multigraded Betti numbers of any squarefree monomial ideal can appear in a certain part of multigraded Betti numbers of the cover ideal of a bipartite graph.


title: Symmetries, Spin-2 Scattering Amplitudes, and Equivalence theorems in Warped Five-Dimensional Gravitational Theories

abstract: Building on work by Hang and He, we show how the residual five-dimensional diffeomorphism symmetries of compactified gravitational theories with a warped extra dimension imply Equivalence theorems which ensure that the scattering amplitudes of helicity-0 and helicity-1 spin-2 Kaluza-Klein states equal (to leading order in scattering energy) those of the corresponding Goldstone bosons present in the `t-Hooft-Feynman gauge. We derive a set of Ward identities that lead to a transparent power-counting of the scattering amplitudes involving spin-2 Kaluza-Klein states. We explicitly calculate these amplitudes in terms of the Goldstone bosons in the Randall-Sundrum model, check the correspondence to previous unitary-gauge computations, and demonstrate the efficacy of `t-Hooft-Feynman gauge for accurately computing amplitudes for scattering of the spin-2 states both among themselves and with matter. Power-counting for the Goldstone boson interactions establishes that the scattering amplitudes grow no faster than $O(s)$, explaining the origin of the behavior previously shown to arise from intricate cancellations between different contributions to these scattering amplitudes in unitary gauge. We describe how our results apply to more general warped geometries, including models with a stabilized extra dimension. In an appendix we explicitly identify the symmetry algebra of the residual 5D diffeomorphisms of a Randall-Sundrum extra-dimensional theory.


title: Federated Learning for Wireless Applications: A Prototype

abstract: Wireless embedded edge devices are ubiquitous in our daily lives, enabling them to gather immense data via onboard sensors and mobile applications. This offers an amazing opportunity to train machine learning (ML) models in the realm of wireless devices for decision-making. Training ML models in a wireless setting necessitates transmitting datasets collected at the edge to a cloud parameter server, which is infeasible due to bandwidth constraints, security, and privacy issues. To tackle these challenges, Federated Learning (FL) has emerged as a distributed optimization approach to the decentralization of the model training process. In this work, we present a novel prototype to examine FL's effectiveness over bandwidth-constrained wireless channels. Through a novel design consisting of Zigbee and NI USRP devices, we propose a configuration that allows clients to broadcast synergistically local ML model updates to a central server to obtain a generalized global model. We assess the efficacy of this prototype using metrics such as global model accuracy and time complexity under varying conditions of transmission power, data heterogeneity and local learning.


title: A Picture is Worth More Than 77 Text Tokens: Evaluating CLIP-Style Models on Dense Captions

abstract: Curation methods for massive vision-language datasets trade off between dataset size and quality. However, even the highest quality of available curated captions are far too short to capture the rich visual detail in an image. To show the value of dense and highly-aligned image-text pairs, we collect the Densely Captioned Images (DCI) dataset, containing 7805 natural images human-annotated with mask-aligned descriptions averaging above 1000 words each. With precise and reliable captions associated with specific parts of an image, we can evaluate vision-language models' (VLMs) understanding of image content with a novel task that matches each caption with its corresponding subcrop. As current models are often limited to 77 text tokens, we also introduce a summarized version (sDCI) in which each caption length is limited. We show that modern techniques that make progress on standard benchmarks do not correspond with significant improvement on our sDCI based benchmark. Lastly, we finetune CLIP using sDCI and show significant improvements over the baseline despite a small training set. By releasing the first human annotated dense image captioning dataset, we hope to enable the development of new benchmarks or fine-tuning recipes for the next generation of VLMs to come.


title: Identifying Planetary Names in Astronomy Papers: A Multi-Step Approach

abstract: The automatic identification of planetary feature names in astronomy publications presents numerous challenges. These features include craters, defined as roughly circular depressions resulting from impact or volcanic activity; dorsas, which are elongate raised structures or wrinkle ridges; and lacus, small irregular patches of dark, smooth material on the Moon, referred to as "lake" (Planetary Names Working Group, n.d.). Many feature names overlap with places or people's names that they are named after, for example, Syria, Tempe, Einstein, and Sagan, to name a few (U.S. Geological Survey, n.d.). Some feature names have been used in many contexts, for instance, Apollo, which can refer to mission, program, sample, astronaut, seismic, seismometers, core, era, data, collection, instrument, and station, in addition to the crater on the Moon. Some feature names can appear in the text as adjectives, like the lunar craters Black, Green, and White. Some feature names in other contexts serve as directions, like craters West and South on the Moon. Additionally, some features share identical names across different celestial bodies, requiring disambiguation, such as the Adams crater, which exists on both the Moon and Mars. We present a multi-step pipeline combining rule-based filtering, statistical relevance analysis, part-of-speech (POS) tagging, named entity recognition (NER) model, hybrid keyword harvesting, knowledge graph (KG) matching, and inference with a locally installed large language model (LLM) to reliably identify planetary names despite these challenges. When evaluated on a dataset of astronomy papers from the Astrophysics Data System (ADS), this methodology achieves an F1-score over 0.97 in disambiguating planetary feature names.


abstract: The main purpose of this paper is to establish a Schwarz lemma for the solutions to the Dirichlet problems for the invariant Laplacians. The obtained result of this paper is a generalization of the corresponding known results [11, Theorem 1.1] and [15, Theorem 2.1].


title: High-resolution spectroscopy of the young open cluster M 39 (NGC 7092)

abstract: M 39 is a nearby young open cluster hardly studied in the last decades. No giant is known among its members and its chemical composition has never been studied. In order to investigate it we performed high-resolution spectroscopy of 20 expected cluster members with the HARPS and FIES spectrographs. By combining our observations with archival photometry and $Gaia$-DR3 data we searched for evolved members and studied cluster properties such as the radial velocity, extinction and age. For the first time, we provide stellar parameters and chemical abundances for 21 species with atomic numbers up to 56. We have not found any new giant as likely member and notice a negligible reddening along the cluster field, that we place at 300 pc. We obtain a mean radial velocity for M 39 of -5.5$\pm$0.5 km s$^{-1}$ and an isochrone-fitting age of 430$\pm$110 Ma, which corresponds to a MSTO mass of around 2.8 Msol. This value is consistent with the Li content and chromospheric activity shown by its members. Based on main-sequence stars the cluster exhibits a solar composition, [Fe/H]=+0.04$\pm$0.08 dex, compatible with its Galactocentric location. However, it has a slightly subsolar abundance of Na and an enriched content of neutron-capture elements, specially Ba. In any case, the chemical composition of M 39 is fully compatible with that shown by other open clusters that populate the Galactic thin disc


title: Simulations of Thin Polymer Films on Flat and Curved Substrates

abstract: We report molecular dynamics simulation results on the equilibrium properties of polymer thin films adsorbed onto flat and curved substrates. We first systematically determine the contact angle of polymer droplets on flat substrates as a function of the substrate-monomer adsorption strength and degree of polymerization. Focussing on the fully wetted regime, we then investigate the effect of the substrate's topography on the polymer film configuration by using substrates with varying mean curvature. We find that polymer chains close to the substrate are significantly stretched (compressed) in regions of high negative (positive) mean curvature. Further, we find partial dewetting near regions of high mean curvature for thin polymer films. For thicker films, the polymers fully cover the substrate and the shape of the liquid-vapor interface largely follows the shape of the substrate. As the film thickness is increased further, the liquid-vapor interface becomes completely flat. These simulation results are corroborated by analytic calculations using a simplified continuum model that treats the adsorbed polymers as an incompressible medium. Our findings show how the substrate topography influences the conformation of individual chains as well as the shape of the entire film.


title: ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Tasks

abstract: This study examines 4-bit quantization methods like GPTQ in large language models (LLMs), highlighting GPTQ's overfitting and limited enhancement in Zero-Shot tasks. While prior works merely focusing on zero-shot measurement, we extend task scope to more generative categories such as code generation and abstractive summarization, in which we found that INT4 quantization can significantly underperform. However, simply shifting to higher precision formats like FP6 has been particularly challenging, thus overlooked, due to poor performance caused by the lack of sophisticated integration and system acceleration strategies on current AI hardware. Our results show that FP6, even with a coarse-grain quantization scheme, performs robustly across various algorithms and tasks, demonstrating its superiority in accuracy and versatility. Notably, with the FP6 quantization, \codestar-15B model performs comparably to its FP16 counterpart in code generation, and for smaller models like the 406M it closely matches their baselines in summarization. Neither can be achieved by INT4. To better accommodate various AI hardware and achieve the best system performance, we propose a novel 4+2 design for FP6 to achieve similar latency to the state-of-the-art INT4 fine-grain quantization. With our design, FP6 can become a promising solution to the current 4-bit quantization methods used in LLMs.


title: Hybrid Content Dynamic Recommendation System Based in Adapted Tags and Applied to Digital Library

abstract: The technological evolution of the library in the academic environment brought a lot of information and documents that are available to access, but these systems do not always have mechanisms to search in an integrated way the relevant information for the user. To alleviate this problem, we propose a recommendation system that generates the user profile through tags that are reshaped over time. To trace the user profile the system uses information from your lending history stored in the library database and it collects their opinions (feedback) through a list of recommendations. These data are integrated with the document base of institutional repository.Thus, the recommendation system assists users in identifying relevant items and makes suggestions for content in an integrated environment that contains institutional repository documents and the university library database. The proposed recommendation system uses a hybrid approach being applied in an academic environment with the participation of the users.


title: Unraveling Key Factors of Knowledge Distillation

abstract: Knowledge distillation, a technique for model compression and performance enhancement, has gained significant traction in Neural Machine Translation (NMT). However, existing research primarily focuses on empirical applications, and there is a lack of comprehensive understanding of how student model capacity, data complexity, and decoding strategies collectively influence distillation effectiveness. Addressing this gap, our study conducts an in-depth investigation into these factors, particularly focusing on their interplay in word-level and sequence-level distillation within NMT. Through extensive experimentation across datasets like IWSLT13 En$\rightarrow$Fr, IWSLT14 En$\rightarrow$De, and others, we empirically validate hypotheses related to the impact of these factors on knowledge distillation. Our research not only elucidates the significant influence of model capacity, data complexity, and decoding strategies on distillation effectiveness but also introduces a novel, optimized distillation approach. This approach, when applied to the IWSLT14 de$\rightarrow$en translation task, achieves state-of-the-art performance, demonstrating its practical efficacy in advancing the field of NMT.


title: Estimating calibration error under label shift without labels

abstract: In the face of dataset shift, model calibration plays a pivotal role in ensuring the reliability of machine learning systems. Calibration error (CE) is an indicator of the alignment between the predicted probabilities and the classifier accuracy. While prior works have delved into the implications of dataset shift on calibration, existing CE estimators assume access to labels from the target domain, which are often unavailable in practice, i.e., when the model is deployed and used. This work addresses such challenging scenario, and proposes a novel CE estimator under label shift, which is characterized by changes in the marginal label distribution $p(Y)$, while keeping the conditional $p(X|Y)$ constant between the source and target distributions. Our contribution is an approach, which, by leveraging importance re-weighting of the labeled source distribution, provides consistent and asymptotically unbiased CE estimation with respect to the shifted target distribution. Empirical results across diverse real-world datasets, under various conditions and label-shift intensities, demonstrate the effectiveness and reliability of the proposed estimator.


title: Bayesian Tensor Modeling for Image-based Classification of Alzheimer's Disease

abstract: Tensor-based representations are being increasingly used to represent complex data types such as imaging data, due to their appealing properties such as dimension reduction and the preservation of spatial information. Recently, there is a growing literature on using Bayesian scalar-on-tensor regression techniques that use tensor-based representations for high-dimensional and spatially distributed covariates to predict continuous outcomes. However surprisingly, there is limited development on corresponding Bayesian classification methods relying on tensor-valued covariates. Standard approaches that vectorize the image are not desirable due to the loss of spatial structure, and alternate methods that use extracted features from the image in the predictive model may suffer from information loss. We propose a novel data augmentation-based Bayesian classification approach relying on tensor-valued covariates, with a focus on imaging predictors. We propose two data augmentation schemes, one resulting in a support vector machine (SVM) classifier, and another yielding a logistic regression classifier. While both types of classifiers have been proposed independently in literature, our contribution is to extend such existing methodology to accommodate high-dimensional tensor valued predictors that involve low rank decompositions of the coefficient matrix while preserving the spatial information in the image. An efficient Markov chain Monte Carlo (MCMC) algorithm is developed for implementing these methods. Simulation studies show significant improvements in classification accuracy and parameter estimation compared to routinely used classification methods. We further illustrate our method in a neuroimaging application using cortical thickness MRI data from Alzheimer's Disease Neuroimaging Initiative, with results displaying better classification accuracy throughout several classification tasks.


title: Black Hole Spectroscopy for Precessing Binary Black Hole Coalescences

abstract: To accurately perform black hole spectroscopy, it is essential to know which quasinormal modes dominate astrophysical ringdown signals. In this Letter, we present a phenomenological description of the quasinormal modes that are excited in the ringdowns of comparable mass, quasi-circular precessing binary black hole coalescences. By analyzing an exhaustive catalog of numerical relativity simulations, we confirm that the relative fundamental quasinormal mode amplitudes of precessing systems are related to those of non-precessing systems by a simple rotation, and that additional structure in the spectrum is connected to the system's kick velocity and other asymmetries in the orbital dynamics. We find that the ringdowns of precessing systems need not be dominated by the ${(\ell,m)=(2,\pm 2)}$ quasinormal modes. These results build upon previous works on waveform modeling, and are consistent with a recent ringdown analysis of the LIGO-Virgo gravitational wave signal GW190521.


title: Consistent and Asymptotically Unbiased Estimation of Proper Calibration Errors

abstract: Proper scoring rules evaluate the quality of probabilistic predictions, playing an essential role in the pursuit of accurate and well-calibrated models. Every proper score decomposes into two fundamental components -- proper calibration error and refinement -- utilizing a Bregman divergence. While uncertainty calibration has gained significant attention, current literature lacks a general estimator for these quantities with known statistical properties. To address this gap, we propose a method that allows consistent, and asymptotically unbiased estimation of all proper calibration errors and refinement terms. In particular, we introduce Kullback--Leibler calibration error, induced by the commonly used cross-entropy loss. As part of our results, we prove the relation between refinement and f-divergences, which implies information monotonicity in neural networks, regardless of which proper scoring rule is optimized. Our experiments validate empirically the claimed properties of the proposed estimator and suggest that the selection of a post-hoc calibration method should be determined by the particular calibration error of interest.


title: Making the zeroth-order process fidelity independent of state preparation and measurement errors

abstract: A protocol called zero-fidelity was recently proposed as an approximation to the process fidelity. It can be understood as the zeroth-order process fidelity. It remedies problems of the process fidelity such as complex experimental settings and long running times. However, like the process fidelity, zero-fidelity is also not robust to state preparation and measurement (SPAM) errors. This limits both protocols' usefulness for real devices. Here, we investigate how SPAM errors affect the zero-fidelity for two operation channels: one channel containing controlled-NOT gates and the other containing controlled-Z gates. Then, we compare these two channels by checking the difference in the zero-fidelities between them. Finally, to make the zero-fidelity protocol independent of SPAM errors, we combine it with the randomized benchmarking (RB) protocol.


title: Joint2Human: High-quality 3D Human Generation via Compact Spherical Embedding of 3D Joints

abstract: 3D human generation is increasingly significant in various applications. However, the direct use of 2D generative methods in 3D generation often results in losing local details, while methods that reconstruct geometry from generated images struggle with global view consistency. In this work, we introduce Joint2Human, a novel method that leverages 2D diffusion models to generate detailed 3D human geometry directly, ensuring both global structure and local details. To achieve this, we employ the Fourier occupancy field (FOF) representation, enabling the direct generation of 3D shapes as preliminary results with 2D generative models. With the proposed high-frequency enhancer and the multi-view recarving strategy, our method can seamlessly integrate the details from different views into a uniform global shape. To better utilize the 3D human prior and enhance control over the generated geometry, we introduce a compact spherical embedding of 3D joints. This allows for an effective guidance of pose during the generation process. Additionally, our method can generate 3D humans guided by textual inputs. Our experimental results demonstrate the capability of our method to ensure global structure, local details, high resolution, and low computational cost simultaneously. More results and the code can be found on our project page at http://cic.tju.edu.cn/faculty/likun/projects/Joint2Human.


title: Dietary Assessment with Multimodal ChatGPT: A Systematic Analysis

abstract: Conventional approaches to dietary assessment are primarily grounded in self-reporting methods or structured interviews conducted under the supervision of dietitians. These methods, however, are often subjective, potentially inaccurate, and time-intensive. Although artificial intelligence (AI)-based solutions have been devised to automate the dietary assessment process, these prior AI methodologies encounter challenges in their ability to generalize across a diverse range of food types, dietary behaviors, and cultural contexts. This results in AI applications in the dietary field that possess a narrow specialization and limited accuracy. Recently, the emergence of multimodal foundation models such as GPT-4V powering the latest ChatGPT has exhibited transformative potential across a wide range of tasks (e.g., Scene understanding and image captioning) in numerous research domains. These models have demonstrated remarkable generalist intelligence and accuracy, capable of processing various data modalities. In this study, we explore the application of multimodal ChatGPT within the realm of dietary assessment. Our findings reveal that GPT-4V excels in food detection under challenging conditions with accuracy up to 87.5% without any fine-tuning or adaptation using food-specific datasets. By guiding the model with specific language prompts (e.g., African cuisine), it shifts from recognizing common staples like rice and bread to accurately identifying regional dishes like banku and ugali. Another GPT-4V's standout feature is its contextual awareness. GPT-4V can leverage surrounding objects as scale references to deduce the portion sizes of food items, further enhancing its accuracy in translating food weight into nutritional content. This alignment with the USDA National Nutrient Database underscores GPT-4V's potential to advance nutritional science and dietary assessment techniques.


title: MOSaiC: a Web-based Platform for Collaborative Medical Video Assessment and Annotation

abstract: This technical report presents MOSaiC 3.6.2, a web-based collaborative platform designed for the annotation and evaluation of medical videos. MOSaiC is engineered to facilitate video-based assessment and accelerate surgical data science projects. We provide an overview of MOSaiC's key functionalities, encompassing group and video management, annotation tools, ontologies, assessment capabilities, and user administration. Finally, we briefly describe several medical data science studies where MOSaiC has been instrumental in the dataset development.


title: CT-MVSNet: Efficient Multi-View Stereo with Cross-scale Transformer

abstract: Recent deep multi-view stereo (MVS) methods have widely incorporated transformers into cascade network for high-resolution depth estimation, achieving impressive results. However, existing transformer-based methods are constrained by their computational costs, preventing their extension to finer stages. In this paper, we propose a novel cross-scale transformer (CT) that processes feature representations at different stages without additional computation. Specifically, we introduce an adaptive matching-aware transformer (AMT) that employs different interactive attention combinations at multiple scales. This combined strategy enables our network to capture intra-image context information and enhance inter-image feature relationships. Besides, we present a dual-feature guided aggregation (DFGA) that embeds the coarse global semantic information into the finer cost volume construction to further strengthen global and local feature awareness. Meanwhile, we design a feature metric loss (FM Loss) that evaluates the feature bias before and after transformation to reduce the impact of feature mismatch on depth estimation. Extensive experiments on DTU dataset and Tanks and Temples (T\&T) benchmark demonstrate that our method achieves state-of-the-art results. Code is available at https://github.com/wscstrive/CT-MVSNet.


title: Limits to the Energy Efficiency of CMOS Microprocessors

abstract: CMOS microprocessors have achieved massive energy efficiency gains but may reach limits soon. This paper presents an approach to estimating the limits on the maximum floating point operations per Joule (FLOP/J) for CMOS microprocessors. We analyze the three primary sources of energy dissipation: transistor switching, interconnect capacitances and leakage power. Using first-principles calculations of minimum energy costs based on Landauer's principle, prior estimates of relevant parameters, and empirical data on hardware, we derive the energy cost per FLOP for each component. Combining these yields a geometric mean estimate of 4.7e15 FP4/J for the maximum CMOS energy efficiency, roughly two hundred-fold more efficient than current microprocessors.


title: Support theories for non-Noetherian tensor triangulated categories

abstract: We extend the support theory of Benson--Iyengar--Krause to the non-Noetherian setting by introducing a new notion of small support for modules. This enables us to prove that the stable module category of a finite group is canonically stratified by the action of the Tate cohomology ring, despite the fact that this ring is rarely Noetherian. In the tensor triangular context, we compare the support theory proposed by W. Sanders (which extends the Balmer--Favi support theory beyond the weakly Noetherian setting) with our generalized BIK support theory. When the Balmer spectrum is homeomorphic to the Zariski spectrum of the endomorphism ring of the unit, the two support theories coincide as do their associated theories of stratification. We also prove a negative result which states that the Balmer--Favi--Sanders support theory can only stratify categories whose spectra are weakly Noetherian. This provides additional justification for the weakly Noetherian hypothesis in the work of Barthel, Heard and B. Sanders. On the other hand, the detection property and the local-to-global principle remain interesting in the general setting.


title: ${\rm w}_{1+\infty}$ in 4D Gravitational Scattering

abstract: In four-dimensional asymptotically flat spacetimes, an infinite tower of soft graviton modes is known to generate the symmetry algebra of ${\rm w}_{1+\infty}$ at tree-level. Here we demonstrate that the symmetry action follows from soft graviton theorems and acts non-trivially on massive scalar particles. By generalizing previous analyses that were specifically tailored to the scattering of massless particles, our results clarify that ${\rm w}_{1+\infty}$ symmetry is a universal feature of tree-level gravitational scattering in four-dimensional asymptotically flat spacetimes and originates from minimally-coupled gravitational interactions. In addition, we show that the ${\rm w}_{1+\infty}$ symmetry acts non-diagonally on massive states by mixing an infinite number of conformal families. We also present a concrete example of non-local behavior on the celestial sphere in the presence of massive scattering states.


title: MotherNet: A Foundational Hypernetwork for Tabular Classification

abstract: The advent of Foundation Models is transforming machine learning across many modalities (e.g., language, images, videos) with prompt engineering replacing training in many settings. Recent work on tabular data (e.g., TabPFN) hints at a similar opportunity to build Foundation Models for classification for numerical data. In this paper, we go one step further and propose a hypernetwork architecture that we call MotherNet, trained on millions of classification tasks, that, once prompted with a never-seen-before training set generates the weights of a trained ``child'' neural-network. Like other Foundation Models, MotherNet replaces training on specific datasets with in-context learning through a single forward pass. In contrast to existing hypernetworks that were either task-specific or trained for relatively constraint multi-task settings, MotherNet is trained to generate networks to perform multiclass classification on arbitrary tabular datasets without any dataset specific gradient descent. The child network generated by MotherNet using in-context learning outperforms neural networks trained using gradient descent on small datasets, and is competitive with predictions by TabPFN and standard ML methods like Gradient Boosting. Unlike a direct application of transformer models like TabPFN, MotherNet generated networks are highly efficient at inference time. This methodology opens up a new approach to building predictive models on tabular data that is both efficient and robust, without any dataset-specific training.


title: Multi-IRS Aided Mobile Edge Computing for High Reliability and Low Latency Services

abstract: Although multi-access edge computing (MEC) has allowed for computation offloading at the network edge, weak wireless signals in the radio access network caused by obstacles and high network load are still preventing efficient edge computation offloading, especially for user requests with stringent latency and reliability requirements. Intelligent reflective surfaces (IRS) have recently emerged as a technology capable of enhancing the quality of the signals in the radio access network, where passive reflecting elements can be tuned to improve the uplink or downlink signals. Harnessing the IRS's potential in enhancing the performance of edge computation offloading, in this paper, we study the optimized use of a system of multi-IRS along with the design of the offloading (to an edge with multi MECs) and resource allocation parameters for the purpose of minimizing the devices' energy consumption considering 5G services with stringent latency and reliability requirements. After presenting our non-convex mathematical problem, we propose a suboptimal solution based on alternating optimization where we divide the problem into sub-problems which are then solved separately. Specifically, the offloading decision is solved through a matching game algorithm, and then the IRS phase shifts and resource allocation optimizations are solved in an alternating fashion using the Difference of Convex approach. The obtained results demonstrate the gains both in energy and network resources and highlight the IRS's influence on the design of the MEC parameters.


title: CartoMark: a benchmark dataset for map pattern recognition and 1 map content retrieval with machine intelligence

abstract: Maps are fundamental medium to visualize and represent the real word in a simple and 16 philosophical way. The emergence of the 3rd wave information has made a proportion of maps are available to be generated ubiquitously, which would significantly enrich the dimensions and perspectives to understand the characteristics of the real world. However, a majority of map dataset have never been discovered, acquired and effectively used, and the map data used in many applications might not be completely fitted for the authentic demands of these applications. This challenge is emerged due to the lack of numerous well-labelled benchmark datasets for implementing the deep learning approaches into identifying complicated map content. Thus, we develop a large-scale benchmark dataset that includes well-labelled dataset for map text annotation recognition, map scene classification, map super-resolution reconstruction, and map style transferring. Furthermore, these well-labelled datasets would facilitate the state-of-the-art machine intelligence technologies to conduct map feature detection, map pattern recognition and map content retrieval. We hope our efforts would be useful for AI-enhanced cartographical applications.


title: Confinement and Kink Entanglement Asymmetry on a Quantum Ising Chain

abstract: In this work, we explore the interplay of confinement, string breaking and entanglement asymmetry on a 1D quantum Ising chain. We consider the evolution of an initial domain wall and show that, surprisingly, while the introduction of confinement through a longitudinal field typically suppresses entanglement, it can also serve to increase it beyond a bound set for free particles. Our model can be tuned to conserve the number of domain walls, which gives an opportunity to explore entanglement asymmetry associated with link variables. We study two approaches to deal with the non-locality of the link variables, either directly or following a Kramers-Wannier transformation that maps bond variables (kinks) to site variables (spins). We develop a numerical procedure for computing the asymmetry using tensor network methods and use it to demonstrate the different types of entanglement and entanglement asymmetry.

categories: quant-ph cond-mat.stat-mech cond-mat.str-el hep-ph


title: Omega-Regular Decision Processes

abstract: Regular decision processes (RDPs) are a subclass of non-Markovian decision processes where the transition and reward functions are guarded by some regular property of the past (a lookback). While RDPs enable intuitive and succinct representation of non-Markovian decision processes, their expressive power coincides with finite-state Markov decision processes (MDPs). We introduce omega-regular decision processes (ODPs) where the non-Markovian aspect of the transition and reward functions are extended to an omega-regular lookahead over the system evolution. Semantically, these lookaheads can be considered as promises made by the decision maker or the learning agent about her future behavior. In particular, we assume that, if the promised lookaheads are not met, then the payoff to the decision maker is $\bot$ (least desirable payoff), overriding any rewards collected by the decision maker. We enable optimization and learning for ODPs under the discounted-reward objective by reducing them to lexicographic optimization and learning over finite MDPs. We present experimental results demonstrating the effectiveness of the proposed reduction.


title: NeXt-TDNN: Modernizing Multi-Scale Temporal Convolution Backbone for Speaker Verification

abstract: In speaker verification, ECAPA-TDNN has shown remarkable improvement by utilizing one-dimensional(1D) Res2Net block and squeeze-and-excitation(SE) module, along with multi-layer feature aggregation (MFA). Meanwhile, in vision tasks, ConvNet structures have been modernized by referring to Transformer, resulting in improved performance. In this paper, we present an improved block design for TDNN in speaker verification. Inspired by recent ConvNet structures, we replace the SE-Res2Net block in ECAPA-TDNN with a novel 1D two-step multi-scale ConvNeXt block, which we call TS-ConvNeXt. The TS-ConvNeXt block is constructed using two separated sub-modules: a temporal multi-scale convolution (MSC) and a frame-wise feed-forward network (FFN). This two-step design allows for flexible capturing of inter-frame and intra-frame contexts. Additionally, we introduce global response normalization (GRN) for the FFN modules to enable more selective feature propagation, similar to the SE module in ECAPA-TDNN. Experimental results demonstrate that NeXt-TDNN, with a modernized backbone block, significantly improved performance in speaker verification tasks while reducing parameter size and inference time. We have released our code for future studies.


title: Verification of Neural Reachable Tubes via Scenario Optimization and Conformal Prediction

abstract: Learning-based approaches for controlling safety-critical systems are rapidly growing in popularity; thus, it is important to assure their performance and safety. Hamilton-Jacobi (HJ) reachability analysis is a popular formal verification tool for providing such guarantees, since it can handle general nonlinear system dynamics, bounded adversarial system disturbances, and state and input constraints. However, its computational and memory complexity scales exponentially with the state dimension, making it intractable for large-scale systems. To overcome this challenge, neural approaches, such as DeepReach, have been used to synthesize reachable tubes and safety controllers for high-dimensional systems. However, verifying these neural reachable tubes remains challenging. In this work, we propose two verification methods, based on robust scenario optimization and conformal prediction, to provide probabilistic safety guarantees for neural reachable tubes. Our methods allow a direct trade-off between resilience to outlier errors in the neural tube, which are inevitable in a learning-based approach, and the strength of the probabilistic safety guarantee. Furthermore, we show that split conformal prediction, a widely used method in the machine learning community for uncertainty quantification, reduces to a scenario-based approach, making the two methods equivalent not only for verification of neural reachable tubes but also more generally. To our knowledge, our proof is the first in the literature to show a strong relationship between conformal prediction and scenario optimization. Finally, we propose an outlier-adjusted verification approach that uses the error distribution in neural reachable tubes to recover greater safe volumes. We demonstrate the efficacy of the proposed approaches for the high-dimensional problems of multi-vehicle collision avoidance and rocket landing with no-go zones.


title: Markov-bridge generation of transition paths and its application to cell-fate choice

abstract: We present a method to sample Markov-chain trajectories constrained to both the initial and final conditions, which we term Markov bridges. The trajectories are conditioned to end in a specific state at a given time. We derive the master equation for Markov bridges, which exhibits the original transition rates scaled by a time-dependent factor. Trajectories can then be generated using a refined version of the Gillespie algorithm. We illustrate the benefits of our method by sampling trajectories in the M\"uller-Brown potential. This allows us to generate transition paths which would otherwise be obtained at a high computational cost with standard Kinetic Monte Carlo methods because commitment to a transition path is essentially a rare event. We then apply our method to a single-cell RNA sequencing dataset from mouse pancreatic cells to investigate the cell differentiation pathways of endocrine-cell precursors. By sampling Markov bridges for a specific differentiation pathway we obtain a time-resolved dynamics that can reveal features such as cell types which behave as bottlenecks. The ensemble of trajectories also gives information about the fluctuations around the most likely path. For example, we quantify the statistical weights of different branches in the differentiation pathway to alpha cells.


title: VQCNIR: Clearer Night Image Restoration with Vector-Quantized Codebook

abstract: Night photography often struggles with challenges like low light and blurring, stemming from dark environments and prolonged exposures. Current methods either disregard priors and directly fitting end-to-end networks, leading to inconsistent illumination, or rely on unreliable handcrafted priors to constrain the network, thereby bringing the greater error to the final result. We believe in the strength of data-driven high-quality priors and strive to offer a reliable and consistent prior, circumventing the restrictions of manual priors. In this paper, we propose Clearer Night Image Restoration with Vector-Quantized Codebook (VQCNIR) to achieve remarkable and consistent restoration outcomes on real-world and synthetic benchmarks. To ensure the faithful restoration of details and illumination, we propose the incorporation of two essential modules: the Adaptive Illumination Enhancement Module (AIEM) and the Deformable Bi-directional Cross-Attention (DBCA) module. The AIEM leverages the inter-channel correlation of features to dynamically maintain illumination consistency between degraded features and high-quality codebook features. Meanwhile, the DBCA module effectively integrates texture and structural information through bi-directional cross-attention and deformable convolution, resulting in enhanced fine-grained detail and structural fidelity across parallel decoders. Extensive experiments validate the remarkable benefits of VQCNIR in enhancing image quality under low-light conditions, showcasing its state-of-the-art performance on both synthetic and real-world datasets. The code is available at https://github.com/AlexZou14/VQCNIR.


title: Parabolic Anderson model with rough initial condition: continuity in law of the solution

abstract: The parabolic Anderson model (PAM) is one of the most interesting and challenging SPDEs related to various physical phenomena, and can be described mathematically as a stochastic heat equation driven by linear multiplicative noise. In this paper, we consider PAM with initial condition given by a signed Borel measure on $R^d$. The forcing term under investigation is examined in two cases: (i) the regular noise, with the spatial covariance given by the Riesz kernel of order $\alpha \in (0, d)$ in spatial dimension $d \ge 1$; (ii) the rough noise, which is a fractional noise in space with Hurst index $H < 1/2$ and $d = 1$. In both cases, the noise is assumed to be colored in time and we consider a general initial condition. The objective of this article is to show that the solution is continuous in law with respect to the spatial noise parameter. The similar problem for the constant initial condition has been recently studied in Balan and Liang (2023).


title: Electroweak Symmetry Breaking in Two Higgs Doublet Model from 6D Gauge-Higgs Unification on $T^2/Z_2$

abstract: Electroweak symmetry breaking is explored in a two Higgs doublet model based on a six dimensional $SU(4)$ gauge-Higgs unification compactified on an orbifold $T^2/Z_2$. The remarkable property of this model is a prediction of realistic weak mixing angle $\sin^2 \theta_W = 1/4$ at the compactification scale. We calculate one-loop effective potential of the Standard Model Higgs boson from the contributions of the gauge boson and the fermion in a four-rank totally symmetric tensor where top quark is included. We find that the electroweak symmetry breaking certainly takes place.


title: Non-equilibrium physics of multi-species assembly: From inhibition of fibrils in biomolecular condensates to growth of online distrust

abstract: Self-assembly is a key process in living systems - from the microscopic biological level (e.g. assembly of proteins into fibrils within biomolecular condensates in a human cell) through to the macroscopic societal level (e.g. assembly of humans into common-interest communities across online social media platforms). The components in such systems (e.g. macromolecules, humans) are highly diverse, and so are the self-assembled structures that they form. However, there is no simple theory of how such structures assemble from a multi-species pool of components. Here we provide a very simple model which trades myriad chemical and human details for a transparent analysis, and yields results in good agreement with recent empirical data. It reveals a new inhibitory role for biomolecular condensates in the formation of dangerous amyloid fibrils, as well as a kinetic explanation of why so many diverse distrust movements are now emerging across social media. The nonlinear dependencies that we uncover suggest new real-world control strategies for such multi-species assembly.


title: A computationally efficient semi-blind source separation based approach for nonlinear echo cancellation based on an element-wise iterative source steering

abstract: While the semi-blind source separation-based acoustic echo cancellation (SBSS-AEC) has received much research attention due to its promising performance during double-talk compared to the traditional adaptive algorithms, it suffers from system latency and nonlinear distortions. To circumvent these drawbacks, the recently developed ideas on convolutive transfer function (CTF) approximation and nonlinear expansion have been used in the iterative projection (IP)-based semi-blind source separation (SBSS) algorithm. However, because of the introduction of CTF approximation and nonlinear expansion, this algorithm becomes computationally very expensive, which makes it difficult to implement in embedded systems. Thus, we attempt in this paper to improve this IP-based algorithm, thereby developing an element-wise iterative source steering (EISS) algorithm. In comparison with the IP-based SBSS algorithm, the proposed algorithm is computationally much more efficient, especially when the nonlinear expansion order is high and the length of the CTF filter is long. Meanwhile, its AEC performance is as good as that of IP-based SBSS.


title: UniTeam: Open Vocabulary Mobile Manipulation Challenge

abstract: This report introduces our UniTeam agent - an improved baseline for the "HomeRobot: Open Vocabulary Mobile Manipulation" challenge. The challenge poses problems of navigation in unfamiliar environments, manipulation of novel objects, and recognition of open-vocabulary object classes. This challenge aims to facilitate cross-cutting research in embodied AI using recent advances in machine learning, computer vision, natural language, and robotics. In this work, we conducted an exhaustive evaluation of the provided baseline agent; identified deficiencies in perception, navigation, and manipulation skills; and improved the baseline agent's performance. Notably, enhancements were made in perception - minimizing misclassifications; navigation - preventing infinite loop commitments; picking - addressing failures due to changing object visibility; and placing - ensuring accurate positioning for successful object placement.


title: On a Kostant section for the unitary group

abstract: For the unitary group defined over the ring of integers in a non Archimedean local field, we give a correction for a Kostant section provided in G.Laumon and B.C. Ng\^o's paper; Le lemme fondamental pour les groupes unitaires.


title: Directly observing atomic-scale relaxations of a glass forming liquid using femtosecond X-ray photon correlation spectroscopy

abstract: Glass forming liquids exhibit structural relaxation behaviors, reflecting underlying atomic rearrangements on a wide range of timescales. These behaviors play a crucial role in determining many material properties. However, the relaxation processes on the atomic scale are not well understood due to the experimental difficulties in directly characterizing the evolving correlations of atomic order in disordered systems. Here, taking the model system Ge15Te85, we demonstrate an experimental approach that probes the relaxation dynamics by scattering the coherent X-ray pulses with femtosecond duration produced by X-ray free electron lasers (XFELs). By collecting the summed speckle patterns from two rapidly successive, nearly identical X-ray pulses generated using a split-delay system, we can extract the contrast decay of speckle patterns originating from sample dynamics and observe the full decorrelation of local order on the sub-picosecond timescale. This provides the direct atomic-level evidence of fragile liquid behavior of Ge15Te85. Our results demonstrate the strategy for XFEL-based X-ray photon correlation spectroscopy (XPCS), attaining femtosecond temporal and atomic-scale spatial resolutions. This twelve orders of magnitude extension from the millisecond regime of synchrotron-based XPCS opens a new avenue of experimental studies of relaxation dynamics in liquids, glasses, and other highly disordered systems.