title: Instance-Level Safety-Aware Fidelity of Synthetic Data and Its Calibration

abstract: Modeling and calibrating the fidelity of synthetic data is paramount in shaping the future of safe and reliable self-driving technology by offering a cost-effective and scalable alternative to real-world data collection. We focus on its role in safety-critical applications, introducing four types of instance-level fidelity that go beyond mere visual input characteristics. The aim is to ensure that applying testing on synthetic data can reveal real-world safety issues, and the absence of safety-critical issues when testing under synthetic data can provide a strong safety guarantee in real-world behavior. We suggest an optimization method to refine the synthetic data generator, reducing fidelity gaps identified by deep learning components. Experiments show this tuning enhances the correlation between safety-critical errors in synthetic and real data.


title: Field demonstration of predictive heating control for an all-electric house in a cold climate

abstract: Efficient electric heat pumps that replace fossil-fueled heating systems could significantly reduce greenhouse gas emissions. However, electric heat pumps can sharply increase electricity demand, causing high utility bills and stressing the power grid. Residential neighborhoods could see particularly high electricity demand during cold weather, when heat demand rises and heat pump efficiencies fall. This paper presents the development and field demonstration of a predictive control system for an air-to-air heat pump with backup electric resistance heat. The control system adjusts indoor temperature set-points based on weather forecasts, occupancy conditions, and data-driven models of the building and heating equipment. Field tests from January to March of 2023 in an occupied, all-electric, 208 m^2 detached single-family house in Indiana, USA, included outdoor temperatures as low as -15 C. On average over these tests, the control system reduced daily heating energy use by 19% (95% confidence interval: 13--24%), energy used for backup heat by 38%, and the frequency of using the highest stage (19 kW) of backup heat by 83%. Concurrent surveys of residents showed that the control system maintained satisfactory thermal comfort. The control system could reduce the house's total annual heating costs by about $300 (95% confidence interval: 23--34%). These real-world results could strengthen the case for deploying predictive home heating control, bringing the technology one step closer to reducing emissions, utility bills, and power grid impacts at scale.


title: Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models

abstract: Large Language Models (LLMs) based on Mixture-of-Experts (MoE) architecture are showing promising performance on various tasks. However, running them on resource-constrained settings, where GPU memory resources are not abundant, is challenging due to huge model sizes. Existing systems that offload model weights to CPU memory suffer from the significant overhead of frequently moving data between CPU and GPU. In this paper, we propose Fiddler, a resource-efficient inference engine with CPU-GPU orchestration for MoE models. The key idea of Fiddler is to use the computation ability of the CPU to minimize the data movement between the CPU and GPU. Our evaluation shows that Fiddler can run the uncompressed Mixtral-8x7B model, which exceeds 90GB in parameters, to generate over $3$ tokens per second on a single GPU with 24GB memory, showing an order of magnitude improvement over existing methods. The code of Fiddler is publicly available at \url{https://github.com/efeslab/fiddler}


title: A Robotic Cyber-Physical System for Automated Reality Capture and Visualization in Construction Progress Monitoring

abstract: Effective progress monitoring is crucial for the successful delivery of the construction project within the stipulated time and budget. Construction projects are often monitored irregularly through time-consuming physical site visits by multiple project stakeholders. Remote monitoring using robotic cyber-physical systems (CPS) can make the process more efficient and safer. This article presents a conceptual framework for robotic CPS for automated reality capture and visualization for remote progress monitoring in construction. The CPS integrates quadruped robot, Building Information Modelling (BIM), and 360{\deg} reality capturing to autonomously capture, and visualize up-to-date site information. Additionally, the study explores the factors affecting acceptance of the proposed robotic CPS through semi-structured interviews with seventeen progress monitoring experts. The findings will guide construction management teams in adopting CPS in construction and drive further research in the human-centered development of CPS for construction.


title: Distilling Symbolic Priors for Concept Learning into Neural Networks

abstract: Humans can learn new concepts from a small number of examples by drawing on their inductive biases. These inductive biases have previously been captured by using Bayesian models defined over symbolic hypothesis spaces. Is it possible to create a neural network that displays the same inductive biases? We show that inductive biases that enable rapid concept learning can be instantiated in artificial neural networks by distilling a prior distribution from a symbolic Bayesian model via meta-learning, an approach for extracting the common structure from a set of tasks. By generating the set of tasks used in meta-learning from the prior distribution of a Bayesian model, we are able to transfer that prior into a neural network. We use this approach to create a neural network with an inductive bias towards concepts expressed as short logical formulas. Analyzing results from previous behavioral experiments in which people learned logical concepts from a few examples, we find that our meta-trained models are highly aligned with human performance.


title: Sachs equations and plane waves, I: Rosen universes

abstract: This article, the first in a series, analyzes the general theory of plane wave spacetimes. Following Dmitri Aleekseevsky, these are defined as spacetimes admitting a group of dilations leaving invariant a smooth curve. If this curve is specified as part of the structure, the spacetime is termed a Penrose limit, whose theory was developed first by Roger Penrose. The main result is that every plane wave is a Rosen universe, a generalization of the smooth metrics of Albert Einstein and Nathan Rosen, allowing for certain isolated co-ordinate singularities; the latter are characterized. We conclude with an extended example, using the techniques developed in the article to associate a vacuum plane wave in four dimensions to any hyperbolic billiard trajectory.


title: Unified Inverse Dynamics of Modular Serial Mechanical Systems with Application to Soft Robotics

abstract: The robotic field has been witnessing a progressive departure from classic robotic systems composed of serial/stiff links interconnected by simple rigid joints. Novel robotic concepts, e.g., soft robots, often maintain a series-like structure, but their mechanical modules exhibit complex and unconventional articulation patterns. Research in efficient recursive formulations of the dynamic models for subclasses of these systems has been extremely active in the past decade. Yet, as of today, no single recursive inverse dynamics algorithm can describe the behavior of all these systems. This paper addresses this challenge by proposing a new iterative formulation based on Kane equations. Its computational complexity is optimal, i.e., linear with the number of modules. While the proposed formulation is not claimed to be necessarily more efficient than state-of-the-art techniques for specific subclasses of robots, we illustrate its usefulness in the modeling of different complex systems. We propose two new models of soft robots: (i) a class of pneumatically actuated soft arms that deform along their cross-sectional area, and (ii) a piecewise strain model with Gaussian functions.


title: Nonlinear Modes as a Tool for Comparing the Mathematical Structure of Dynamic Models of Soft Robots

abstract: Continuum soft robots are nonlinear mechanical systems with theoretically infinite degrees of freedom (DoFs) that exhibit complex behaviors. Achieving motor intelligence under dynamic conditions necessitates the development of control-oriented reduced-order models (ROMs), which employ as few DoFs as possible while still accurately capturing the core characteristics of the theoretically infinite-dimensional dynamics. However, there is no quantitative way to measure if the ROM of a soft robot has succeeded in this task. In other fields, like structural dynamics or flexible link robotics, linear normal modes are routinely used to this end. Yet, this theory is not applicable to soft robots due to their nonlinearities. In this work, we propose to use the recent nonlinear extension in modal theory -- called eigenmanifolds -- as a means to evaluate control-oriented models for soft robots and compare them. To achieve this, we propose three similarity metrics relying on the projection of the nonlinear modes of the system into a task space of interest. We use this approach to compare quantitatively, for the first time, ROMs of increasing order generated under the piecewise constant curvature (PCC) hypothesis with a high-dimensional finite element (FE)-like model of a soft arm. Results show that by increasing the order of the discretization, the eigenmanifolds of the PCC model converge to those of the FE model.


title: Coordinated Disclosure for AI: Beyond Security Vulnerabilities

abstract: Harm reporting in the field of Artificial Intelligence (AI) currently operates on an ad hoc basis, lacking a structured process for disclosing or addressing algorithmic flaws. In contrast, the Coordinated Vulnerability Disclosure (CVD) ethos and ecosystem play a pivotal role in software security and transparency. Globally, there are ongoing efforts to establish frameworks that promote transparency and collaboration in addressing AI-related issues, though challenges persist. Algorithmic flaws in machine learning (ML) models present distinct challenges compared to traditional software vulnerabilities, warranting a specialized approach. To address this gap, we propose the implementation of a dedicated Coordinated Flaw Disclosure (CFD) framework tailored to the intricacies of machine learning and artificial intelligence issues. This paper delves into the historical landscape of disclosures in ML, encompassing the ad hoc reporting of harms and the emergence of participatory auditing. By juxtaposing these practices with the well-established disclosure norms in cybersecurity, we argue that the broader adoption of CFD has the potential to enhance public trust through transparent processes that carefully balance the interests of both organizations and the community.


title: Optimal convergence rates of an adaptive hybrid FEM-BEM method for full-space linear transmission problems

abstract: We consider a hybrid FEM-BEM method to compute approximations of full-space linear elliptic transmission problems. First, we derive a priori and a posteriori error estimates. Then, building on the latter, we present an adaptive algorithm and prove that it converges at optimal rates with respect to the number of mesh elements. Finally, we provide numerical experiments, demonstrating the practical performance of the adaptive algorithm.


title: Risk assessment and observation of driver with pedestrian using instantaneous heart rate and HRV

abstract: Currently, human drivers outperform self-driving vehicles in many conditions such as collision avoidance. Therefore, understanding human driver behaviour in these conditions will provide insight for future autonomous vehicles. For understanding driver behaviour, risk assessment is applied so far as one of the approaches by using both subjective and objective measurement. Subjective measurement methods such as questionnaires may provide insight into driver risk assessment but there is often significant variability between drivers.Physiological measurements such as heart rate (HR), electroencephalogram (EEG), and electromyogram (EMG) provide more objective measurements of driver risk assessment. HR is often used for measuring driver risk assessment based on observed correlations between HR and risk perception. Previous work has used HR to measure driver risk assessment in self-driving systems, but pedestrian dynamics is not considered for the research. In this study, we observed driver behaviour in certain scenarios which have pedestrian on driving simulator. The scenarios have safe/unsafe situations (i.e., pedestrian crosses road and vehicle may hit pedestrian in one scenario), HR analysis in time/frequency domain is processed for risk assessment. As a result, HR analysis in frequency domain shows certain reasonability for driver risk assessment when driver has pedestrian in its traffic.


title: Projection-algebras and quantum logic

abstract: P-algebras are a non-commutative, non-associative generalization of Boolean algebras that are for Quantum Logic what Boolean algebras are for Classical Logic.The closed subspaces of a separable Hilbert space form a P-algebra under orthogonal complementation and projection of a subspace onto another one. P-algebras are complemented orthomodular posets that are not lattices. Atomic algebras are defined and their main properties are studied. A substructural logic of sequents is proved to be sound and complete for the logic of P-algebras.


title: A Tale of Tails: Model Collapse as a Change of Scaling Laws

abstract: As AI model size grows, neural scaling laws have become a crucial tool to predict the improvements of large models when increasing capacity and the size of original (human or natural) training data. Yet, the widespread use of popular models means that the ecosystem of online data and text will co-evolve to progressively contain increased amounts of synthesized data. In this paper we ask: How will the scaling laws change in the inevitable regime where synthetic data makes its way into the training corpus? Will future models, still improve, or be doomed to degenerate up to total (model) collapse? We develop a theoretical framework of model collapse through the lens of scaling laws. We discover a wide range of decay phenomena, analyzing loss of scaling, shifted scaling with number of generations, the ''un-learning" of skills, and grokking when mixing human and synthesized data. Our theory is validated by large-scale experiments with a transformer on an arithmetic task and text generation using the large language model Llama2.


title: Effects of Strong Capacitive Coupling Between Meta-Atoms in rf SQUID Metamaterials

abstract: We consider, for the first time, the effects of strong capacitive and inductive coupling between radio frequency Superconducting Quantum Interference Devices (rf SQUIDs) in an overlapping metamaterial geometry when driven by rf flux at and near their self-resonant frequencies. The equations of motion for the gauge-invariant phases on the Josephson junctions in each SQUID are set up and solved. Our model accounts for the high-frequency displacement currents through capacitive overlap between the wiring of SQUID loops. We begin by modeling two overlapping SQUIDs and studying the response in both the linear and nonlinear high-frequency driving limits. By exploring a sequence of more and more complicated arrays, the formalism is eventually extended to the $N\times N \times 2$ overlapping metamaterial array, where we develop an understanding of the many ($8N^2-8N+3$) resulting resonant modes in terms of three classes of resonances. The capacitive coupling gives rise to qualitatively new self-resonant responses of rf SQUID metamaterials, and is demonstrated through analytical theory, numerical modeling, and experiment in the 10-30 GHz range on capacitively and inductively coupled rf SQUID metamaterials.


title: Unraveling the Origins and Development of the Galactic Disk through Metal-Poor Stars

abstract: The Milky Way is a spiral galaxy comprising three main components: the Bulge, the Disk, and the Halo. Of particular interest is the Galactic disk, which holds a significant portion of the baryonic matter angular momentum and harbors at least two primary stellar populations: the thin and thick disks. Understanding the formation and evolution of the Galactic disk is crucial for comprehending the origins and development of our Galaxy. Stellar archaeology offers a means to probe the disk's evolution by listening to the cosmological narratives of its oldest and most pristine stars, specifically the metal-poor stars. In this study, we employed accurate photometric metallicity estimates and Gaia Early Data Release 3 astrometry to curate a pure sample of the oldest Galactic stars. This proceeding presents a summary of our primary findings.


title: A Strontium-rich Ultra Metal-poor Star in the Atari Disk Component

abstract: We report on the discovery of the first ultra metal-poor (UMP) star 2MASS~J20500194$-$6613298 (J2050$-$6613; \mbox{[Fe/H] = $-4.05$}) selected from the Gaia BP/RP spectral catalog that belongs to the ancient Atari disk component. We obtained a high-resolution spectrum for the star with the MIKE spectrograph on the Magellan-Clay telescope. J2050$-$6613 displays a typical chemical abundance pattern for UMP stars, including carbon and zinc enhancements. In contrast, J2050$-$6613 shows extremely high [Sr/Fe] and [Sr/Ba] ratios compared to other stars in the [Fe/H] $<-4.0$ regime. J2050$-$6613 is most likely an early Population\,II star that formed from a gas cloud that was chemically enriched by a massive Population\,III hypernova (E $> 10^{52}$\,erg). Such a Population\,III core-collapse hypernova could simultaneously explain the origin of the abundance pattern of light and heavy elements of 2MASS~J2050$-$6613 if a large amount of Sr of $\sim10^{-5}$\,M$_{\odot}$ was produced, possibly by neutrino-driven \textbf{(wind)} ejecta. Therefore, the abundance pattern of 2MASS~J2050$-$6613 places important constraints on Sr-producing nucleosynthesis sources operating in the Atari progenitor at the earliest times.


title: cortecs: A Python package for compressing opacities

abstract: The absorption and emission of light by exoplanet atmospheres encode details of atmospheric composition, temperature, and dynamics. Fundamentally, simulating these processes requires detailed knowledge of the opacity of gases within an atmosphere. When modeling broad wavelength ranges at high resolution, such opacity data for even a single gas can take up multiple gigabytes of system random-access memory (RAM). This aspect can be a limiting factor when considering the number of gases to consider in a simulation, the sampling strategy used for inference, or even the architecture of the system used for calculations. Here, we present cortecs, a Python tool for compressing opacity data. cortecs provides flexible methods for fitting the temperature, pressure, and wavelength dependencies of opacity data and for evaluating the opacity with accelerated, GPU-friendly methods. The package is actively developed on GitHub (https://github.com/arjunsavel/cortecs), and it is available for download with pip.


title: Logistic-beta processes for dependent random probabilities with beta marginals

abstract: The beta distribution serves as a canonical tool for modelling probabilities in statistics and machine learning. However, there is limited work on flexible and computationally convenient stochastic process extensions for modelling dependent random probabilities. We propose a novel stochastic process called the logistic-beta process, whose logistic transformation yields a stochastic process with common beta marginals. Logistic-beta processes can model dependence on both discrete and continuous domains, such as space or time, and have a flexible dependence structure through correlation kernels. Moreover, its normal variance-mean mixture representation leads to effective posterior inference algorithms. We illustrate the benefits through nonparametric binary regression and conditional density estimation examples, both in simulation studies and in a pregnancy outcome application.


title: A Factor Graph Model of Trust for a Collaborative Multi-Agent System

abstract: In the field of Multi-Agent Systems (MAS), known for their openness, dynamism, and cooperative nature, the ability to trust the resources and services of other agents is crucial. Trust, in this setting, is the reliance and confidence an agent has in the information, behaviors, intentions, truthfulness, and capabilities of others within the system. Our paper introduces a new graphical approach that utilizes factor graphs to represent the interdependent behaviors and trustworthiness among agents. This includes modeling the behavior of robots as a trajectory of actions using a Gaussian process factor graph, which accounts for smoothness, obstacle avoidance, and trust-related factors. Our method for evaluating trust is decentralized and considers key interdependent sub-factors such as proximity safety, consistency, and cooperation. The overall system comprises a network of factor graphs that interact through trust-related factors and employs a Bayesian inference method to dynamically assess trust-based decisions with informed consent. The effectiveness of this method is validated via simulations and empirical tests with autonomous robots navigating unsignalized intersections.


title: On holomorphic tubular neighborhoods of compact Riemann surfaces

abstract: We give a sufficient condition for the existence of a holomorphic tubular neighborhood of a compact Riemann surface holomorphically embedded in a non-singular complex surface. Our sufficient condition is described by an arithmetical condition of unitary flat line bundles which can be regarded as an analogue of the Brjuno condition for irrational numbers which appears in the theory of 1-variable complex dynamics.


title: $L^*LM$: Learning Automata from Examples using Natural Language Oracles

abstract: Expert demonstrations have proven an easy way to indirectly specify complex tasks. Recent algorithms even support extracting unambiguous formal specifications, e.g. deterministic finite automata (DFA), from demonstrations. Unfortunately, these techniques are generally not sample efficient. In this work, we introduce $L^*LM$, an algorithm for learning DFAs from both demonstrations and natural language. Due to the expressivity of natural language, we observe a significant improvement in the data efficiency of learning DFAs from expert demonstrations. Technically, $L^*LM$ leverages large language models to answer membership queries about the underlying task. This is then combined with recent techniques for transforming learning from demonstrations into a sequence of labeled example learning problems. In our experiments, we observe the two modalities complement each other, yielding a powerful few-shot learner.


title: Understanding the Training Speedup from Sampling with Approximate Losses

abstract: It is well known that selecting samples with large losses/gradients can significantly reduce the number of training steps. However, the selection overhead is often too high to yield any meaningful gains in terms of overall training time. In this work, we focus on the greedy approach of selecting samples with large \textit{approximate losses} instead of exact losses in order to reduce the selection overhead. For smooth convex losses, we show that such a greedy strategy can converge to a constant factor of the minimum value of the average loss in fewer iterations than the standard approach of random selection. We also theoretically quantify the effect of the approximation level. We then develop SIFT which uses early exiting to obtain approximate losses with an intermediate layer's representations for sample selection. We evaluate SIFT on the task of training a 110M parameter 12-layer BERT base model and show significant gains (in terms of training hours and number of backpropagation steps) without any optimized implementation over vanilla training. For e.g., to reach 64% validation accuracy, SIFT with exit at the first layer takes ~43 hours compared to ~57 hours of vanilla training.


title: Certified homotopy tracking using the Krawczyk method

abstract: We revisit the problem of certifying the correctness of approximate solution paths computed by numerical homotopy continuation methods. We propose a conceptually simple approach based on a parametric variant of the Krawczyk method from interval arithmetic. Unlike most previous methods for certified path-tracking, our approach is applicable in the general setting of parameter homotopies commonly used to solve polynomial systems of equations. We also describe a novel preconditioning strategy and give theoretical correctness and termination results. Experiments using a preliminary implementation of the method indicate that our approach is competitive with specialized methods appearing previously in the literature, in spite of our more general setting.


title: HNMblock: Blockchain technology powered Healthcare Network Model for epidemiological monitoring, medical systems security, and wellness

abstract: In the ever-evolving healthcare sector, the widespread adoption of Internet of Things and wearable technologies facilitates remote patient monitoring. However, the existing client/server infrastructure poses significant security and privacy challenges, necessitating strict adherence to healthcare data regulations. To combat these issues, a decentralized approach is imperative, and blockchain technology emerges as a compelling solution for strengthening Internet of Things and medical systems security. This paper introduces HNMblock, a model that elevates the realms of epidemiological monitoring, medical system security, and wellness enhancement. By harnessing the transparency and immutability inherent in blockchain, HNMblock empowers real-time, tamper-proof tracking of epidemiological data, enabling swift responses to disease outbreaks. Furthermore, it fortifies the security of medical systems through advanced cryptographic techniques and smart contracts, with a paramount focus on safeguarding patient privacy. HNMblock also fosters personalized healthcare, encouraging patient involvement and data-informed decision-making. The integration of blockchain within the healthcare domain, as exemplified by HNMblock, holds the potential to revolutionize data management, epidemiological surveillance, and wellness, as meticulously explored in this research article.


title: Optimization of Super-Directive Linear Arrays with Differential Evolution for High Realized Gain

abstract: Due to the low impedance and high feeding currents, it is naturally challenging to design super-directive antenna arrays that perfectly match the feed line, and this becomes almost impossible as the number of elements increases. In this paper, we assert that it is crucial to consider the trade-off between directivity and overall efficiency (to achieve high realized gain) before employing super-directive arrays in real-world applications. Given this trade-off (high directivity and low mismatch for high realized gain), a 4-element dipole array (unit array) is optimized using the differential evolution (DE) algorithm. Then, the performance of the unit array in subarray configuration scenarios is analyzed. Finally, the obtained parameters are verified using the CST full-wave simulation software. The results clearly indicate that the proposed unit array is a strong candidate for dense array applications, particularly in the context of massive multiple-input multiple-output (MIMO), thanks to its notable high gain and efficiency.


title: Efficient ($\sim$10$\%$) Generation of Vacuum Ultraviolet Femtosecond Pulses via Four-Wave Mixing in Hollow-Core Fibers

abstract: We report the generation of the 5th harmonic of Ti:sapphire, at 160 nm, with more than 4~$\mu$J of pulse energy, and a pulse length of 37 fs with a 1 kHz repetition rate. The VUV pulses are produced using Four-Wave Difference Frequency Mixing (FWDFM) in a helium-filled stretched Hollow-Core Fiber (HCF), driven by a pump at 267 nm and seeded at 800 nm. Guided by simulations using Luna.jl, we are able to optimize the process carefully. The result is a conversion efficiency of $\sim$10$\%$ from the 267 nm pump beam, rivaling the efficient optical mixing schemes in nonlinear crystals.


title: Rate-Quality or Energy-Quality Pareto Fronts for Adaptive Video Streaming?

abstract: Adaptive video streaming is a key enabler for optimising the delivery of offline encoded video content. The research focus to date has been on optimisation, based solely on rate-quality curves. This paper adds an additional dimension, the energy expenditure, and explores construction of bitrate ladders based on decoding energy-quality curves rather than the conventional rate-quality curves. Pareto fronts are extracted from the rate-quality and energy-quality spaces to select optimal points. Bitrate ladders are constructed from these points using conventional rate-based rules together with a novel quality-based approach. Evaluation on a subset of YouTube-UGC videos encoded with x.265 shows that the energy-quality ladders reduce energy requirements by 28-31% on average at the cost of slightly higher bitrates. The results indicate that optimising based on energy-quality curves rather than rate-quality curves and using quality levels to create the rungs could potentially improve energy efficiency for a comparable quality of experience.


title: Correlated Binomial Process

abstract: Cohen and Kontorovich (COLT 2023) initiated the study of what we call here the Binomial Empirical Process: the maximal absolute value of a sequence of inhomogeneous normalized and centered binomials. They almost fully analyzed the case where the binomials are independent, and the remaining gap was closed by Blanchard and Vor\'{a}\v{c}ek (ALT 2024). In this work, we study the much more general and challenging case with correlations. In contradistinction to Gaussian processes, whose behavior is characterized by the covariance structure, we discover that, at least somewhat surprisingly, for binomial processes covariance does not even characterize convergence. Although a full characterization remains out of reach, we take the first steps with nontrivial upper and lower bounds in terms of covering numbers.


title: Domain Adaptable Fine-Tune Distillation Framework For Advancing Farm Surveillance

abstract: In this study, we propose an automated framework for camel farm monitoring, introducing two key contributions: the Unified Auto-Annotation framework and the Fine-Tune Distillation framework. The Unified Auto-Annotation approach combines two models, GroundingDINO (GD), and Segment-Anything-Model (SAM), to automatically annotate raw datasets extracted from surveillance videos. Building upon this foundation, the Fine-Tune Distillation framework conducts fine-tuning of student models using the auto-annotated dataset. This process involves transferring knowledge from a large teacher model to a student model, resembling a variant of Knowledge Distillation. The Fine-Tune Distillation framework aims to be adaptable to specific use cases, enabling the transfer of knowledge from the large models to the small models, making it suitable for domain-specific applications. By leveraging our raw dataset collected from Al-Marmoom Camel Farm in Dubai, UAE, and a pre-trained teacher model, GroundingDINO, the Fine-Tune Distillation framework produces a lightweight deployable model, YOLOv8. This framework demonstrates high performance and computational efficiency, facilitating efficient real-time object detection. Our code is available at \href{https://github.com/Razaimam45/Fine-Tune-Distillation}{https://github.com/Razaimam45/Fine-Tune-Distillation}


title: Spectral convergence of a semi-discretized numerical system for the spatially homogeneous Boltzmann equation with uncertainties

abstract: In this paper, we study the Boltzmann equation with uncertainties and prove that the spectral convergence of the semi-discretized numerical system holds in a combined velocity and random space, where the Fourier-spectral method is applied for approximation in the velocity space whereas the generalized polynomial chaos (gPC)-based stochastic Galerkin (SG) method is employed to discretize the random variable. Our proof is based on a delicate energy estimate for showing the well-posedness of the numerical solution as well as a rigorous control of its negative part in our well-designed functional space that involves high-order derivatives of both the velocity and random variables. This paper rigorously justifies the statement proposed in [Remark 4.4, J. Hu and S. Jin, J. Comput. Phys., 315 (2016), pp. 150-168].


title: The $k$-Opt algorithm for the Traveling Salesman Problem has exponential running time for $k \ge 5$

abstract: The $k$-Opt algorithm is a local search algorithm for the Traveling Salesman Problem. Starting with an initial tour, it iteratively replaces at most $k$ edges in the tour with the same number of edges to obtain a better tour. Krentel (FOCS 1989) showed that the Traveling Salesman Problem with the $k$-Opt neighborhood is complete for the class PLS (polynomial time local search) and that the $k$-Opt algorithm can have exponential running time for any pivot rule. However, his proof requires $k \gg 1000$ and has a substantial gap. We show the two properties above for a much smaller value of $k$, addressing an open question by Monien, Dumrauf, and Tscheuschner (ICALP 2010). In particular, we prove the PLS-completeness for $k \geq 17$ and the exponential running time for $k \geq 5$.


title: Fast UCB-type algorithms for stochastic bandits with heavy and super heavy symmetric noise

abstract: In this study, we propose a new method for constructing UCB-type algorithms for stochastic multi-armed bandits based on general convex optimization methods with an inexact oracle. We derive the regret bounds corresponding to the convergence rates of the optimization methods. We propose a new algorithm Clipped-SGD-UCB and show, both theoretically and empirically, that in the case of symmetric noise in the reward, we can achieve an $O(\log T\sqrt{KT\log T})$ regret bound instead of $O\left (T^{\frac{1}{1+\alpha}} K^{\frac{\alpha}{1+\alpha}} \right)$ for the case when the reward distribution satisfies $\mathbb{E}_{X \in D}[|X|^{1+\alpha}] \leq \sigma^{1+\alpha}$ ($\alpha \in (0, 1])$, i.e. perform better than it is assumed by the general lower bound for bandits with heavy-tails. Moreover, the same bound holds even when the reward distribution does not have the expectation, that is, when $\alpha<0$.


title: On the Convergence Rate of MCTS for the Optimal Value Estimation in Markov Decision Processes

abstract: A recent theoretical analysis of a corrected-version of a Monte-Carlo tree search (MCTS) method, so-called UCT, established an unexpected result, due to a great deal of empirical successes reported from heuristic usage of UCT with relevant adjustments for the problem domains in the literature, that its convergence rate in estimating the expected error relative to the optimal value of a finite-horizon Markov decision process (MDP) at an initial state is polynomial. We strengthen this dispiriting slow-convergence result by arguing within a simpler framework in the perspective of MDP, apart from the usual MCTS description, that just simpler UCB1 applied with the policy set as the arm set is actually competitive with or asymptotically faster than the corrected-version of UCT because of its logarithmic convergence-rate. We also point out that MCTS in general has the worst-case time and space complexities that depend on the state-set size which contradicts the original spirit of MCTS. Unless heuristically used, UCT-based MCTS has yet to have theoretical supports for its applicabilities.


title: Piecewise SOS-Convex Moment Optimization and Applications via Exact Semi-Definite Programs

abstract: This paper presents exact Semi-Definite Program (SDP) reformulations for infinite-dimensional moment optimization problems involving a new class of piecewise Sum-of-Squares (SOS)-convex functions and projected spectrahedral support sets. These reformulations show that solving a single SDP finds the optimal value and an optimal probability measure of the original moment problem. This is done by establishing an SOS representation for the non-negativity of a piecewise SOS-convex function over a projected spectrahedron. Finally, as an application and a proof-of-concept illustration, the paper also presents numerical results for the Newsvendor and revenue maximization problems with higher-order moments by solving their equivalent SDP reformulations. These reformulations promise a flexible and efficient approach to solving these models. The main novelty of the present work in relation to the recent research lies in finding the solution to moment problems, for the first time, with piecewise SOS-convex functions from their numerically tractable exact SDP reformulations.


title: CAHSOR: Competence-Aware High-Speed Off-Road Ground Navigation in SE(3)

abstract: While the workspace of traditional ground vehicles is usually assumed to be in a 2D plane, i.e., SE(2), such an assumption may not hold when they drive at high speeds on unstructured off-road terrain: High-speed sharp turns on high-friction surfaces may lead to vehicle rollover; Turning aggressively on loose gravel or grass may violate the non-holonomic constraint and cause significant lateral sliding; Driving quickly on rugged terrain will produce extensive vibration along the vertical axis. Therefore, most offroad vehicles are currently limited to drive only at low speeds to assure vehicle stability and safety. In this work, we aim at empowering high-speed off-road vehicles with competence awareness in SE(3) so that they can reason about the consequences of taking aggressive maneuvers on different terrain with a 6-DoF forward kinodynamic model. The model is learned from visual and inertial Terrain Representation for Off-road Navigation (TRON) using multimodal, self-supervised vehicle-terrain interactions. We demonstrate the efficacy of our Competence-Aware High-Speed Off-Road (CAHSOR) navigation approach on a physical ground robot in both an autonomous navigation and a human shared-control setup and show that CAHSOR can efficiently reduce vehicle instability by 62% while only compromising 8.6% average speed with the help of TRON.


title: Differentially Private Range Queries with Correlated Input Perturbation

abstract: This work proposes a class of locally differentially private mechanisms for linear queries, in particular range queries, that leverages correlated input perturbation to simultaneously achieve unbiasedness, consistency, statistical transparency, and control over utility requirements in terms of accuracy targets expressed either in certain query margins or as implied by the hierarchical database structure. The proposed Cascade Sampling algorithm instantiates the mechanism exactly and efficiently. Our bounds show that we obtain near-optimal utility while being empirically competitive against output perturbation methods.


title: Learning the Expected Core of Strictly Convex Stochastic Cooperative Games

abstract: Reward allocation, also known as the credit assignment problem, has been an important topic in economics, engineering, and machine learning. An important concept in reward allocation is the core, which is the set of stable allocations where no agent has the motivation to deviate from the grand coalition. In previous works, computing the core requires either knowledge of the reward function in deterministic games or the reward distribution in stochastic games. However, this is unrealistic, as the reward function or distribution is often only partially known and may be subject to uncertainty. In this paper, we consider the core learning problem in stochastic cooperative games, where the reward distribution is unknown. Our goal is to learn the expected core, that is, the set of allocations that are stable in expectation, given an oracle that returns a stochastic reward for an enquired coalition each round. Within the class of strictly convex games, we present an algorithm named \texttt{Common-Points-Picking} that returns a point in the expected core given a polynomial number of samples, with high probability. To analyse the algorithm, we develop a new extension of the separation hyperplane theorem for multiple convex sets.


title: Minimal Einstein-Aether Theory

abstract: We show that there is a minimal Einstein-Aether theory, obtained as a phenomenologically and theoretically consistent limit from the generic Einstein-Aether theory, that supports Einstein metrics as solutions with a reduced cosmological constant. The minimal theory is obtained by taking three of the coupling constants to be zero but keeping the expansion coupling constant to be nonzero. The square of the expansion of the unit-timelike aether field depletes the bare cosmological constant and thus provides, via local Lorentz symmetry breaking inherent in the Einstein-Aether theories, a novel mechanism for reconciling the observed, small cosmological constant (or dark energy) with the large theoretical prediction coming from quantum field theories. The crucial point here is that minimal Einstein-Aether theory does not modify the well-tested aspects of General Relativity such as solar systems tests and black hole physics including gravitational waves.


title: Using Large Language Models to Automate and Expedite Reinforcement Learning with Reward Machine

abstract: We present LARL-RM (Large language model-generated Automaton for Reinforcement Learning with Reward Machine) algorithm in order to encode high-level knowledge into reinforcement learning using automaton to expedite the reinforcement learning. Our method uses Large Language Models (LLM) to obtain high-level domain-specific knowledge using prompt engineering instead of providing the reinforcement learning algorithm directly with the high-level knowledge which requires an expert to encode the automaton. We use chain-of-thought and few-shot methods for prompt engineering and demonstrate that our method works using these approaches. Additionally, LARL-RM allows for fully closed-loop reinforcement learning without the need for an expert to guide and supervise the learning since LARL-RM can use the LLM directly to generate the required high-level knowledge for the task at hand. We also show the theoretical guarantee of our algorithm to converge to an optimal policy. We demonstrate that LARL-RM speeds up the convergence by 30% by implementing our method in two case studies.


title: Efficient Algorithms for Sum-of-Minimum Optimization

abstract: In this work, we propose a novel optimization model termed "sum-of-minimum" optimization. This model seeks to minimize the sum or average of $N$ objective functions over $k$ parameters, where each objective takes the minimum value of a predefined sub-function with respect to the $k$ parameters. This universal framework encompasses numerous clustering applications in machine learning and related fields. We develop efficient algorithms for solving sum-of-minimum optimization problems, inspired by a randomized initialization algorithm for the classic $k$-means (Arthur & Vassilvitskii, 2007) and Lloyd's algorithm (Lloyd, 1982). We establish a new tight bound for the generalized initialization algorithm and prove a gradient-descent-like convergence rate for generalized Lloyd's algorithm. The efficiency of our algorithms is numerically examined on multiple tasks, including generalized principal component analysis, mixed linear regression, and small-scale neural network training. Our approach compares favorably to previous ones based on simpler-but-less-precise optimization reformulations.


title: Modeling of Key Quality Indicators for End-to-End Network Management: Preparing for 5G

abstract: Thanks to evolving cellular telecommunication networks, providers can deploy a wide range of services. Soon, 5G mobile networks will be available to handle all types of services and applications for vast numbers of users through their mobile equipment. To effectively manage new 5G systems, end-to-end (E2E) performance analysis and optimization will be key features. However, estimating the end-user experience is not an easy task for network operators. The amount of end-user performance information operators can measure from the network is limited, complicating this approach. Here we explore the calculation of service metrics [known as key quality indicators (KQIs)] from classic low-layer measurements and parameters. We propose a complete machine-learning (ML) modeling framework. This system's low-layer metrics can be applied to measure service-layer performance. To assess the approach, we implemented and evaluated the proposed system on a real cellular network testbed.


title: The relative James construction and its application to homotopy groups

abstract: In this paper, we develop the new method to compute the homotopy groups of the mapping cone $C_f=Y\cup_{f}CX$ beyond the metastable range by analysing the homotopy of the $n$-th filtration of the relative James construction $J(X,A)$ for CW-pair $A\stackrel{i}\hookrightarrow X$, defined by B. Gray, which is homotopy equivalent to the homotopy fiber of the pinch map $X\cup_{i}CA\rightarrow \Sigma A$. As an application, we compute the 5 and 6-dim unstable homotopy groups of 3-dimensional mod $2^r$ Moore spaces for all positive integers $r$.


title: Quasi Regular Functions in Quaternionic Analysis

abstract: We study a new class of functions that arise naturally in quaternionic analysis, we call them "quasi regular functions". Like the well-known quaternionic regular functions, these functions provide representations of the quaternionic conformal group. However, unlike the regular functions, the quasi regular ones do not admit an invariant unitary structure but rather a pseudounitary equivalent. The reproducing kernels of these functions have an especially simple form: (Z-W)^{-1}. We describe the K-type bases of quasi regular functions and derive the reproducing kernel expansions. We also show that the restrictions of the irreducible representations formed from the quasi regular functions to the Poincare group have three irreducible components. Our interest in the quasi regular functions arises from an application to the study of conformal-invariant algebras of quaternionic functions. We also introduce a factorization of certain intertwining operators between tensor products of spaces of quaternionic functions. This factorization is obtained using fermionic Fock spaces constructed from the quasi regular functions.


title: Local moduli of continuity for permanental processes that are zero at zero

abstract: Let $u(s,t)$ be a continuous potential density of a symmetric L\'evy process or diffusion with state space $T$ killed at $T_{0}$, the first hitting time of $0$, or at $\lambda \wedge T_{0}$, where $\lambda$ is an independent exponential time. Let \[ f(t)=\int_{T} u(t,v)\,d\mu(v), \] where $\mu$ is a finite positive measure on $T$. Let $X_{\alpha}=\{X_{\alpha}(t),t\in T \}$ be an $\alpha-$permanental process with kernel \[ v(s,t)=u(s,t)+f(t). \] Then when $\lim_{t\to 0}u(t,t)=0$, \[ \limsup_{t\downarrow 0}\frac{X_{\alpha}(t )}{u(t,t)\log \log 1/t }\ge 1 ,\qquad \text{a.s.} \] and \[ \limsup_{t\downarrow 0}\frac{X_{\alpha}(t )}{u(t,t)\log \log 1/t }\le 1+C_{u,h} ,\qquad \text{a.s.} \] where $C_{u,\mu}\le |\mu|$ is a constant that depends on both $u$ and $\mu$, which is given explicitly, and is different in the different examples.


title: Inferring small neutron star spins with neutron star-black hole mergers

abstract: The precise measurement of neutron star (NS) spins can provide important insight into the formation and evolution of compact binaries containing NS. While traditional methods of NS spin measurement rely on pulsar observations, gravitational wave detections offer a complementary avenue. However, determining component spins with gravitational waves is hindered by the small dimensionless spins of the NS and the degeneracy in the mass and spin parameters. This degeneracy can be addressed by the inclusion of higher-order modes in the waveform, which are important for systems with unequal masses. This study shows the suitability of neutron star-black hole mergers, which are naturally mass-asymmetric, for precise NS spin measurements. We explore the effects of the black hole masses and spins, higher-mode content, inclination angle, and detector sensitivity on the measurement of NS spin. We find that networks with next-generation observatories like the Cosmic Explorer and the Einstein Telescope can distinguish NS dimensionless spin of 0.04 (0.1) from zero at $1-\sigma$ confidence for events within $\sim 350$ $(\sim 1000)$ Mpc. Networks with A+ and A$^{\sharp}$ detectors achieve similar distinction within $\sim 30$ $(\sim 70)$ Mpc and $\sim 50$ $(\sim 110)$ Mpc, respectively.


title: Enhancing Multi-field B2B Cloud Solution Matching via Contrastive Pre-training

abstract: Cloud solutions have gained significant popularity in the technology industry as they offer a combination of services and tools to tackle specific problems. However, despite their widespread use, the task of identifying appropriate company customers for a specific target solution to the sales team of a solution provider remains a complex business problem that existing matching systems have yet to adequately address. In this work, we study the B2B solution matching problem and identify two main challenges of this scenario: (1) the modeling of complex multi-field features and (2) the limited, incomplete, and sparse transaction data. To tackle these challenges, we propose a framework CAMA, which is built with a hierarchical multi-field matching structure as its backbone and supplemented by three data augmentation strategies and a contrastive pre-training objective to compensate for the imperfections in the available data. Through extensive experiments on a real-world dataset, we demonstrate that CAMA outperforms several strong baseline matching models significantly. Furthermore, we have deployed our matching framework on a system of Huawei Cloud. Our observations indicate an improvement of about 30% compared to the previous online model in terms of Conversion Rate (CVR), which demonstrates its great business value.


title: Smooth plurisubharmonic exhaustion functions on pseudo-convex domains in infinite dimensions

abstract: In this paper, by modifying significantly the Friedrichs-Gross mollifier technique and/or using the Lasry-Lions regularization technique together with some carefully chosen cut-off functions, for the first time we construct explicitly smooth exhaustion functions on any open subset and smooth plurisubharmonic exhaustion functions on any pseudo-convex domain in a typical Hilbert space, which enjoy delicate properties needed for the $L^{2}$ method in infinite-dimensional complex analysis.


title: Quantum Pair State Transfer on Isomorphic Branches

abstract: Quantum state transfer plays an important role in quantum information processing. The evolution of certain pair states in a quantum network with Heisenberg $XY$ Hamiltonian depends only on the local structure of the network, and it remains unchanged even if the global structure is altered. All graphs with high fidelity vertex state transfer may be considered as isomorphic branches of the graph underlying a large quantum network to exhibit high fidelity pair state transfer. Among other graphs, one may construct infinite family of trees admitting perfect pair state transfer.


title: The Relevance Feature and Vector Machine for health applications

abstract: This paper presents the Relevance Feature and Vector Machine (RFVM), a novel model that addresses the challenges of the fat-data problem when dealing with clinical prospective studies. The fat-data problem refers to the limitations of Machine Learning (ML) algorithms when working with databases in which the number of features is much larger than the number of samples (a common scenario in certain medical fields). To overcome such limitations, the RFVM incorporates different characteristics: (1) A Bayesian formulation which enables the model to infer its parameters without overfitting thanks to the Bayesian model averaging. (2) A joint optimisation that overcomes the limitations arising from the fat-data characteristic by simultaneously including the variables that define the primal space (features) and those that define the dual space (observations). (3) An integrated prunning that removes the irrelevant features and samples during the training iterative optimization. Also, this last point turns out crucial when performing medical prospective studies, enabling researchers to exclude unnecessary medical tests, reducing costs and inconvenience for patients, and identifying the critical patients/subjects that characterize the disorder and, subsequently, optimize the patient recruitment process that leads to a balanced cohort. The model capabilities are tested against state-of-the-art models in several medical datasets with fat-data problems. These experimental works show that RFVM is capable of achieving competitive classification accuracies while providing the most compact subset of data (in both terms of features and samples). Moreover, the selected features (medical tests) seem to be aligned with the existing medical literature.


title: RiskMiner: Discovering Formulaic Alphas via Risk Seeking Monte Carlo Tree Search

abstract: The formulaic alphas are mathematical formulas that transform raw stock data into indicated signals. In the industry, a collection of formulaic alphas is combined to enhance modeling accuracy. Existing alpha mining only employs the neural network agent, unable to utilize the structural information of the solution space. Moreover, they didn't consider the correlation between alphas in the collection, which limits the synergistic performance. To address these problems, we propose a novel alpha mining framework, which formulates the alpha mining problems as a reward-dense Markov Decision Process (MDP) and solves the MDP by the risk-seeking Monte Carlo Tree Search (MCTS). The MCTS-based agent fully exploits the structural information of discrete solution space and the risk-seeking policy explicitly optimizes the best-case performance rather than average outcomes. Comprehensive experiments are conducted to demonstrate the efficiency of our framework. Our method outperforms all state-of-the-art benchmarks on two real-world stock sets under various metrics. Backtest experiments show that our alphas achieve the most profitable results under a realistic trading setting.


title: Using Large Language Models for Student-Code Guided Test Case Generation in Computer Science Education

abstract: In computer science education, test cases are an integral part of programming assignments since they can be used as assessment items to test students' programming knowledge and provide personalized feedback on student-written code. The goal of our work is to propose a fully automated approach for test case generation that can accurately measure student knowledge, which is important for two reasons. First, manually constructing test cases requires expert knowledge and is a labor-intensive process. Second, developing test cases for students, especially those who are novice programmers, is significantly different from those oriented toward professional-level software developers. Therefore, we need an automated process for test case generation to assess student knowledge and provide feedback. In this work, we propose a large language model-based approach to automatically generate test cases and show that they are good measures of student knowledge, using a publicly available dataset that contains student-written Java code. We also discuss future research directions centered on using test cases to help students.


title: Refined Sample Complexity for Markov Games with Independent Linear Function Approximation

abstract: Markov Games (MG) is an important model for Multi-Agent Reinforcement Learning (MARL). It was long believed that the "curse of multi-agents" (i.e., the algorithmic performance drops exponentially with the number of agents) is unavoidable until several recent works (Daskalakis et al., 2023; Cui et al., 2023; Wang et al., 2023). While these works resolved the curse of multi-agents, when the state spaces are prohibitively large and (linear) function approximations are deployed, they either had a slower convergence rate of $O(T^{-1/4})$ or brought a polynomial dependency on the number of actions $A_{\max}$ -- which is avoidable in single-agent cases even when the loss functions can arbitrarily vary with time. This paper first refines the AVLPR framework by Wang et al. (2023), with an insight of designing *data-dependent* (i.e., stochastic) pessimistic estimation of the sub-optimality gap, allowing a broader choice of plug-in algorithms. When specialized to MGs with independent linear function approximations, we propose novel *action-dependent bonuses* to cover occasionally extreme estimation errors. With the help of state-of-the-art techniques from the single-agent RL literature, we give the first algorithm that tackles the curse of multi-agents, attains the optimal $O(T^{-1/2})$ convergence rate, and avoids $\text{poly}(A_{\max})$ dependency simultaneously.


title: A Highlight Removal Method for Capsule Endoscopy Images

abstract: The images captured by Wireless Capsule Endoscopy (WCE) always exhibit specular reflections, and removing highlights while preserving the color and texture in the region remains a challenge. To address this issue, this paper proposes a highlight removal method for capsule endoscopy images. Firstly, the confidence and feature terms of the highlight region's edges are computed, where confidence is obtained by the ratio of known pixels in the RGB space's R channel to the B channel within a window centered on the highlight region's edge pixel, and feature terms are acquired by multiplying the gradient vector of the highlight region's edge pixel with the iso-intensity line. Subsequently, the confidence and feature terms are assigned different weights and summed to obtain the priority of all highlight region's edge pixels, and the pixel with the highest priority is identified. Then, the variance of the highlight region's edge pixels is used to adjust the size of the sample block window, and the best-matching block is searched in the known region based on the RGB color similarity and distance between the sample block and the window centered on the pixel with the highest priority. Finally, the pixels in the best-matching block are copied to the highest priority highlight removal region to achieve the goal of removing the highlight region. Experimental results demonstrate that the proposed method effectively removes highlights from WCE images, with a lower coefficient of variation in the highlight removal region compared to the Crinimisi algorithm and DeepGin method. Additionally, the color and texture in the highlight removal region are similar to those in the surrounding areas, and the texture is continuous.


title: CodPy: a Python library for numerics, machine learning, and statistics

abstract: This monograph offers an introduction to a collection of numerical algorithms implemented in the library CodPy (an acronym that stands for the Curse Of Dimensionality in PYthon), which has found widespread applications across various areas, including machine learning, statistics, and computational physics. We develop here a strategy based on the theory of reproducing kernel Hilbert spaces (RKHS) and the theory of optimal transport. Initially designed for mathematical finance, this library has since been enhanced and broadened to be applicable to problems arising in engineering and industry. In order to present the general principles and techniques employed in CodPy and its applications, we have structured this monograph into two main parts. First of all, we focus on the fundamental principles of kernel-based representations of data and solutions, also that the presentation therein is supplemented with illustrative examples only. Next, we discuss the application of these principles to many classes of concrete problems, spanning from the numerical approximation of partial differential equations to (supervised, unsupervised) machine learning, extending to generative methods with a focus on stochastic aspects.


title: Speech Rhythm-Based Speaker Embeddings Extraction from Phonemes and Phoneme Duration for Multi-Speaker Speech Synthesis

abstract: This paper proposes a speech rhythm-based method for speaker embeddings to model phoneme duration using a few utterances by the target speaker. Speech rhythm is one of the essential factors among speaker characteristics, along with acoustic features such as F0, for reproducing individual utterances in speech synthesis. A novel feature of the proposed method is the rhythm-based embeddings extracted from phonemes and their durations, which are known to be related to speaking rhythm. They are extracted with a speaker identification model similar to the conventional spectral feature-based one. We conducted three experiments, speaker embeddings generation, speech synthesis with generated embeddings, and embedding space analysis, to evaluate the performance. The proposed method demonstrated a moderate speaker identification performance (15.2% EER), even with only phonemes and their duration information. The objective and subjective evaluation results demonstrated that the proposed method can synthesize speech with speech rhythm closer to the target speaker than the conventional method. We also visualized the embeddings to evaluate the relationship between the distance of the embeddings and the perceptual similarity. The visualization of the embedding space and the relation analysis between the closeness indicated that the distribution of embeddings reflects the subjective and objective similarity.


title: Coupling phase-switching with generalized Brewster effect for tunable optical sensor designs

abstract: The non-linear and tunable optical constants of phase-change materials associated with their phase-switching have been utilized in reconfigurable optical devices. For example, one possible application of phase-change thin films is for tunable perfect absorption designs, where p- polarized light reflectance vanishes at a specific incidence angle known as the Brewster angle. This work demonstrates a generalized Brewster effect (s- and p- polarized light absorption) for a multilayered heterostructure design based on the strong interference effect. The proposed design comprises a low-loss phase-change material, Sb2Se3, coated on a gold substrate. We experimentally and theoretically show the coexistence of vanishing reflectance values for both s- and p- polarized lights in the visible and near IR wavelength range at a single Brewster angle. Such vanishing reflectance values (points of darkness) are associated with phase singularities with abrupt changes. Moreover, we show that additional phase singularities can be realized by switching the active Sb2Se3 layer between amorphous and crystalline structures, extending the functionality of our design. The realized phase singularities are susceptible to small optical constant changes and can be utilized for ultra-sensing applications. As a proof of concept, we demonstrate our design's CO2 gas sensing capabilities, showing a linearly dependent optical response with gas flow rate. We believe our lithography-free design with multiple phase singularities, from the coexisting generalized Brewster effect and from the additional structural switching, is highly promising for tunable optical sensing applications.


title: Self-Correcting Self-Consuming Loops for Generative Model Training

abstract: As synthetic data becomes higher quality and proliferates on the internet, machine learning models are increasingly trained on a mix of human- and machine-generated data. Despite the successful stories of using synthetic data for representation learning, using synthetic data for generative model training creates "self-consuming loops" which may lead to training instability or even collapse, unless certain conditions are met. Our paper aims to stabilize self-consuming generative model training. Our theoretical results demonstrate that by introducing an idealized correction function, which maps a data point to be more likely under the true data distribution, self-consuming loops can be made exponentially more stable. We then propose self-correction functions, which rely on expert knowledge (e.g. the laws of physics programmed in a simulator), and aim to approximate the idealized corrector automatically and at scale. We empirically validate the effectiveness of self-correcting self-consuming loops on the challenging human motion synthesis task, and observe that it successfully avoids model collapse, even when the ratio of synthetic data to real data is as high as 100%.


title: Cooperating Cracks in Two-Dimensional Crystals

abstract: The pattern development of multiple cracks in extremely anisotropic solids such as bilayer or multilayer two-dimensional (2D) crystals contains rich physics, which, however, remains largely unexplored. We studied crack interaction across neighboring 2D layers by transmission electron microscopy and molecular dynamics simulations. Parallel and anti-parallel ('En-Passant') cracks attract and repel each other in bilayer 2D crystals, respectively, in stark contrast to the behaviors of co-planar cracks. We show that the misfit between in-plane displacement fields around the crack tips results in non-uniform interlayer shear, which modifies the crack driving forces by creating an antisymmetric component of the stress intensity factor. The cross-layer interaction between cracks directly leads to material toughening, the strength of which increases with the shear stiffness and decreases with the crack spacings. Backed by the experimental findings and simulation results, a theory that marries the theory of linear elastic fracture mechanics and the shear-lag model is presented, which guides the unconventional approach to engineer fracture patterns and enhance material resistance to cracking.


title: Quantum multiparameter estimation enhanced by a topological phase transition

abstract: In quantum multiparameter estimation, multiple to-be-estimated parameters are encoded in a quantum dynamics system by a unitary evolution. As the parameters vary, the system may undergo a topological phase transition (TPT). In this paper, we investigate two SU(2) TPT models and propose the singular behavior of the quantum metric tensor around the TPT point as a tool for the simultaneous optimal estimation of multiple parameters. We find that the proposed TPT sensing protocol can achieve the same metrology performance as the quantum-control-enhanced one. Moreover, the probe state of the TPT sensing protocol is only the ground state of the Hamiltonian rather than the entangled state required in the control-enhanced one. In addition, an adaptive multiparameter estimation strategy is developed for updating the estimated values until the desired quantum Cram\'er-Rao bound is approached. Our work reinforces the connection between quantum multiparameter estimation and topology physics, with potential inspiration for quantum critical metrology.


title: Design of a W-band High-PAE Class A&AB Power Amplifier in 150nm GaAs Technology

abstract: Nanometer scale power amplifiers (PA) at sub-THz suffer from severe parasitic effects that lead to experience limited maximum frequency and reduced power performance at the device transceiver front end. The integrated circuits researchers proposed different PA design architecture combinations at scaled down technologies to overcome these limitations. Although the designs meet the minimum requirements, the power added efficiency (PAE) of PA is still quite low. In this paper, a W-band single-ended common-source (CS) and cascode integrated 3-stage 2-way PA design is proposed. The design integrated different key design methodologies to mitigate the parasitic; such as combined Class AB and Class A stages for gain-boosting and efficiency enhancement, Wilkinson power combiner for higher output power, linearity, and bandwidth, and transmission line (TL)-based wide band matching network for better inter-stage matching and compact size. The proposed PA design is validated using UMS 150-nm GaAs pHEMT using advanced design system (ADS) simulator. The results show that the proposed PA achieved a gain of 20.1 dB, an output power of 17.2 dBm, a PAE of 33 % and a 21 GHz bandwidth at 90 GHz Sub-THz band. The PA layout consumes only 5.66 X 2.51 mm2 die space including pads. Our proposed PA design will boost the research on sub-THz integrated circuits research and will smooth the wide spread adoption of 6G in near future.


title: 3D-mapping and manipulation of photocurrent in an optoelectronic diamond device

abstract: Characterising charge transport in a material is central to the understanding of its electrical properties, and can usually only be inferred from bulk measurements of derived quantities such as current flow. Establishing connections between host material impurities and transport properties in emerging electronics materials, such as wide bandgap semiconductors, demands new diagnostic methods tailored to these unique systems, and the presence of optically-active defect centers in these materials offers a non-perturbative, in-situ characterisation system. Here, we combine charge-state sensitive optical microscopy and photoelectric detection of nitrogen-vacancy (NV) centres to directly image the flow of charge carriers inside a diamond optoelectronic device, in 3D and with temporal resolution. We optically control the charge state of background impurities inside the diamond on-demand, resulting in drastically different current flow such as filamentary channels nucleating from specific, defective regions of the device. We then optically engineered conducting channels that control carrier flow, key steps towards optically reconfigurable, wide bandgap designer optoelectronics. We anticipate our approach might be extended to probe other wide-bandgap semiconductors (SiC, GaN) relevant to present and emerging electronic technologies.


title: Generalizing Conversational Dense Retrieval via LLM-Cognition Data Augmentation

abstract: Conversational search utilizes muli-turn natural language contexts to retrieve relevant passages. Existing conversational dense retrieval models mostly view a conversation as a fixed sequence of questions and responses, overlooking the severe data sparsity problem -- that is, users can perform a conversation in various ways, and these alternate conversations are unrecorded. Consequently, they often struggle to generalize to diverse conversations in real-world scenarios. In this work, we propose a framework for generalizing Conversational dense retrieval via LLM-cognition data Augmentation (ConvAug). ConvAug first generates multi-level augmented conversations to capture the diverse nature of conversational contexts. Inspired by human cognition, we devise a cognition-aware process to mitigate the generation of false positives, false negatives, and hallucinations. Moreover, we develop a difficulty-adaptive sample filter that selects challenging samples for complex conversations, thereby giving the model a larger learning space. A contrastive learning objective is then employed to train a better conversational context encoder. Extensive experiments conducted on four public datasets, under both normal and zero-shot settings, demonstrate the effectiveness, generalizability, and applicability of ConvAug. The code is released at https://github.com/haon-chen/ConvAug.


title: Stability of the \`A Trous Algorithm Under Iteration

abstract: This paper examines the stability of the \`a trous algorithm under arbitrary iteration in the context of a more general study of shift-invariant filter banks. The main results describe sufficient conditions on the associated filters under which an infinitely iterated shift-invariant filter bank is stable. Moreover, it is shown that the stability of an infinitely iterated shift-invariant filter bank guarantees that of any associated finitely iterated shift-invariant filter bank, with uniform bounds. The reverse implication is shown to hold under an additional assumption on the low-pass filter. Finally, it is also shown that the separable product of stable one-dimensional shift-invariant filter banks produces a stable two-dimensional shift-invariant filter bank.


title: Equivalence of the staggered fermion Hamiltonan and the discrete Hodge-Dirac operator on square lattices

abstract: We show that the free massless staggered fermion (or the KS-fermion) Hamiltonian is equivalent to a discrete Hodge-Dirac operator on the $d$-dimensional square lattice $h\mathbb{Z}^d$. In fact, they are identical operator valued matrices under suitable choices of their representations on $\ell^2(2h\mathbb{Z}^d)\otimes\mathbb{C}^{2^d}$. We employ the formulations of the staggered fermion by Nakamura (2024), and the discrete cohomology structure on the square lattices by Miranda-Parra (2023).


title: Does ChatGPT and Whisper Make Humanoid Robots More Relatable?

abstract: Humanoid robots are designed to be relatable to humans for applications such as customer support and helpdesk services. However, many such systems, including Softbank's Pepper, fall short because they fail to communicate effectively with humans. The advent of Large Language Models (LLMs) shows the potential to solve the communication barrier for humanoid robotics. This paper outlines the comparison of different Automatic Speech Recognition (ASR) APIs, the integration of Whisper ASR and ChatGPT with the Pepper robot and the evaluation of the system (Pepper-GPT) tested by 15 human users. The comparison result shows that, compared to the Google ASR and Google Cloud ASR, the Whisper ASR performed best as its average Word Error Rate (1.716%) and processing time (2.639 s) are both the lowest. The participants' usability investigations show that 60% of the participants thought the performance of the Pepper-GPT was "excellent", while the rest rated this system as "good" in the subsequent experiments. It is proved that while some problems still need to be overcome, such as the robot's multilingual ability and facial tracking capacity, users generally responded positively to the system, feeling like talking to an actual human.


title: A Note on Unique Factorization in Superrings

abstract: In the realm of supercommutative superrings, this article investigates the unique factorization of elements. We build upon recent findings by Naser et. al. concerning similar results in noncommutative symmetric rings with zerodivisors, delving deeper into the ramifications. Strikingly, we demonstrate that any unique factorization superdomain necessarily takes the form of a superfield, further characterizing them as Artinian superrings with Krull superdimension 0 | d. Furthermore, we discover that a straightforward analogue of the well-known Auslander-Buchsbaum Theorem does not hold true in the supercommutative setting.


title: Quantum reservoir probing of quantum phase transitions

abstract: Quantum phase transitions are highly remarkable phenomena manifesting in quantum many-body systems. However, their precise identifications in equilibrium systems pose significant theoretical and experimental challenges. Thus far, dynamical detection protocols employing global quantum quenches have been proposed, wherein transitions are discerned from global nonequilibrium excitations. In this work, we demonstrate that quantum phase transitions can be detected through localized out-of-equilibrium excitations induced by local quantum quenches. While the resulting dynamics after the quench are influenced by both the local quench operation and the intrinsic dynamics of the quantum system, the effects of the former are exclusively extracted through the cutting-edge framework called quantum reservoir probing (QRP). Through the QRP, we find that the impacts of the local quenches vary across different quantum phases and are significantly suppressed by quantum fluctuations amplified near quantum critical points, thereby precisely delineating phase boundaries. We demonstrate that the QRP can detect quantum phase transitions in the paradigmatic integrable and nonintegrable quantum systems, and even topological quantum phase transitions, all within the identical framework employing single-site observables.

categories: quant-ph cond-mat.quant-gas cond-mat.stat-mech cond-mat.str-el


title: Improving Pallet Detection Using Synthetic Data

abstract: The use of synthetic data in machine learning saves a significant amount of time when implementing an effective object detector. However, there is limited research in this domain. This study aims to improve upon previously applied implementations in the task of instance segmentation of pallets in a warehouse environment. This study proposes using synthetically generated domain-randomised data as well as data generated through Unity to achieve this. This study achieved performance improvements on the stacked and racked pallet categories by 69% and 50% mAP50, respectively when being evaluated on real data. Additionally, it was found that there was a considerable impact on the performance of a model when it was evaluated against images in a darker environment, dropping as low as 3% mAP50 when being evaluated on images with an 80% brightness reduction. This study also created a two-stage detector that used YOLOv8 and SAM, but this proved to have unstable performance. The use of domain-randomised data proved to have negligible performance improvements when compared to the Unity-generated data.


title: Rethinking the Capacity of Graph Neural Networks for Branching Strategy

abstract: Graph neural networks (GNNs) have been widely used to predict properties and heuristics of mixed-integer linear programs (MILPs) and hence accelerate MILP solvers. This paper investigates the capacity of GNNs to represent strong branching (SB), the most effective yet computationally expensive heuristic employed in the branch-and-bound algorithm. In the literature, message-passing GNN (MP-GNN), as the simplest GNN structure, is frequently used as a fast approximation of SB and we find that not all MILPs's SB can be represented with MP-GNN. We precisely define a class of "MP-tractable" MILPs for which MP-GNNs can accurately approximate SB scores. Particularly, we establish a universal approximation theorem: for any data distribution over the MP-tractable class, there always exists an MP-GNN that can approximate the SB score with arbitrarily high accuracy and arbitrarily high probability, which lays a theoretical foundation of the existing works on imitating SB with MP-GNN. For MILPs without the MP-tractability, unfortunately, a similar result is impossible, which can be illustrated by two MILP instances with different SB scores that cannot be distinguished by any MP-GNN, regardless of the number of parameters. Recognizing this, we explore another GNN structure called the second-order folklore GNN (2-FGNN) that overcomes this limitation, and the aforementioned universal approximation theorem can be extended to the entire MILP space using 2-FGNN, regardless of the MP-tractability. A small-scale numerical experiment is conducted to directly validate our theoretical findings.


title: Many-Body Eigenstates from Quantum Manifold Optimization

abstract: Quantum computing offers several new pathways toward finding many-body eigenstates, with variational approaches being some of the most flexible and near-term oriented. These require particular parameterizations of the state, and for solving multiple eigenstates must incorporate orthogonality. In this work, we use techniques from manifold optimization to arrive at solutions of the many-body eigenstate problem via direct minimization over the Stiefel and Grassmannian manifolds, avoiding parameterizations of the states and allowing for multiple eigenstates to be simultaneously calculated. These Riemannian manifolds naturally encode orthogonality constraints and have efficient quantum representations of the states and tangent vectors. We provide example calculations for quantum many-body molecular systems and discuss different pathways for solving the multiple eigenstate problem.


title: On the Complexity of First-Order Methods in Stochastic Bilevel Optimization

abstract: We consider the problem of finding stationary points in Bilevel optimization when the lower-level problem is unconstrained and strongly convex. The problem has been extensively studied in recent years; the main technical challenge is to keep track of lower-level solutions $y^*(x)$ in response to the changes in the upper-level variables $x$. Subsequently, all existing approaches tie their analyses to a genie algorithm that knows lower-level solutions and, therefore, need not query any points far from them. We consider a dual question to such approaches: suppose we have an oracle, which we call $y^*$-aware, that returns an $O(\epsilon)$-estimate of the lower-level solution, in addition to first-order gradient estimators {\it locally unbiased} within the $\Theta(\epsilon)$-ball around $y^*(x)$. We study the complexity of finding stationary points with such an $y^*$-aware oracle: we propose a simple first-order method that converges to an $\epsilon$ stationary point using $O(\epsilon^{-6}), O(\epsilon^{-4})$ access to first-order $y^*$-aware oracles. Our upper bounds also apply to standard unbiased first-order oracles, improving the best-known complexity of first-order methods by $O(\epsilon)$ with minimal assumptions. We then provide the matching $\Omega(\epsilon^{-6})$, $\Omega(\epsilon^{-4})$ lower bounds without and with an additional smoothness assumption on $y^*$-aware oracles, respectively. Our results imply that any approach that simulates an algorithm with an $y^*$-aware oracle must suffer the same lower bounds.


title: Future Prediction Can be a Strong Evidence of Good History Representation in Partially Observable Environments

abstract: Learning a good history representation is one of the core challenges of reinforcement learning (RL) in partially observable environments. Recent works have shown the advantages of various auxiliary tasks for facilitating representation learning. However, the effectiveness of such auxiliary tasks has not been fully convincing, especially in partially observable environments that require long-term memorization and inference. In this empirical study, we investigate the effectiveness of future prediction for learning the representations of histories, possibly of extensive length, in partially observable environments. We first introduce an approach that decouples the task of learning history representations from policy optimization via future prediction. Then, our main contributions are two-fold: (a) we demonstrate that the performance of reinforcement learning is strongly correlated with the prediction accuracy of future observations in partially observable environments, and (b) our approach can significantly improve the overall end-to-end approach by preventing high-variance noisy signals from reinforcement learning objectives to influence the representation learning. We illustrate our claims on three types of benchmarks that necessitate the ability to process long histories for high returns.


title: Learning protein-ligand unbinding pathways via single-parameter community detection

abstract: Understanding the dynamics of biomolecular complexes, e.g., of protein-ligand (un)binding, requires the understanding of paths such systems take between metastable states. In MD simulation data, paths are usually not observable per se, but need to be inferred from simulation trajectories. Here we present a novel approach to cluster trajectories based on a community detection algorithm that requires the definition of only a single free parameter. Using the streptavidin-biotin complex as benchmark system and the A\textsubscript{2a} adenosine receptor in complex with the inhibitor ZM241385 as an elaborate application, we demonstrate how such clusters of trajectories correspond to pathways, and how the approach helps in the identification of reaction coordinates for a considered (un)binding process.

categories: physics.comp-ph cond-mat.stat-mech physics.data-an q-bio.BM


title: The Aleph & Other Metaphors for Image Generation

abstract: In this position paper, we reflect on fictional stories dealing with the infinite and how they connect with the current, fast-evolving field of image generation models. We draw attention to how some of these literary constructs can serve as powerful metaphors for guiding human-centered design and technical thinking in the space of these emerging technologies and the experiences we build around them. We hope our provocations seed conversations about current and yet-to-be developed interactions with these emerging models in ways that may amplify human agency.


title: Unified Framework for Laser-induced Transient Bubble Dynamics within Microchannels

abstract: Oscillatory flow in confined spaces is central to understanding physiological flows and rational design of synthetic periodic-actuation based micromachines. Using theory and experiments on oscillating flows generated through a laser-induced cavitation bubble, we associate the dynamic bubble size (fluid velocity) and bubble lifetime to the laser energy supplied - a control parameter in experiments. Employing different channel cross-section shapes, sizes and lengths, we demonstrate the characteristic scales for velocity, time and energy to depend solely on the channel geometry. Contrary to the generally assumed absence of instability in low Reynolds number flows (<1000), we report a momentary flow distortion that originates due to the boundary layer separation near channel walls during flow deceleration. The emergence of distorted laminar states is characterized using two stages. First the conditions for the onset of instabilities is analyzed using the Reynolds number and Womersley number for oscillating flows. Second the growth and the ability of an instability to prevail is analyzed using the convective time scale of the flow. Our findings inform rational design of microsystems leveraging pulsatile flows via cavitation-powered microactuation.


title: Transport multi-paths with capacity constraints

abstract: This article generalizes the study of branched/ramified optimal transportation to those with capacity constraints. Each admissible transport network studied here is represented by a transport multi-path between measures, with a capacity constraint on each of its components. The associated transport cost is given by the sum of the $\textbf{M}_{\alpha}$-cost of each component. Using this new formulation, we prove the existence of an optimal solution and provide an upper bound on the number of components for the solution. Additionally, we conduct analytical examinations of the properties (e.g. ``map-compatibility", and ``simple common-source property") of each solution component and explore the interplay among components, particularly in the discrete case.


title: Echoes of Socratic Doubt: Embracing Uncertainty in Calibrated Evidential Reinforcement Learning

abstract: We present a novel statistical approach to incorporating uncertainty awareness in model-free distributional reinforcement learning involving quantile regression-based deep Q networks. The proposed algorithm, $\textit{Calibrated Evidential Quantile Regression in Deep Q Networks (CEQR-DQN)}$, aims to address key challenges associated with separately estimating aleatoric and epistemic uncertainty in stochastic environments. It combines deep evidential learning with quantile calibration based on principles of conformal inference to provide explicit, sample-free computations of $\textit{global}$ uncertainty as opposed to $\textit{local}$ estimates based on simple variance, overcoming limitations of traditional methods in computational and statistical efficiency and handling of out-of-distribution (OOD) observations. Tested on a suite of miniaturized Atari games (i.e., MinAtar), CEQR-DQN is shown to surpass similar existing frameworks in scores and learning speed. Its ability to rigorously evaluate uncertainty improves exploration strategies and can serve as a blueprint for other algorithms requiring uncertainty awareness.


title: Decoupling Learning and Decision-Making: Breaking the $\mathcal{O}(\sqrt{T})$ Barrier in Online Resource Allocation with First-Order Methods

abstract: Online linear programming plays an important role in both revenue management and resource allocation, and recent research has focused on developing efficient first-order online learning algorithms. Despite the empirical success of first-order methods, they typically achieve a regret no better than $\mathcal{O}(\sqrt{T})$, which is suboptimal compared to the $\mathcal{O}(\log T)$ bound guaranteed by the state-of-the-art linear programming (LP)-based online algorithms. This paper establishes several important facts about online linear programming, which unveils the challenge for first-order-method-based online algorithms to achieve beyond $\mathcal{O}(\sqrt{T})$ regret. To address the challenge, we introduce a new algorithmic framework that decouples learning from decision-making. For the first time, we show that first-order methods can attain regret $\mathcal{O}(T^{1/3})$ with this new framework.


title: B-brane Transport and Grade Restriction Rule for Determinantal Varieties

abstract: We study autoequivalences of $D^{b}Coh(X)$ associated to B-brane transport around loops in the stringy K\"ahler moduli of $X$. We consider the case of $X$ being certain resolutions of determinantal varieties embedded in $\mathbb{P}^{d}\times G(k,n)$. Such resolutions have been modeled, in general, by nonabelian gauged linear sigma models (GLSM). We use the GLSM construction to determine the window categories associated with B-brane transport between different geometric phases using the machinery of grade restriction rule and the hemisphere partition function. In the family of examples analyzed the monodromies around phase boundaries enjoy the interpretation as loop inside link complements. We exploit this interpretation to find a decomposition of autoequivalences into simpler spherical functors and we illustrate this in two examples of Calabi-Yau 3-folds $X$, modeled by an abelian and nonabelian GLSM respectively. In additon we also determine explicitly the action of the autoequivalences on the Grothendieck group $K(X)$ (or equivalently, B-brane charges).


title: The TESS-Keck Survey. XVIII. A sub-Neptune and spurious long-period signal in the TOI-1751 system

abstract: We present and confirm TOI-1751 b, a transiting sub-Neptune orbiting a slightly evolved, solar-type, metal-poor star ($T_{eff} = 5996 \pm 110$ K, $log(g) = 4.2 \pm 0.1$, V = 9.3 mag, [Fe/H] = $-0.40 \pm 0.06$ dex) every 37.47 d. We use TESS photometry to measure a planet radius of $2.77_{-0.07}^{+0.15}~\rm{R_\oplus}$. We also use both Keck/HIRES and APF/Levy radial velocities (RV) to derive a planet mass of $14.5_{-3.14}^{+3.15} ~\rm{M_\oplus}$, and thus a planet density of $3.6 \pm 0.9 \, {\rm g}\,{\rm cm}^{-3}$. There is also a long-period ($\sim400~\rm{d}$) signal that is observed in only the Keck/HIRES data. We conclude that this long-period signal is not planetary in nature, and is likely due to the window function of the Keck/HIRES observations. This highlights the role of complementary observations from multiple observatories to identify and exclude aliases in RV data. Finally, we investigate potential compositions of this planet, including rocky and water-rich solutions, as well as theoretical irradiated ocean models. TOI-1751 b is a warm sub-Neptune, with an equilibrium temperature of $\sim 820$ K. As TOI-1751 is a metal-poor star, TOI-1751 b may have formed in a water-enriched formation environment. We thus favor a volatile-rich interior composition for this planet.


title: A multitype Galton-Watson model for rejuvenating cells

abstract: We employ the framework of multitype Galton-Watson processes to model a population of dividing cells. The cellular type is represented by its biological age, defined as the count of harmful proteins hosted by the cell. The stochastic evolution of the biological age of a cell is modeled as a discrete Markov chain with a finite state space $\{0,1,\ldots,n\}$, where $n$ signifies the absorbing state corresponding to the senescent state of the cell. Consequently, the set of individual types in the multitype Galton-Watson process becomes $\{0,\ldots,n-1\}$. In our setting, a dividing cell may undergo rejuvenation meaning that its biological ages reduces due to transfer of harmful proteins to the daughter cell. For the proposed model, we define and study several biologically meaningful features, such as rejuvenation states, expected replicative lifespan, population growth rate, stable biological age distribution, and the population average of the biological age.


title: Linear Stability Analysis of Oblique Couette-Poiseuille flows

abstract: We perform a detailed numerical study of modal and non-modal stability in oblique Couette-Poiseuille profiles, which are among the simplest examples of three-dimensional boundary layers. Through a comparison with the Orr-Sommerfeld operator for the aligned case, we show how an effective wall speed succinctly characterizes modal stability. Large-scale parameter sweeps reveal that the misalignment between the pressure gradient and wall motion is, in general, destabilizing. For flows that are sufficiently oblique, the instability is found to depend exclusively on the direction of wall motion and not on its speed, a conclusion supported, in part, by the perturbation energy budget and the evolution of the critical layers. Closed forms for the critical parameters in this regime are derived using a simple analysis. Finally, a modified long-wavelength approximation is developed, and the resulting asymptotic eigenvalue problem is used to show that there is no cutoff wall speed for unconditional stability whenever the angle of wall motion is non-zero, in stark contrast to the aligned case. From a non-modal perspective, pseudo-resonance is examined through the resolvent and the $\epsilon$-pseudospectra. An analysis of the unforced initial value problem shows that the maximum energy gain is highly dependent on both the magnitude and direction of the wall velocity. However, the strongest amplification is always achieved for configurations that are only weakly skewed. Finally, the optimal perturbations appear to develop via a lift-up effect induced by an Orr-like mechanism.


title: Statistical properties of probabilistic context-sensitive grammars

abstract: Probabilistic context-free grammars, commonly used to randomly generate trees, have been well analyzed theoretically and have found applications in various domains. Despite their utility, the distributions that the grammar can express are limited to those in which the distribution of a subtree depends only on its root and not on its context. This limitation becomes a challenge for modeling various real-world phenomena such as natural language. To overcome this limitation, a probabilistic context-sensitive grammar is introduced, where a subtree's distribution depends on its context, and its statistical properties are explored. Numerical analysis reveals that the distribution of a symbol does not exhibit a qualitative difference from that in the context-free case, but mutual information does. Furthermore, a metric is introduced to directly quantify the breaking of this limitation. This metric is zero in the context-free case, and is applicable to an arbitrary distribution of a tree. Measuring this metric enables the detection of a distinct difference between probabilistic context-free and context-sensitive grammars.


title: Towards Quantifying the Preconditioning Effect of Adam

abstract: There is a notable dearth of results characterizing the preconditioning effect of Adam and showing how it may alleviate the curse of ill-conditioning -- an issue plaguing gradient descent (GD). In this work, we perform a detailed analysis of Adam's preconditioning effect for quadratic functions and quantify to what extent Adam can mitigate the dependence on the condition number of the Hessian. Our key finding is that Adam can suffer less from the condition number but at the expense of suffering a dimension-dependent quantity. Specifically, for a $d$-dimensional quadratic with a diagonal Hessian having condition number $\kappa$, we show that the effective condition number-like quantity controlling the iteration complexity of Adam without momentum is $\mathcal{O}(\min(d, \kappa))$. For a diagonally dominant Hessian, we obtain a bound of $\mathcal{O}(\min(d \sqrt{d \kappa}, \kappa))$ for the corresponding quantity. Thus, when $d < \mathcal{O}(\kappa^p)$ where $p = 1$ for a diagonal Hessian and $p = 1/3$ for a diagonally dominant Hessian, Adam can outperform GD (which has an $\mathcal{O}(\kappa)$ dependence). On the negative side, our results suggest that Adam can be worse than GD for a sufficiently non-diagonal Hessian even if $d \ll \mathcal{O}(\kappa^{1/3})$; we corroborate this with empirical evidence. Finally, we extend our analysis to functions satisfying per-coordinate Lipschitz smoothness and a modified version of the Polyak-\L ojasiewicz condition.


title: Simple error bounds for an asymptotic expansion of the partition function

abstract: Recently, there has been renewed interest in studying the asymptotic properties of the number theoretic partition function $p(n)$. Ramanujan, Hardy, and Rademacher provided detailed asymptotic analyses for $p(n)$. Presently, attention has shifted towards Poincar\'e-type asymptotic expansions, characterised by their simplicity albeit reduced accuracy compared to the earlier works of Ramanujan, Hardy, and Rademacher. This paper aims to establish computable error bounds for one such simplified expansion. The bounds presented herein are sharper, and their derivation is considerably simpler compared to those found in recent literature.