title: Photonic lantern wavefront reconstruction in a multi-wavefront sensor single-conjugate adaptive optics system

abstract: Exoplanet direct imaging using adaptive optics (AO) is often limited by non-common path aberrations (NCPAs) and aberrations that are invisible to traditional pupil-plane wavefront sensors (WFSs). This can be remedied by focal-plane (FP) WFSs that characterize aberrations directly from a final science image. Photonic lanterns (PLs) can act as low-order FPWFSs with the ability to direct some light to downstream science instruments. Using a PL on the SEAL (Santa Cruz Extreme AO Laboratory) high-contrast imaging testbed, we demonstrate (1) linear ranges and (2) closed-loop control. Additionally, we simulate the use of the PL in a multi-wavefront sensor AO system, in which multiple WFSs feed back to the same common-path deformable mirror. Building on previous multi-WFS AO demonstrations on SEAL, we simulate a modulated pyramid WFS to sense aberrations of high spatial order and large amplitude, and the PL to sense low order aberrations including NCPAs. We assess adaptive optics performance in this setting using three different PL wavefront reconstruction algorithms. We also provide a new method to experimentally identify the propagation matrix of a PL, making advanced model-based algorithms practical. This work demonstrates the role of photonic technologies and multi-stage wavefront sensing in the context of extreme AO and high contrast imaging.


title: Quantum embedding study of strain and charge induced Stark effects on the NV$^{-}$ center in diamond

abstract: The NV$^{-}$ color center in diamond has been demonstrated as a powerful nanosensor for quantum metrology, due to the sensitivity of its optical and spin properties to external electric, magnetic, and strain fields. In view of these applications, we use quantum embedding to derive a many-body description of strain and charge induced Stark effects on the NV$^{-}$ center. We quantify how strain longitudinal to the axis of NV$^{-}$ shifts the excited states in energy, while strain with a component transverse to the NV axis splits the degeneracies of the $^{3}E$ and $^{1}E$ states. The largest effects are for the optically relevant $^{3}E$ manifold, which splits into $E_{x}$ and $E_{y}$ with transverse strain. From these responses we extract strain susceptibilities for the $E_{x/y}$ states within the quasi-linear regime. Additionally, we study the many-body dipole matrix elements of the NV$^{-}$ and find a permanent dipole 1.64 D at zero strain, which is $\sim 30 \%$ smaller than that obtained from recent density functional theory calculations. We also determine the transition dipole between the $E_{x}$ and $E_{y}$ and how it evolves with strain.


title: Development of Focused X-ray Luminescence Compute Tomography Imaging

abstract: X-ray luminescence is produced when contrast agents absorb energy from X-ray photons and release a portion of that energy by emitting photons in the visible and near-infrared range. X-ray luminescence computed tomography (XLCT) was introduced in the past decade as a hybrid molecular imaging modality combining the merits of both X-ray imaging (high spatial resolution) and optical imaging (high sensitivity to tracer nanophosphors).


title: Beurling and Model subspaces invariant under a universal operator

abstract: In this article, we characterize the Beurling and Model subspaces of the Hardy-Hilbert space $H^2(\mathbb{D})$ invariant under the composition operator $C_{\phi_a}f=f\circ\phi_a$, where $\phi_a(z) = az + 1 - a$ for $a \in (0,1)$ is an affine self-map of the open unit disk $\mathbb{D}$. These operators have universal translates (in the sense of Rota) and have attracted attention recently due to their connection with the Invariant Subspace Problem (ISP) and the classical Ces\`aro operator.


title: Self-attention-based non-linear basis transformations for compact latent space modelling of dynamic optical fibre transmission matrices

abstract: Multimode optical fibres are hair-thin strands of glass that efficiently transport light. They promise next-generation medical endoscopes that provide unprecedented sub-cellular image resolution deep inside the body. However, confining light to such fibres means that images are inherently scrambled in transit. Conventionally, this scrambling has been compensated by pre-calibrating how a specific fibre scrambles light and solving a stationary linear matrix equation that represents a physical model of the fibre. However, as the technology develops towards real-world deployment, the unscrambling process must account for dynamic changes in the matrix representing the fibre's effect on light, due to factors such as movement and temperature shifts, and non-linearities resulting from the inaccessibility of the fibre tip when inside the body. Such complex, dynamic and nonlinear behaviour is well-suited to approximation by neural networks, but most leading image reconstruction networks rely on convolutional layers, which assume strong correlations between adjacent pixels, a strong inductive bias that is inappropriate for fibre matrices which may be expressed in a range of arbitrary coordinate representations with long-range correlations. We introduce a new concept that uses self-attention layers to dynamically transform the coordinate representations of varying fibre matrices to a basis that admits compact, low-dimensional representations suitable for further processing. We demonstrate the effectiveness of this approach on diverse fibre matrix datasets. We show our models significantly improve the sparsity of fibre bases in their transformed bases with a participation ratio, p, as a measure of sparsity, of between 0.01 and 0.11. Further, we show that these transformed representations admit reconstruction of the original matrices with < 10% reconstruction error, demonstrating the invertibility.


title: The $L^1$-$L^\infty$-geometry of Teichm\"uller space -- Second order infinitesimal structures

abstract: The $L^1$-$L^\infty$ geometry is the Finsler geometry of the Teichm\"uller space by the Teichm\"uller metric and the $L^1$-norm function of holomorphic quadratic differentials. In this paper, aiming to develop the $L^1$-$L^\infty$-geometry and the differential geometry on the Teichm\"uller space, we formulate the second order infinitesimal structures (the infinitesimal structures on the (co)tangent bundles) over the Teichm\"uller space. We will give model spaces of the second order infinitesimal spaces. By applying our formulation, we give affirmative answers to two folklore. We first show that the map from the space of holomorphic quadratic differentials to the tangent bundle defined by Teichm\"uller Beltrami differentials is a real-analytic diffeomorphism on every stratum in the space of holomorphic quadratic differentials. Second, we show that the Teichm\"uller metric is real-analytic on the image of each stratum. We also observe a new duality between the Teichm\"uller metric and the $L^1$-norm function at the infinitesimal level.


title: Unifying Interpretability and Explainability for Alzheimer's Disease Progression Prediction

abstract: Reinforcement learning (RL) has recently shown promise in predicting Alzheimer's disease (AD) progression due to its unique ability to model domain knowledge. However, it is not clear which RL algorithms are well-suited for this task. Furthermore, these methods are not inherently explainable, limiting their applicability in real-world clinical scenarios. Our work addresses these two important questions. Using a causal, interpretable model of AD, we first compare the performance of four contemporary RL algorithms in predicting brain cognition over 10 years using only baseline (year 0) data. We then apply SHAP (SHapley Additive exPlanations) to explain the decisions made by each algorithm in the model. Our approach combines interpretability with explainability to provide insights into the key factors influencing AD progression, offering both global and individual, patient-level analysis. Our findings show that only one of the RL methods is able to satisfactorily model disease progression, but the post-hoc explanations indicate that all methods fail to properly capture the importance of amyloid accumulation, one of the pathological hallmarks of Alzheimer's disease. Our work aims to merge predictive accuracy with transparency, assisting clinicians and researchers in enhancing disease progression modeling for informed healthcare decisions. Code is available at https://github.com/rfali/xrlad.


title: On Trojans in Refined Language Models

abstract: A Trojan in a language model can be inserted when the model is refined for a particular application such as determining the sentiment of product reviews. In this paper, we clarify and empirically explore variations of the data-poisoning threat model. We then empirically assess two simple defenses each for a different defense scenario. Finally, we provide a brief survey of related attacks and defenses.


title: An Atomic Beam of Titanium for Ultracold Atom Experiments

abstract: We generate an atomic beam of titanium (Ti) using a "Ti-ball" Ti-sublimation pump, which is a common getter pump used in ultrahigh vacuum (UHV) systems. We show that the sublimated atomic beam can be optically pumped into the metastable $3d^{3}(^4F){4}s$ $a^5F_5$ state, which is the lower energy level in a nearly cycling optical transition that can be used for laser cooling. We measure the atomic density and transverse and longitudinal velocity distributions of the beam through laser fluorescence spectroscopy. We find a metastable atomic flux density of $4.3(2)\times10^9\,$s$^{-1}$cm$^{-2}$ with mean forward velocity $773(8)\,$m/s at $2.55\,$cm directly downstream of the center of the Ti-ball. Owing to the details of optical pumping, the beam is highly collimated along the transverse axis parallel to the optical pumping beam and the flux density falls off as $1/r$. We discuss how this source can be used to load atoms into a magneto-optical trap.


title: A Critical Look At Tokenwise Reward-Guided Text Generation

abstract: Large language models (LLMs) can significantly be improved by aligning to human preferences -- the so-called reinforcement learning from human feedback (RLHF). However, the cost of fine-tuning an LLM is prohibitive for many users. Due to their ability to bypass LLM finetuning, tokenwise reward-guided text generation (RGTG) methods have recently been proposed. They use a reward model trained on full sequences to score partial sequences during a tokenwise decoding, in a bid to steer the generation towards sequences with high rewards. However, these methods have so far been only heuristically motivated and poorly analyzed. In this work, we show that reward models trained on full sequences are not compatible with scoring partial sequences. To alleviate this issue, we propose to explicitly train a Bradley-Terry reward model on partial sequences, and autoregressively sample from the implied tokenwise policy during decoding time. We study the property of this reward model and the implied policy. In particular, we show that this policy is proportional to the ratio of two distinct RLHF policies. We show that our simple approach outperforms previous RGTG methods and achieves similar performance as strong offline baselines but without large-scale LLM finetuning.


title: TRANSP integrated modeling code for interpretive and predictive analysis of tokamak plasmas

abstract: This paper provides a comprehensive review of the TRANSP code, a sophisticated tool for interpretive and predictive analysis of tokamak plasmas, detailing its major capabilities and features. It describes the equations for particle, power, and momentum balance analysis, as well as the poloidal field diffusion equations. The paper outlines the spatial and time grids used in TRANSP and details the equilibrium assumptions and solvers. Various models for heating and current drive, including updates to the NUBEAM model, are discussed. The handling of large-scale events such as sawtooth crashes and pellet injections is examined, along with the predictive capabilities for advancing plasma profiles. The integration of TRANSP with the ITER Integrated Modeling and Analysis Suite (IMAS) is highlighted, demonstrating enhanced data access and analysis capabilities. Additionally, the paper discusses best practices and continuous integration techniques to enhance TRANSP's robustness. The suite of TRANSP tools, designed for efficient data analysis and simulation, further supports the optimization of tokamak operations and coupling with other tokamak codes. Continuous development and support ensure that TRANSP remains a major code for the analysis of experimental data for controlled thermonuclear fusion, maintaining its critical role in supporting the optimization of tokamak operations and advancing fusion research.


title: Wideband tunable cavity development for axion dark matter searches using a piezoelectric motor in combination with gears

abstract: Most search experiments sensitive to quantum chromodynamics axion dark matter benefit from microwave cavities, as electromagnetic resonators, that enhance the detected axion signal power and thus the experimental sensitivity drastically. As the possible axion mass spans multiple orders of magnitude, microwave cavities must be tunable and it is desirable for the cavity to have a tunable frequency range that is as wide as possible. Since the tunable frequency range generally increases as the dimension of the conductor tuning rod increases for a given cylindrical conductor cavity system, we developed a cavity system with a large dimensional tuning rod in order to increase this. We, for the first time, employed not only a piezoelectric motor, but also gears to drive a large and accordingly heavy tuning rod, where such a combination to increase driving power can be adopted for extreme environments as is the case for axion dark matter experiments: cryogenic, high-magnetic-field, and high vacuum. Thanks to such higher power derived from the piezoelectric motor and gear combination, we realized a wideband tunable cavity whose frequency range is about 42\% of the central resonant frequency of the cavity, without sacrificing the experimental sensitivity too much.


title: One-sided H alpha Excess before the First Pericentre Passage in Galaxy Pairs

abstract: We present novel insights into the interplay between tidal forces and star formation in interacting galaxies before their first pericentre passage. We investigate seven close pair galaxies devoid of visible tidal disturbances, such as tails, bridges, and shells. Using integral field spectroscopy (IFS) data of extended Calar Alto Legacy Integral Field Area (eCALIFA), we unveil a previously unreported phenomenon: H alhpa emission, a proxy for recent star formation, exhibits a significant enhancement in regions facing the companion galaxy, reaching up to 1.9 times higher flux compared to opposite directions. Notably, fainter companions within pairs display a more pronounced one-sided H alpha excess, exceeding the typical range observed in isolated galaxies with 2 sigma confidence level. Furthermore, the observed H alpha excess in fainter companion galaxies exhibits a heightened prominence at the outer galactic regions. These findings suggest that tidal forces generated before the first pericentre passage exert a stronger influence on fainter galaxies due to their shallower potential wells by their brighter companions. This unveils a more intricate interplay between gravitational interactions and star formation history within interacting galaxies than previously understood, highlighting the need further to explore the early stages of interaction in galaxy evolution.


title: Characterization of Acoustic Losses in Interdigitated VHF to mmWave Piezoelectric M/NEMS Resonators

abstract: This work reports on a technology-agnostic and frequency-independent methodology combining a-priori modeling, Finite Element Analysis (FEA), and experimental results for the characterization of acoustic losses in interdigitated piezoelectric micro- and nano-electromechanical (M/NEMS) resonators. The proposed approach models the mechanical quality factor (Qm) and its dependency on piezoelectric (Qpiezo) and metal (Qmetal) acoustic losses, as a function of the mode of vibration dispersion characteristics. The model is finally experimentally validated by exploiting the intrinsic on-chip multifrequency manufacturability of interdigitated devices. A broad range of available resonator technologies, frequencies, and piezoelectric materials are investigated for this purpose, including bulk X-cut Lithium Niobate (XLN) leaky surface acoustic wave resonators operating at Ultra High Frequency (UHF), thin film XLN Lamb Wave resonators spanning between Very High Frequency (VHF) and the Ku band, and Aluminum Nitride (AlN) and scandium-doped AlN (ScAlN) cross-sectional lame' mode resonators ranging from the Ku to Ka band (mmWave).


title: From Variance to Veracity: Unbundling and Mitigating Gradient Variance in Differentiable Bundle Adjustment Layers

abstract: Various pose estimation and tracking problems in robotics can be decomposed into a correspondence estimation problem (often computed using a deep network) followed by a weighted least squares optimization problem to solve for the poses. Recent work has shown that coupling the two problems by iteratively refining one conditioned on the other's output yields SOTA results across domains. However, training these models has proved challenging, requiring a litany of tricks to stabilize and speed up training. In this work, we take the visual odometry problem as an example and identify three plausible causes: (1) flow loss interference, (2) linearization errors in the bundle adjustment (BA) layer, and (3) dependence of weight gradients on the BA residual. We show how these issues result in noisy and higher variance gradients, potentially leading to a slow down in training and instabilities. We then propose a simple, yet effective solution to reduce the gradient variance by using the weights predicted by the network in the inner optimization loop to weight the correspondence objective in the training problem. This helps the training objective `focus' on the more important points, thereby reducing the variance and mitigating the influence of outliers. We show that the resulting method leads to faster training and can be more flexibly trained in varying training setups without sacrificing performance. In particular we show $2$--$2.5\times$ training speedups over a baseline visual odometry model we modify.


title: Field Test of Quantum Key Distribution with High Key Creation Efficiency

abstract: Quantumkey distribution (QKD) promises unconditional security for communication. However, the random choices of the measurement basis in QKD usually result in low key creation efficiency. This drawback is overcome in the differential-phase-shift QKD, provided that each photon can be prepared in a large number of time bins with a proper waveform. In this work we develop a miniature 1550-nm single-photon source to generate narrowband single photon in 50 time bins with a nearly optimal waveform for achieving unity key creation efficiency. By utilizing these single photons in the field test, we demonstrate the differential-phase-shift QKD with a key creation efficiency of 97%. Our work shows that the practical QKD can benefit from the narrowband single photons with controllable waveforms.


title: A Diagnostic Tool for Functional Causal Discovery

abstract: Causal discovery methods aim to determine the causal direction between variables using observational data. Functional causal discovery methods, such as those based on the Linear Non-Gaussian Acyclic Model (LiNGAM), rely on structural and distributional assumptions to infer the causal direction. However, approaches for assessing causal discovery methods' performance as a function of sample size or the impact of assumption violations, inevitable in real-world scenarios, are lacking. To address this need, we propose Causal Direction Detection Rate (CDDR) diagnostic that evaluates whether and to what extent the interaction between assumption violations and sample size affects the ability to identify the hypothesized causal direction. Given a bivariate dataset of size N on a pair of variables, X and Y, CDDR diagnostic is the plotted comparison of the probability of each causal discovery outcome (e.g. X causes Y, Y causes X, or inconclusive) as a function of sample size less than N. We fully develop CDDR diagnostic in a bivariate case and demonstrate its use for two methods, LiNGAM and our new test-based causal discovery approach. We find CDDR diagnostic for the test-based approach to be more informative since it uses a richer set of causal discovery outcomes. Under certain assumptions, we prove that the probability estimates of detecting each possible causal discovery outcome are consistent and asymptotically normal. Through simulations, we study CDDR diagnostic's behavior when linearity and non-Gaussianity assumptions are violated. Additionally, we illustrate CDDR diagnostic on four real datasets, including three for which the causal direction is known.


title: Immersibility of manifolds is decidable in odd codimension

abstract: Given a smooth map $f:M\rightarrow N$ of closed oriented smooth manifolds, is there an immersion homotopic to $f$? We provide an algorithm that decides this when the codimension of the manifolds is odd.


title: A posteriori error estimates for the exponential midpoint method for linear and semilinear parabolic equations

abstract: In this paper, the a posteriori error estimates of the exponential midpoint method for time discretization are studied for linear and semilinear parabolic equations. Using the exponential midpoint approximation defined by a continuous and piecewise linear interpolation of nodal values yields the suboptimal order estimates. Based on the property of the entire function, we introduce a continuous and piecewise quadratic time reconstruction of the exponential midpoint method to derive the optimal order estimates, and the error bounds are solely dependent on the discretization parameters, the data of the problem and the approximation of the entire function. Several numerical examples are implemented to illustrate the theoretical results.


title: Hierarchical Neural Networks, p-Adic PDEs, and Applications to Image Processing

abstract: The first goal of this article is to introduce a new type of p-adic reaction-diffusion cellular neural network with delay. We study the stability of these networks and provide numerical simulations of their responses. The second goal is to provide a quick review of the state of the art of p-adic cellular neural networks and their applications to image processing.


title: Judging the Judges: A Systematic Investigation of Position Bias in Pairwise Comparative Assessments by LLMs

abstract: LLM-as-a-Judge offers a promising alternative to human judges across various tasks, yet inherent biases, particularly position bias - a systematic preference for answers based on their position in the prompt - compromise its effectiveness. Our study investigates this issue by developing a framework to systematically study and quantify position bias using metrics such as repetitional consistency, positional consistency, and positional fairness. We conduct experiments with 9 judge models across 22 tasks from the MTBench and DevBench benchmarks and nearly 40 answer-generating models, generating approximately 80,000 evaluation instances. This comprehensive assessment reveals significant variations in bias across judges and tasks. Although GPT-4 often excels in positional consistency and fairness, some more cost-effective models perform comparably or even better in specific tasks, highlighting essential trade-offs between consistency, fairness, and cost. Our results also demonstrate high consistency of judgment across repetitions, confirming that position bias is not due to random variations. This research significantly contributes to the field by introducing new concepts for understanding position bias and providing a multi-dimensional framework for evaluation. These insights guide the selection of optimal judge models, enhance benchmark design, and lay the foundation for future research into effective debiasing strategies, ultimately enhancing the reliability of LLM evaluators.


title: Hierarchical Patch Diffusion Models for High-Resolution Video Generation

abstract: Diffusion models have demonstrated remarkable performance in image and video synthesis. However, scaling them to high-resolution inputs is challenging and requires restructuring the diffusion pipeline into multiple independent components, limiting scalability and complicating downstream applications. This makes it very efficient during training and unlocks end-to-end optimization on high-resolution videos. We improve PDMs in two principled ways. First, to enforce consistency between patches, we develop deep context fusion -- an architectural technique that propagates the context information from low-scale to high-scale patches in a hierarchical manner. Second, to accelerate training and inference, we propose adaptive computation, which allocates more network capacity and computation towards coarse image details. The resulting model sets a new state-of-the-art FVD score of 66.32 and Inception Score of 87.68 in class-conditional video generation on UCF-101 $256^2$, surpassing recent methods by more than 100%. Then, we show that it can be rapidly fine-tuned from a base $36\times 64$ low-resolution generator for high-resolution $64 \times 288 \times 512$ text-to-video synthesis. To the best of our knowledge, our model is the first diffusion-based architecture which is trained on such high resolutions entirely end-to-end. Project webpage: https://snap-research.github.io/hpdm.


title: Data-driven confidence bound for structural response using segmented least squares: a mixed-integer programming approach

abstract: As one of data-driven approaches to computational mechanics in elasticity, this paper presents a method finding a bound for structural response, taking uncertainty in a material data set into account. For construction of an uncertainty set, we adopt the segmented least squares so that a data set that is not fitted well by the linear regression model can be dealt with. Since the obtained uncertainty set is nonconvex, the optimization problem solved for the uncertainty analysis is nonconvex. We recast this optimization problem as a mixed-integer programming problem to find a global optimal solution. This global optimality, together with a fundamental property of the order statistics, guarantees that the obtained bound for the structural response is conservative, in the sense that, at least a specified confidence level, probability that the structural response is in this bound is no smaller than a specified target value. We present numerical examples for three different types of skeletal structures.


title: Making Task-Oriented Dialogue Datasets More Natural by Synthetically Generating Indirect User Requests

abstract: Indirect User Requests (IURs), such as "It's cold in here" instead of "Could you please increase the temperature?" are common in human-human task-oriented dialogue and require world knowledge and pragmatic reasoning from the listener. While large language models (LLMs) can handle these requests effectively, smaller models deployed on virtual assistants often struggle due to resource constraints. Moreover, existing task-oriented dialogue benchmarks lack sufficient examples of complex discourse phenomena such as indirectness. To address this, we propose a set of linguistic criteria along with an LLM-based pipeline for generating realistic IURs to test natural language understanding (NLU) and dialogue state tracking (DST) models before deployment in a new domain. We also release IndirectRequests, a dataset of IURs based on the Schema Guided Dialog (SGD) corpus, as a comparative testbed for evaluating the performance of smaller models in handling indirect requests.


title: The smith normal form of the walk matrix of the Dynkin graph $A_n$

abstract: In this paper, we give the rank of the walk matrix of the Dynkin graph $A_n$, and prove that its Smith normal form is $$\diag(\underbrace{1,\ldots,1}_{\lceil\frac{n}{2}\rceil},0,\ldots,0).$$


title: Battling Botpoop using GenAI for Higher Education: A Study of a Retrieval Augmented Generation Chatbots Impact on Learning

abstract: Generative artificial intelligence (GenAI) and large language models (LLMs) have simultaneously opened new avenues for enhancing human learning and increased the prevalence of poor-quality information in student response - termed Botpoop. This study introduces Professor Leodar, a custom-built, Singlish-speaking Retrieval Augmented Generation (RAG) chatbot designed to enhance educational while reducing Botpoop. Deployed at Nanyang Technological University, Singapore, Professor Leodar offers a glimpse into the future of AI-assisted learning, offering personalized guidance, 24/7 availability, and contextually relevant information. Through a mixed-methods approach, we examine the impact of Professor Leodar on learning, engagement, and exam preparedness, with 97.1% of participants reporting positive experiences. These findings help define possible roles of AI in education and highlight the potential of custom GenAI chatbots. Our combination of chatbot development, in-class deployment and outcomes study offers a benchmark for GenAI educational tools and is a stepping stone for redefining the interplay between AI and human learning.


title: Real-time Deformation Correction in Additively Printed Flexible Antenna Arrays

abstract: Conformal phased arrays provide multiple degrees of freedom to the scan angle, which is typically limited by antenna aperture in rigid arrays. Silicon-based RF signal processing offers reliable, reconfigurable, multi-functional, and compact control for conformal phased arrays that can be used for on-the-move communication. While the lightweight, compactness, and shape-changing properties of the conformal phased arrays are attractive, these features result in dynamic deformation of the array during motion leading to significant dynamic beam pointing errors. We propose a silicon-based, compact, reconfigurable solution to self-correct these dynamic deformation-induced beam pointing errors. Furthermore, additive printing is leveraged to enhance the flexibility of the conformal phased arrays, as the printed conductive ink is more flexible than bulk copper and can be easily deposited on flexible sheets using different printing tools, providing an environmentally-friendly solution for large-scale production. The inks such as conventional silver inks are expensive and copper-based printable inks suffer from spontaneous metal oxidation that alters trace impedance and degrades beamforming performance. This work uses a low-cost molecular copper decomposition ink with reliable RF properties at different temperature and strain to print the proposed intelligent conformal phased array operating at 2.1 GHz. Proof-of-concept prototype $2\times2$ array self-corrects the deformation induces beampointing error with an error $<1.25^\circ$. The silicon based array processing part occupying only 2.58 mm$^2$ area and 83 mW power per tile.


title: Automatic detection of large-scale flux ropes and their geoeffectiveness with a machine learning approach

abstract: Detecting large-scale flux ropes (FRs) embedded in interplanetary coronal mass ejections (ICMEs) and assessing their geoeffectiveness are essential since they can drive severe space weather. At 1 au, these FRs have an average duration of 1 day. Their most common magnetic features are large, smoothly rotating magnetic fields. Their manual detection has become a relatively common practice over decades, although visual detection can be time-consuming and subject to observer bias. Our study proposes a pipeline that utilizes two supervised binary-classification machine learning (ML) models trained with solar wind magnetic properties to automatically detect large-scale FRs and additionally determine their geoeffectiveness. The first model is used to generate a list of auto-detected FRs. Using the properties of southward magnetic field the second model determines the geoeffectiveness of FRs. Our method identifies 88.6\% and 80\% large-scale ICMEs (duration $\ge 1$ day) observed at 1 au by Wind and Sun Earth Connection Coronal and Heliospheric Investigation (STEREO) mission, respectively. While testing with a continuous solar wind data obtained from Wind, our pipeline detected 56 of the 64 large-scale ICMEs during 2008 - 2014 period (recall= 0.875) but many false positives (precision= 0.56) as we do not take into account any additional solar wind properties than the magnetic properties. We found an accuracy of 0.88 when estimating the geoeffectiveness of the auto-detected FRs using our method. Thus, in space weather now-casting and forecasting at L1 or any planetary missions, our pipeline can be utilized to offer a first-order detection of large-scale FRs and geoeffectiveness.


title: Counting independent sets in structured graphs

abstract: Counting independent sets in graphs and hypergraphs under a variety of restrictions is a classical question with a long history. It is the subject of the celebrated container method which found numerous spectacular applications over the years. We consider the question of how many independent sets we can have in a graph under structural restrictions. We show that any $n$-vertex graph with independence number $\alpha$ without $bK_a$ as an induced subgraph has at most $n^{O(1)} \cdot \alpha^{O(\alpha)}$ independent sets. This substantially improves the trivial upper bound of $n^{\alpha},$ whenever $\alpha \le n^{o(1)}$ and gives a characterization of graphs forbidding of which allows for such an improvement. It is also in general tight up to a constant in the exponent since there exist triangle-free graphs with $\alpha^{\Omega(\alpha)}$ independent sets. We also prove that if one in addition assumes the ground graph is chi-bounded one can improve the bound to $n^{O(1)} \cdot 2^{O(\alpha)}$ which is tight up to a constant factor in the exponent.


title: Regularizing and Aggregating Clients with Class Distribution for Personalized Federated Learning

abstract: Personalized federated learning (PFL) enables customized models for clients with varying data distributions. However, existing PFL methods often incur high computational and communication costs, limiting their practical application. This paper proposes a novel PFL method, Class-wise Federated Averaging (cwFedAVG), that performs Federated Averaging (FedAVG) class-wise, creating multiple global models per class on the server. Each local model integrates these global models weighted by its estimated local class distribution, derived from the L2-norms of deep network weights, avoiding privacy violations. Afterward, each global model does the same with local models using the same method. We also newly designed Weight Distribution Regularizer (WDR) to further enhance the accuracy of estimating a local class distribution by minimizing the Euclidean distance between the class distribution and the weight norms' distribution. Experimental results demonstrate that cwFedAVG matches or outperforms several existing PFL methods. Notably, cwFedAVG is conceptually simple yet computationally efficient as it mitigates the need for extensive calculation to collaborate between clients by leveraging shared global models. Visualizations provide insights into how cwFedAVG enables local model specialization on respective class distributions while global models capture class-relevant information across clients.


title: PolySpeech: Exploring Unified Multitask Speech Models for Competitiveness with Single-task Models

abstract: Recently, there have been attempts to integrate various speech processing tasks into a unified model. However, few previous works directly demonstrated that joint optimization of diverse tasks in multitask speech models has positive influence on the performance of individual tasks. In this paper we present a multitask speech model -- PolySpeech, which supports speech recognition, speech synthesis, and two speech classification tasks. PolySpeech takes multi-modal language model as its core structure and uses semantic representations as speech inputs. We introduce semantic speech embedding tokenization and speech reconstruction methods to PolySpeech, enabling efficient generation of high-quality speech for any given speaker. PolySpeech shows competitiveness across various tasks compared to single-task models. In our experiments, multitask optimization achieves performance comparable to single-task optimization and is especially beneficial for specific tasks.


title: Bottlenecking in graphs and a coarse Menger-type theorem

abstract: We expand upon the notion of bottlenecking introduced in our earlier work, characterizing a spectrum of graphs and showing that this naturally extends to a concept of coarse bottlenecking. We examine how bottlenecking differs from other notions of connectedness. We show how the notion of bottlenecking provides a different approach to coarsening measures of connectedness than the Coarse Menger Conjecture proposed independently by Georgakopoulos and Papasoglu as well as Albrechtsen, Huynh, Jacobs, Knappe, and Wollan, which was recently disproved by a counterexample. We give a proof of a coarse Menger-type theorem for the class of coarsely bottlenecked graphs, and provide a conjecture that would extend this to all graphs.


title: EmoSphere-TTS: Emotional Style and Intensity Modeling via Spherical Emotion Vector for Controllable Emotional Text-to-Speech

abstract: Despite rapid advances in the field of emotional text-to-speech (TTS), recent studies primarily focus on mimicking the average style of a particular emotion. As a result, the ability to manipulate speech emotion remains constrained to several predefined labels, compromising the ability to reflect the nuanced variations of emotion. In this paper, we propose EmoSphere-TTS, which synthesizes expressive emotional speech by using a spherical emotion vector to control the emotional style and intensity of the synthetic speech. Without any human annotation, we use the arousal, valence, and dominance pseudo-labels to model the complex nature of emotion via a Cartesian-spherical transformation. Furthermore, we propose a dual conditional adversarial network to improve the quality of generated speech by reflecting the multi-aspect characteristics. The experimental results demonstrate the model ability to control emotional style and intensity with high-quality expressive speech.


title: The maximum likelihood type estimator of SDEs with fractional Brownian motion under small noise asymptotics in the rough case

abstract: We study the problem of parametric estimation for continuously observed stochastic differential equation driven by fractional Brownian motion. Under some assumptions on drift and diffusion coefficients, we construct maximum likelihood estimator and establish its the asymptotic normality and moment convergence of the drift parameter when a small dispersion coefficient vanishes.


title: Wiser than the Wisest of Crowds: The Asch Effect Revisited under Friedkin-Johnsen Opinion Dynamics

abstract: In 1907, Sir Francis Galton independently asked 787 villagers to estimate the weight of an ox. Although none of them guessed the exact weight, the average estimate was remarkably accurate. This phenomenon is known as wisdom of crowds. In a clever experiment, Asch employed actors to demonstrate the human tendency to conform to others' opinions. The question we ask is: what would Sir Francis Galton have observed if Asch had interfered by employing actors? Would the wisdom of crowds become even wiser or not? The problem becomes intriguing when considering the inter-connectedness of the villagers, which is the central theme of this work. We examine a scenario where $n$ agents are interconnected and influence each other. The average of their opinions provides an estimator of a certain quality for some unknown quantity. How can one improve or reduce the quality of the original estimator in terms of the MSE by utilizing Asch's strategy of hiring a few stooges? We present a new formulation of this problem, assuming that nodes adjust their opinions according to the Friedkin-Johnsen opinion dynamics. We demonstrate that selecting $k$ stooges for maximizing and minimizing the MSE is NP-hard. We also demonstrate that our formulation is closely related to maximizing or minimizing polarization and show NP-hardness. We propose an efficient greedy heuristic that scales to large networks and test our algorithm on synthetic and real-world datasets. Although MSE and polarization objectives differ, we find in practice that maximizing polarization often yields solutions that are nearly optimal for minimizing the wisdom of crowds in terms of MSE. Our analysis of real-world data reveals that even a small number of stooges can significantly influence the conversation on the war in Ukraine, resulting in a relative increase of the MSE of 207.80% (maximization) or a decrease of 50.62% (minimization).


title: Probing the Shock Breakout Signal of SN 2024ggi from the Transformation of Early Flash Spectroscopy

abstract: We present early-time, hour-to-day cadence spectroscopy of the nearby type II supernova (SN II) 2024ggi, which was discovered at a phase when the SN shock just emerged from the red-supergiant (RSG) progenitor star. Over the first few days after the first light, SN\,2024ggi exhibited prominent narrow emission lines formed through intense and persistent photoionization of the nearby circumstellar material (CSM). In the first 63 hours, spectral lines of He, C, N, and O revealed a rapid rise in ionization, as a result of the progressive sweeping-up of the CSM by the shock. The duration of the IIn-like spectra indicates a dense and relatively confined CSM distribution extending up to $\sim\,4\,\times\,10^{14}$\,cm. Spectral modeling reveals a CSM mass loss rate at this region exceeding $5 \times\, 10^{-3}$\,\Msun\,yr$^{-1}$\,is required to reproduce low-ionization emissions, which dramatically exceeds that of an RSG. Analyzing H$\alpha$ emission shift implies the velocity of the unshocked outer CSM to be between 20 and 40 \kms, matching the typical wind velocity of an RSG. The differences between the inner and outer layers of the CSM and an RSG progenitor highlight a complex mass loss history before the explosion of SN 2024ggi.


title: Dynamic Energy-Saving Design for Double-Faced Active RIS Assisted Communications with Perfect/Imperfect CSI

abstract: Although the emerging reconfigurable intelligent surface (RIS) paves a new way for next-generation wireless communications, it suffers from inherent flaws, i.e., double-fading attenuation effects and half-space coverage limitations. The state-of-the-art double-face active (DFA)-RIS architecture is proposed for significantly amplifying and transmitting incident signals in full-space. Despite the efficacy of DFA-RIS in mitigating the aforementioned flaws, its potential drawback is that the complex active hardware also incurs intolerable energy consumption. To overcome this drawback, in this paper we propose a novel dynamic energy-saving design for the DFA-RIS, called the sub-array based DFA-RIS architecture. This architecture divides the DFA-RIS into multiple sub-arrays, where the signal amplification function in each sub-array can be activated/deactivated dynamically and flexibly. Utilizing the above architecture, we develop the joint optimization scheme based on transmit beamforming, DFA-RIS configuration, and reflection amplifier (RA) operating pattern to maximize the energy efficiency (EE) of the DFA-RIS assisted multiuser MISO system considering the perfect/imperfect channel state information (CSI) case. Then, the penalty dual decomposition (PDD) based alternating optimization (AO) algorithm and the constrained stochastic majorization-minimization (CSMM) based AO algorithm address non-convex problems in the perfect/imperfect CSI case, respectively. Simulation results verified that our proposed sub-array based DFA-RIS architecture can benefit the EE of the system more than other RIS architectures.


title: Coexistence of ferroelectric and ferrielectric phases in ultrathin antiferroelectric PbZrO3 thin films

abstract: Whereas ferroelectricity may vanish in ultra-thin ferroelectric films, it is expected to emerge in ultra-thin anti-ferroelectric films, sparking people's interest in using antiferroelectric materials as an alternative to ferroelectric ones for high-density data storage applications. Lead Zirconate (PbZrO3) is considered the prototype material for antiferroelectricity, and indeed previous studies indicated that nanoscale PbZrO3 films exhibit ferroelectricity. The understanding of such phenomena from the microstructure aspect is crucial but still lacking. In this study, we fabricated a PbZrO3 film with thicknesses varying from 5 nm to 80 nm. Using Piezoresponse Force Microscopy, we discovered the film displayed a transition from antiferroelectric behaviour in the thicker areas to ferroelectric behaviour in the thinner ones, with a critical thickness between 10 and 15 nm. In this critical thickness range, a 12 nm PZO thin film was chosen for further study using aberration-corrected scanning transmission electron microscopy. The investigation showed that the film comprises both ferroelectric and ferrielectric phases. The ferroelectric phase is characterized by polarisation along the pseudocubic [011] projection direction. The positions of Pb, Zr, and O were determined using the integrated differential phase contrast method. This allowed us to ascertain that the ferroelectric PbZrO3 unit cell is half the size of that in the antiferroelectric phase on the ab plane. The observed unit cell is different from the electric field-induced ferroelectric rhombohedral phases. Additionally, we identified a ferrielectric phase with a unique up-up-zero-zero dipole configuration. The finding is crucial for understanding the performance of ultrathin antiferroelectric thin films and the subsequent design and development of antiferroelectric devices.


title: Did Harold Zuercher Have Time-Separable Preferences?

abstract: This paper proposes an empirical model of dynamic discrete choice to allow for non-separable time preferences, generalizing the well-known Rust (1987) model. Under weak conditions, we show the existence of value functions and hence well-defined optimal choices. We construct a contraction mapping of the value function and propose an estimation method similar to Rust's nested fixed point algorithm. Finally, we apply the framework to the bus engine replacement data. We improve the fit of the data with our general model and reject the null hypothesis that Harold Zuercher has separable time preferences. Misspecifying an agent's preference as time-separable when it is not leads to biased inferences about structure parameters (such as the agent's risk attitudes) and misleading policy recommendations.


title: Colouring isonemal fabrics with more than two colours and non-twilly redundancy

abstract: Perfect colouring of isonemal fabrics by thin and thick striping of warp and weft with more than two colours is examined where the cells with warps and wefts of the same colour do not appear along diagonal lines (not twilly redundancy). In species 33 to 39, all fabrics of specific orders (linear periods) can be perfectly coloured by thin striping with satin redundancy. In fewer species, all fabrics of specific orders can be perfectly coloured by thick striping in two different ways with doubled satin redundancy. The isonemal fabric 6-1-1 can be used as a redundancy configuration. All these colourings allow the coloured weaving of flat tori and -- a few of them -- cubes.


title: Evolutionary Computation and Explainable AI: A Roadmap to Transparent Intelligent Systems

abstract: AI methods are finding an increasing number of applications, but their often black-box nature has raised concerns about accountability and trust. The field of explainable artificial intelligence (XAI) has emerged in response to the need for human understanding of AI models. Evolutionary computation (EC), as a family of powerful optimization and learning tools, has significant potential to contribute to XAI. In this paper, we provide an introduction to XAI and review various techniques in current use for explaining machine learning (ML) models. We then focus on how EC can be used in XAI, and review some XAI approaches which incorporate EC techniques. Additionally, we discuss the application of XAI principles within EC itself, examining how these principles can shed some light on the behavior and outcomes of EC algorithms in general, on the (automatic) configuration of these algorithms, and on the underlying problem landscapes that these algorithms optimize. Finally, we discuss some open challenges in XAI and opportunities for future research in this field using EC. Our aim is to demonstrate that EC is well-suited for addressing current problems in explainability and to encourage further exploration of these methods to contribute to the development of more transparent and trustworthy ML models and EC algorithms.


title: To be Continuous, or to be Discrete, Those are Bits of Questions

abstract: Recently, binary representation has been proposed as a novel representation that lies between continuous and discrete representations. It exhibits considerable information-preserving capability when being used to replace continuous input vectors. In this paper, we investigate the feasibility of further introducing it to the output side, aiming to allow models to output binary labels instead. To preserve the structural information on the output side along with label information, we extend the previous contrastive hashing method as structured contrastive hashing. More specifically, we upgrade CKY from label-level to bit-level, define a new similarity function with span marginal probabilities, and introduce a novel contrastive loss function with a carefully designed instance selection strategy. Our model achieves competitive performance on various structured prediction tasks, and demonstrates that binary representation can be considered a novel representation that further bridges the gap between the continuous nature of deep learning and the discrete intrinsic property of natural languages.


title: Evaluating the Impact of Sequence Combinations on Breast Tumor Segmentation in Multiparametric MRI

abstract: Multiparametric magnetic resonance imaging (mpMRI) is a key tool for assessing breast cancer progression. Although deep learning has been applied to automate tumor segmentation in breast MRI, the effect of sequence combinations in mpMRI remains under-investigated. This study explores the impact of different combinations of T2-weighted (T2w), dynamic contrast-enhanced MRI (DCE-MRI) and diffusion-weighted imaging (DWI) with apparent diffusion coefficient (ADC) map on breast tumor segmentation using nnU-Net. Evaluated on a multicenter mpMRI dataset, the nnU-Net model using DCE sequences achieved a Dice similarity coefficient (DSC) of 0.69 $\pm$ 0.18 for functional tumor volume (FTV) segmentation. For whole tumor mask (WTM) segmentation, adding the predicted FTV to DWI and ADC map improved the DSC from 0.57 $\pm$ 0.24 to 0.60 $\pm$ 0.21. Adding T2w did not yield significant improvement, which still requires further investigation under a more standardized imaging protocol. This study serves as a foundation for future work on predicting breast cancer treatment response using mpMRI.


title: Collective Constitutional AI: Aligning a Language Model with Public Input

abstract: There is growing consensus that language model (LM) developers should not be the sole deciders of LM behavior, creating a need for methods that enable the broader public to collectively shape the behavior of LM systems that affect them. To address this need, we present Collective Constitutional AI (CCAI): a multi-stage process for sourcing and integrating public input into LMs-from identifying a target population to sourcing principles to training and evaluating a model. We demonstrate the real-world practicality of this approach by creating what is, to our knowledge, the first LM fine-tuned with collectively sourced public input and evaluating this model against a baseline model trained with established principles from a LM developer. Our quantitative evaluations demonstrate several benefits of our approach: the CCAI-trained model shows lower bias across nine social dimensions compared to the baseline model, while maintaining equivalent performance on language, math, and helpful-harmless evaluations. Qualitative comparisons of the models suggest that the models differ on the basis of their respective constitutions, e.g., when prompted with contentious topics, the CCAI-trained model tends to generate responses that reframe the matter positively instead of a refusal. These results demonstrate a promising, tractable pathway toward publicly informed development of language models.


title: Are Large Language Models Good Statisticians?

abstract: Large Language Models (LLMs) have demonstrated impressive capabilities across a range of scientific tasks including mathematics, physics, and chemistry. Despite their successes, the effectiveness of LLMs in handling complex statistical tasks remains systematically under-explored. To bridge this gap, we introduce StatQA, a new benchmark designed for statistical analysis tasks. StatQA comprises 11,623 examples tailored to evaluate LLMs' proficiency in specialized statistical tasks and their applicability assessment capabilities, particularly for hypothesis testing methods. We systematically experiment with representative LLMs using various prompting strategies and show that even state-of-the-art models such as GPT-4o achieve a best performance of only 64.83%, indicating significant room for improvement. Notably, while open-source LLMs (e.g. LLaMA-3) show limited capability, those fine-tuned ones exhibit marked improvements, outperforming all in-context learning-based methods (e.g. GPT-4o). Moreover, our comparative human experiments highlight a striking contrast in error types between LLMs and humans: LLMs primarily make applicability errors, whereas humans mostly make statistical task confusion errors. This divergence highlights distinct areas of proficiency and deficiency, suggesting that combining LLM and human expertise could lead to complementary strengths, inviting further investigation into their collaborative potential.


title: Spoof Diarization: "What Spoofed When" in Partially Spoofed Audio

abstract: This paper defines Spoof Diarization as a novel task in the Partial Spoof (PS) scenario. It aims to determine what spoofed when, which includes not only locating spoof regions but also clustering them according to different spoofing methods. As a pioneering study in spoof diarization, we focus on defining the task, establishing evaluation metrics, and proposing a benchmark model, namely the Countermeasure-Condition Clustering (3C) model. Utilizing this model, we first explore how to effectively train countermeasures to support spoof diarization using three labeling schemes. We then utilize spoof localization predictions to enhance the diarization performance. This first study reveals the high complexity of the task, even in restricted scenarios where only a single speaker per audio file and an oracle number of spoofing methods are considered. Our code is available at https://github.com/nii-yamagishilab/PartialSpoof.


title: scores: A Python package for verifying and evaluating models and predictions with xarray and pandas

abstract: `scores` is a Python package containing mathematical functions for the verification, evaluation and optimisation of forecasts, predictions or models. It primarily supports the geoscience communities; in particular, the meteorological, climatological and oceanographic communities. In addition to supporting the Earth system science communities, it also has wide potential application in machine learning and other domains such as economics. `scores` not only includes common scores (e.g. Mean Absolute Error), it also includes novel scores not commonly found elsewhere (e.g. FIxed Risk Multicategorical (FIRM) score, Flip-Flop Index), complex scores (e.g. threshold-weighted continuous ranked probability score), and statistical tests (such as the Diebold Mariano test). It also contains isotonic regression which is becoming an increasingly important tool in forecast verification and can be used to generate stable reliability diagrams. Additionally, it provides pre-processing tools for preparing data for scores in a variety of formats including cumulative distribution functions (CDF). At the time of writing, `scores` includes over 50 metrics, statistical techniques and data processing tools. All of the scores and statistical techniques in this package have undergone a thorough scientific and software review. Every score has a companion Jupyter Notebook tutorial that demonstrates its use in practice. `scores` primarily supports `xarray` datatypes for Earth system data, allowing it to work with NetCDF4, HDF5, Zarr and GRIB data sources among others. `scores` uses Dask for scaling and performance. It has expanding support for `pandas`. The software repository can be found at https://github.com/nci/scores/


title: Single MoS2-flake as a high TCR non-cryogenic bolometer

abstract: Temperature coefficient of resistance (TCR) of a bolometer can be tuned by modifying the thermal conductance of an absorbing materials since they sense radiations via the temperature change in the absorber. However, the thermal conductance of the absorber can be reduced by engineering the appropriate thermal isolation, which can be an ultimate solution towards making a highly sensitive thermal detector. Here, we have developed an atomically thin 2D bolometer detector made up of a mechanically transferred suspended multilayer-MoS2 flake, eliminating the use of challenging thin-film fabrication process. The strength of our detector lies on the two factors: its large surface-to-volume window to absorb the radiations; the suspended configuration which prevents the heat dissipation through the substrate and therefore reduces the thermal conductance. The bolometric response of the detector is tested in both modes, via the photoresponse and the thermal response. The prototype is found to exhibit a very high TCR ~ -9.5%/K with the least achievable thermal noise-equivalent power (NEP) ~ 0.61 pWHz-1/2, in ambient conditions at 328 K.

categories: physics.app-ph cond-mat.mtrl-sci physics.ins-det physics.optics


title: Neon tetra fish (Paracheirodon innesi) as farm-to-optical-table Bragg reflectors

abstract: Iridophore networks in the skin of neon tetra fish are investigated for use as biologically sourced, tunable, Bragg reflector arrays. This paper reports on a method for immediate and fast post-processing of tissue to modify the structural color of iridophores found in the lateral color stripe. Conditions for fixation as well as the environment post-fixation to improve longevity of the structural color are also presented. Recent results from attempts to further increase the lifetime of post-mortem iridophore color through infiltration and embedding in low-acid glycol methacrylate are also discussed.


title: Are Objective Explanatory Evaluation metrics Trustworthy? An Adversarial Analysis

abstract: Explainable AI (XAI) has revolutionized the field of deep learning by empowering users to have more trust in neural network models. The field of XAI allows users to probe the inner workings of these algorithms to elucidate their decision-making processes. The rise in popularity of XAI has led to the advent of different strategies to produce explanations, all of which only occasionally agree. Thus several objective evaluation metrics have been devised to decide which of these modules give the best explanation for specific scenarios. The goal of the paper is twofold: (i) we employ the notions of necessity and sufficiency from causal literature to come up with a novel explanatory technique called SHifted Adversaries using Pixel Elimination(SHAPE) which satisfies all the theoretical and mathematical criteria of being a valid explanation, (ii) we show that SHAPE is, infact, an adversarial explanation that fools causal metrics that are employed to measure the robustness and reliability of popular importance based visual XAI methods. Our analysis shows that SHAPE outperforms popular explanatory techniques like GradCAM and GradCAM++ in these tests and is comparable to RISE, raising questions about the sanity of these metrics and the need for human involvement for an overall better evaluation.


title: Walks, infinite series and spectral radius of graphs

abstract: For a graph G, the spectral radius \r{ho}(G) of G is the largest eigenvalue of its adjacency matrix. In this paper, we seek the relationship between \r{ho}(G) and the walks of the subgraphs of G. Especially, if G contains a complete multi-partite graph as a spanning subgraph, we give a formula for \r{ho}(G) by using an infinite series on walks of the subgraphs of G. These results are useful for the current popular spectral extremal problem.


title: Tell Me What's Next: Textual Foresight for Generic UI Representations

abstract: Mobile app user interfaces (UIs) are rich with action, text, structure, and image content that can be utilized to learn generic UI representations for tasks like automating user commands, summarizing content, and evaluating the accessibility of user interfaces. Prior work has learned strong visual representations with local or global captioning losses, but fails to retain both granularities. To combat this, we propose Textual Foresight, a novel pretraining objective for learning UI screen representations. Textual Foresight generates global text descriptions of future UI states given a current UI and local action taken. Our approach requires joint reasoning over elements and entire screens, resulting in improved UI features: on generation tasks, UI agents trained with Textual Foresight outperform state-of-the-art by 2% with 28x fewer images. We train with our newly constructed mobile app dataset, OpenApp, which results in the first public dataset for app UI representation learning. OpenApp enables new baselines, and we find Textual Foresight improves average task performance over them by 5.7% while having access to 2x less data.


title: PRoDeliberation: Parallel Robust Deliberation for End-to-End Spoken Language Understanding

abstract: Spoken Language Understanding (SLU) is a critical component of voice assistants; it consists of converting speech to semantic parses for task execution. Previous works have explored end-to-end models to improve the quality and robustness of SLU models with Deliberation, however these models have remained autoregressive, resulting in higher latencies. In this work we introduce PRoDeliberation, a novel method leveraging a Connectionist Temporal Classification-based decoding strategy as well as a denoising objective to train robust non-autoregressive deliberation models. We show that PRoDeliberation achieves the latency reduction of parallel decoding (2-10x improvement over autoregressive models) while retaining the ability to correct Automatic Speech Recognition (ASR) mistranscriptions of autoregressive deliberation systems. We further show that the design of the denoising training allows PRoDeliberation to overcome the limitations of small ASR devices, and we provide analysis on the necessity of each component of the system.


title: Efficient Arbitrated Quantum Digital Signature with Multi-Receiver Verification

abstract: Quantum digital signature is used to authenticate the identity of the signer with information theoretical security, while providing non-forgery and non-repudiation services. In traditional multi-receiver quantum digital signature schemes without an arbitrater, the transferability of one-to-one signature is always required to achieve unforgeability, with complicated implementation and heavy key consumption. In this article, we propose an arbitrated quantum digital signature scheme, in which the signature can be verified by multiple receivers simultaneously, and meanwhile, the transferability of the signature is still kept. Our scheme can be simplified performed to various quantum secure networks, due to the proposed efficient signature calculation procedure with low secure key consumption and low computation complexity, by employing one-time universal hashing algorithm and one-time pad encryption scheme. The evaluation results show that our scheme uses at least two orders of magnitude less key than existing signature schemes with transferability when signing files of the same length with the same number of receivers and security parameter settings.


title: Shape-Constrained Distributional Optimization via Importance-Weighted Sample Average Approximation

abstract: Shape-constrained optimization arises in a wide range of problems including distributionally robust optimization (DRO) that has surging popularity in recent years. In the DRO literature, these problems are usually solved via reduction into moment-constrained problems using the Choquet representation. While powerful, such an approach could face tractability challenges arising from the geometries and the compatibility between the shape and the objective function and moment constraints. In this paper, we propose an alternative methodology to solve shape-constrained optimization problems by integrating sample average approximation with importance sampling, the latter used to convert the distributional optimization into an optimization problem over the likelihood ratio with respect to a sampling distribution. We demonstrate how our approach, which relies on finite-dimensional linear programs, can handle a range of shape-constrained problems beyond the reach of previous Choquet-based reformulations, and entails vanishing and quantifiable optimality gaps. Moreover, our theoretical analyses based on strong duality and empirical processes reveal the critical role of shape constraints in guaranteeing desirable consistency and convergence rates.


title: The Max-Min Formulation of Multi-Objective Reinforcement Learning: From Theory to a Model-Free Algorithm

abstract: In this paper, we consider multi-objective reinforcement learning, which arises in many real-world problems with multiple optimization goals. We approach the problem with a max-min framework focusing on fairness among the multiple goals and develop a relevant theory and a practical model-free algorithm under the max-min framework. The developed theory provides a theoretical advance in multi-objective reinforcement learning, and the proposed algorithm demonstrates a notable performance improvement over existing baseline methods.


title: Hinge non-Hermitian skin effect in the single-particle properties of a strongly correlated f-electron system

abstract: Non-Hermitian systems exhibit novel phenomena without Hermitian counterparts, such as exceptional points and the non-Hermitian skin effect. These non-Hermitian topological phenomena are observable in single-particle excitations of correlated systems in equilibrium, which are described by Green's functions. In this paper, we demonstrate the appearance of the hinge non-Hermitian skin effect in the effective Hamiltonian that describes the single-particle properties of an $f$-electron system. Skin effects result in a strong sensitivity to boundary conditions, and a large number of eigenstates localize at one boundary when open boundary conditions are applied. Our system exhibits such sensitivity and hosts skin modes localized around hinges. This hinge skin effect is induced by a non-Hermitian topology of the surface Brillouin zone. The hinge skin modes are observed for one-dimensional subsystems located between one pair of exceptional points in the surface Brillouin zone. This paper highlights that correlated materials are an exciting platform for analyzing non-Hermitian phenomena.


title: Spatial Annealing Smoothing for Efficient Few-shot Neural Rendering

abstract: Neural Radiance Fields (NeRF) with hybrid representations have shown impressive capabilities in reconstructing scenes for view synthesis, delivering high efficiency. Nonetheless, their performance significantly drops with sparse view inputs, due to the issue of overfitting. While various regularization strategies have been devised to address these challenges, they often depend on inefficient assumptions or are not compatible with hybrid models. There is a clear need for a method that maintains efficiency and improves resilience to sparse views within a hybrid framework. In this paper, we introduce an accurate and efficient few-shot neural rendering method named Spatial Annealing smoothing regularized NeRF (SANeRF), which is specifically designed for a pre-filtering-driven hybrid representation architecture. We implement an exponential reduction of the sample space size from an initially large value. This methodology is crucial for stabilizing the early stages of the training phase and significantly contributes to the enhancement of the subsequent process of detail refinement. Our extensive experiments reveal that, by adding merely one line of code, SANeRF delivers superior rendering quality and much faster reconstruction speed compared to current few-shot NeRF methods. Notably, SANeRF outperforms FreeNeRF by 0.3 dB in PSNR on the Blender dataset, while achieving 700x faster reconstruction speed.


title: Quantum Hamilton-Jacobi Theory, Spectral Path Integrals and Exact-WKB

abstract: We propose a new way to perform path integrals in quantum mechanics by using a quantum version of Hamilton-Jacobi theory. In classical mechanics, Hamilton-Jacobi theory is a powerful formalism, however, its utility is not explored in quantum theory beyond the correspondence principle. The canonical transformation enables one to set the new Hamiltonian to constant or zero, but keeps the information about solution in Hamilton's characteristic function. To benefit from this in quantum theory, one must work with a formulation in which classical Hamiltonian is used. This uniquely points to phase space path integral. However, the main variable in HJ-formalism is energy, not time. Thus, we are led to consider Fourier transform of path integral, spectral path integral, $\tilde Z(E)$. This admits a representation in terms of a quantum Hamilton's characteristic functions for perturbative and non-perturbative periodic orbits, generalizing Gutzwiller's sum. This results in a path integral derivation of exact quantization conditions, complementary to the exact WKB analysis of differential equations. We apply these to generic $\mathbb Z_2$ symmetric multi-well potential problems and point out some new instanton effects, e.g., the level splitting is generically a multi-instanton effect, unlike double-well.


title: Simplified and Flexible Coils for Stellarators using Single-Stage Optimization

abstract: Single-stage optimization, also known as combined plasma-coil algorithms or direct coil optimization, has recently emerged as a possible method to expedite the design of stellarator devices by including, in a single step, confinement, stability, and engineering constraints. In this work, we show how such frameworks allow us to find new designs in a streamlined manner, yielding a broad range of new configurations. Examples are shown for stellarators with a small number of coils and quasisymmetric stellarators with only one to three coils per half field period, with external trim coils, helical coils, and a single set of coils generating both a quasi-axisymmetric and a quasi-helical equilibrium.


title: ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models

abstract: The impressive performance of Large Language Models (LLMs) across various natural language processing tasks comes at the cost of vast computational resources and storage requirements. One-shot pruning techniques offer a way to alleviate these burdens by removing redundant weights without the need for retraining. Yet, the massive scale of LLMs often forces current pruning approaches to rely on heuristics instead of optimization-based techniques, potentially resulting in suboptimal compression. In this paper, we introduce ALPS, an optimization-based framework that tackles the pruning problem using the operator splitting technique and a preconditioned conjugate gradient-based post-processing step. Our approach incorporates novel techniques to accelerate and theoretically guarantee convergence while leveraging vectorization and GPU parallelism for efficiency. ALPS substantially outperforms state-of-the-art methods in terms of the pruning objective and perplexity reduction, particularly for highly sparse models. On the OPT-30B model with 70% sparsity, ALPS achieves a 13% reduction in test perplexity on the WikiText dataset and a 19% improvement in zero-shot benchmark performance compared to existing methods.


title: SE/BN Adapter: Parametric Efficient Domain Adaptation for Speaker Recognition

abstract: Deploying a well-optimized pre-trained speaker recognition model in a new domain often leads to a significant decline in performance. While fine-tuning is a commonly employed solution, it demands ample adaptation data and suffers from parameter inefficiency, rendering it impractical for real-world applications with limited data available for model adaptation. Drawing inspiration from the success of adapters in self-supervised pre-trained models, this paper introduces a SE/BN adapter to address this challenge. By freezing the core speaker encoder and adjusting the feature maps' weights and activation distributions, we introduce a novel adapter utilizing trainable squeeze-and-excitation (SE) blocks and batch normalization (BN) layers, termed SE/BN adapter. Our experiments, conducted using VoxCeleb for pre-training and 4 genres from CN-Celeb for adaptation, demonstrate that the SE/BN adapter offers significant performance improvement over the baseline and competes with the vanilla fine-tuning approach by tuning just 1% of the parameters.


title: Sense Less, Generate More: Pre-training LiDAR Perception with Masked Autoencoders for Ultra-Efficient 3D Sensing

abstract: In this work, we propose a disruptively frugal LiDAR perception dataflow that generates rather than senses parts of the environment that are either predictable based on the extensive training of the environment or have limited consequence to the overall prediction accuracy. Therefore, the proposed methodology trades off sensing energy with training data for low-power robotics and autonomous navigation to operate frugally with sensors, extending their lifetime on a single battery charge. Our proposed generative pre-training strategy for this purpose, called as radially masked autoencoding (R-MAE), can also be readily implemented in a typical LiDAR system by selectively activating and controlling the laser power for randomly generated angular regions during on-field operations. Our extensive evaluations show that pre-training with R-MAE enables focusing on the radial segments of the data, thereby capturing spatial relationships and distances between objects more effectively than conventional procedures. Therefore, the proposed methodology not only reduces sensing energy but also improves prediction accuracy. For example, our extensive evaluations on Waymo, nuScenes, and KITTI datasets show that the approach achieves over a 5% average precision improvement in detection tasks across datasets and over a 4% accuracy improvement in transferring domains from Waymo and nuScenes to KITTI. In 3D object detection, it enhances small object detection by up to 4.37% in AP at moderate difficulty levels in the KITTI dataset. Even with 90% radial masking, it surpasses baseline models by up to 5.59% in mAP/mAPH across all object classes in the Waymo dataset. Additionally, our method achieves up to 3.17% and 2.31% improvements in mAP and NDS, respectively, on the nuScenes dataset, demonstrating its effectiveness with both single and fused LiDAR-camera modalities. https://github.com/sinatayebati/Radial_MAE.


title: Research on material identification of mobile phones falling to the ground

abstract: The failure mode of the phone falling has a lot to do with the ground material. At present, the research on ground material and mobile phone damage is generally carried out through experiments, which is extremely costly. This paper presents a method to identify the material of mobile phones falling on the ground. The method determines the material of the mobile phone falling to the ground according to the data of the mobile phone accelerometer and can obtain the ground material of the mobile phone falling through a large number of user data. By analyzing the physical process of mobile phone falling, the accelerometer data interval which can reflect the characteristics of falling is reasonably intercepted. And the data features that can reflect the collision are extracted. Finally, based on the fully connected neural network, the method of determining the material of mobile phones falling on the ground is developed. The experimental results show that the method has a high identification rate, and the average identification rate for different ground materials is 96.75%. Instead of relying on auxiliary devices, the identification process only relies on the phone's built-in acceleration sensor. This paper fills the gap in the field of mobile phone falling ground material identification. It has a great contribution to the collection of user drop data, the analysis of the drop process, and the improvement of mobile phone design defects.


title: SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literature

abstract: We present SciRIFF (Scientific Resource for Instruction-Following and Finetuning), a dataset of 137K instruction-following demonstrations for 54 tasks covering five essential scientific literature understanding capabilities: information extraction, summarization, question answering, claim verification, and classification. SciRIFF demonstrations are notable for their long input contexts, detailed task specifications, and complex structured outputs. While instruction-following resources are available in specific domains such as clinical medicine and chemistry, SciRIFF is the first dataset focused on extracting and synthesizing information from research literature across a wide range of scientific fields. To demonstrate the utility of SciRIFF, we develop a sample-efficient strategy to adapt a general instruction-following model for science by performing additional finetuning on a mix of general-domain and SciRIFF demonstrations. In evaluations on nine held-out scientific tasks, our model -- called SciTulu -- improves over a strong LLM baseline by 28.1% and 6.5% at the 7B and 70B scales respectively, while maintaining general instruction-following performance within 2% of the baseline. We are optimistic that SciRIFF will facilitate the development and evaluation of LLMs to help researchers navigate the ever-growing body of scientific literature. We release our dataset, model checkpoints, and data processing and evaluation code to enable further research.


title: Quantum fluctuation on the worldsheet of probe string in BTZ black hole

abstract: In this paper, we investigate the second-order normal quantum fluctuation on the world-sheet of a probe string in the Ba\~nados-Teitelboim-Zanelli (BTZ) black hole. These fluctuations is treated as the projection of Hawking radiation on the worldsheet and indeed modify the action growth of the string. Then in the string field theory/boundary conformal field theory framework, via the boundary vertex operator we study the correlation function of the Schr\"odinger functional of excited fields on the world-sheet and further extract the field's formula. Our study could shed light on the potential connection between complexity growth and correlation function.


title: Scaling Manipulation Learning with Visual Kinematic Chain Prediction

abstract: Learning general-purpose models from diverse datasets has achieved great success in machine learning. In robotics, however, existing methods in multi-task learning are typically constrained to a single robot and workspace, while recent work such as RT-X requires a non-trivial action normalization procedure to manually bridge the gap between different action spaces in diverse environments. In this paper, we propose the visual kinematics chain as a precise and universal representation of quasi-static actions for robot learning over diverse environments, which requires no manual adjustment since the visual kinematic chains can be automatically obtained from the robot's model and camera parameters. We propose the Visual Kinematics Transformer (VKT), a convolution-free architecture that supports an arbitrary number of camera viewpoints, and that is trained with a single objective of forecasting kinematic structures through optimal point-set matching. We demonstrate the superior performance of VKT over BC transformers as a general agent on Calvin, RLBench, Open-X, and real robot manipulation tasks. Video demonstrations can be found at https://mlzxy.github.io/visual-kinetic-chain.


title: Capacity bounds on integral flows and the Kostant partition function

abstract: The type $A$ Kostant partition function is an important combinatorial object with various applications: it counts integer flows on the complete directed graph, computes Hilbert series of spaces of diagonal harmonics, and can be used to compute weight and tensor product multiplicities of representations. In this paper we study asymptotics of the Kostant partition function, improving on various previously known lower bounds and settling conjectures of O'Neill and Yip. Our methods build upon recent results and techniques of Br\"and\'en-Leake-Pak, who used Lorentzian polynomials and Gurvits' capacity method to bound the number of lattice points of transportation and flow polytopes. Finally, we also give new two-sided bounds using the Lidskii formulas from subdivisions of flow polytopes.


title: Review of the low-lying excited baryons $\Sigma^*(1/2^-)$

abstract: Strong empirical and phenomenological indications exist for large sea-quark admixtures in the low-lying excited baryons. Investigating the low-lying excited baryon $\Sigma^*(1/2^-)$ is important to determine the nature of the low-lying excited baryons. We review the experimental and theoretical progress on the studies of the $\Sigma^*(1/2^-)$. Although several candidates have received intensive discussions, such as $\Sigma(1620)$ and $\Sigma(1480)$, their existence needs further confirmation. Following the prediction of the unquenched quark models for the $\Sigma^*(1/2^-)$, many theoretical works suggested the existence of these states in various processes. Future experimental measurements could shed light on the existence of the low-lying excited $\Sigma^*(1/2^-)$ state.


title: SynthForge: Synthesizing High-Quality Face Dataset with Controllable 3D Generative Models

abstract: Recent advancements in generative models have unlocked the capabilities to render photo-realistic data in a controllable fashion. Trained on the real data, these generative models are capable of producing realistic samples with minimal to no domain gap, as compared to the traditional graphics rendering. However, using the data generated using such models for training downstream tasks remains under-explored, mainly due to the lack of 3D consistent annotations. Moreover, controllable generative models are learned from massive data and their latent space is often too vast to obtain meaningful sample distributions for downstream task with limited generation. To overcome these challenges, we extract 3D consistent annotations from an existing controllable generative model, making the data useful for downstream tasks. Our experiments show competitive performance against state-of-the-art models using only generated synthetic data, demonstrating potential for solving downstream tasks. Project page: https://synth-forge.github.io


title: Labeling Comic Mischief Content in Online Videos with a Multimodal Hierarchical-Cross-Attention Model

abstract: We address the challenge of detecting questionable content in online media, specifically the subcategory of comic mischief. This type of content combines elements such as violence, adult content, or sarcasm with humor, making it difficult to detect. Employing a multimodal approach is vital to capture the subtle details inherent in comic mischief content. To tackle this problem, we propose a novel end-to-end multimodal system for the task of comic mischief detection. As part of this contribution, we release a novel dataset for the targeted task consisting of three modalities: video, text (video captions and subtitles), and audio. We also design a HIerarchical Cross-attention model with CAPtions (HICCAP) to capture the intricate relationships among these modalities. The results show that the proposed approach makes a significant improvement over robust baselines and state-of-the-art models for comic mischief detection and its type classification. This emphasizes the potential of our system to empower users, to make informed decisions about the online content they choose to see. In addition, we conduct experiments on the UCF101, HMDB51, and XD-Violence datasets, comparing our model against other state-of-the-art approaches showcasing the outstanding performance of our proposed model in various scenarios.


title: Dual-Pipeline with Low-Rank Adaptation for New Language Integration in Multilingual ASR

abstract: This paper addresses challenges in integrating new languages into a pre-trained multilingual automatic speech recognition (mASR) system, particularly in scenarios where training data for existing languages is limited or unavailable. The proposed method employs a dual-pipeline with low-rank adaptation (LoRA). It maintains two data flow pipelines-one for existing languages and another for new languages. The primary pipeline follows the standard flow through the pre-trained parameters of mASR, while the secondary pipeline additionally utilizes language-specific parameters represented by LoRA and a separate output decoder module. Importantly, the proposed approach minimizes the performance degradation of existing languages and enables a language-agnostic operation mode, facilitated by a decoder selection strategy. We validate the effectiveness of the proposed method by extending the pre-trained Whisper model to 19 new languages from the FLEURS dataset


title: Incremental Learning and Self-Attention Mechanisms Improve Neural System Identification

abstract: Convolutional neural networks (CNNs) have been shown to be the state-of-the-art approach for modeling the transfer functions of visual cortical neurons. Cortical neurons in the primary visual cortex are are sensitive to contextual information mediated by extensive horizontal and feedback connections. Standard CNNs can integrate global spatial image information to model such contextual modulation via two mechanisms: successive rounds of convolutions and a fully connected readout layer. In this paper, we find that non-local networks or self-attention (SA) mechanisms, theoretically related to context-dependent flexible gating mechanisms observed in the primary visual cortex, improve neural response predictions over parameter-matched CNNs in two key metrics: tuning curve correlation and tuning peak. We factorize networks to determine the relative contribution of each context mechanism. This reveals that information in the local receptive field is most important for modeling the overall tuning curve, but surround information is critically necessary for characterizing the tuning peak. We find that self-attention can replace subsequent spatial-integration convolutions when learned in an incremental manner, and is further enhanced in the presence of a fully connected readout layer, suggesting that the two context mechanisms are complementary. Finally, we find that learning a receptive-field-centric model with self-attention, before incrementally learning a fully connected readout, yields a more biologically realistic model in terms of center-surround contributions.


title: Understanding and Mitigating Compositional Issues in Text-to-Image Generative Models

abstract: Recent text-to-image diffusion-based generative models have the stunning ability to generate highly detailed and photo-realistic images and achieve state-of-the-art low FID scores on challenging image generation benchmarks. However, one of the primary failure modes of these text-to-image generative models is in composing attributes, objects, and their associated relationships accurately into an image. In our paper, we investigate this compositionality-based failure mode and highlight that imperfect text conditioning with CLIP text-encoder is one of the primary reasons behind the inability of these models to generate high-fidelity compositional scenes. In particular, we show that (i) there exists an optimal text-embedding space that can generate highly coherent compositional scenes which shows that the output space of the CLIP text-encoder is sub-optimal, and (ii) we observe that the final token embeddings in CLIP are erroneous as they often include attention contributions from unrelated tokens in compositional prompts. Our main finding shows that the best compositional improvements can be achieved (without harming the model's FID scores) by fine-tuning {\it only} a simple linear projection on CLIP's representation space in Stable-Diffusion variants using a small set of compositional image-text pairs. This result demonstrates that the sub-optimality of the CLIP's output space is a major error source. We also show that re-weighting the erroneous attention contributions in CLIP can also lead to improved compositional performances, however these improvements are often less significant than those achieved by solely learning a linear projection head, highlighting erroneous attentions to be only a minor error source.


title: Target Speaker Extraction with Curriculum Learning

abstract: This paper presents a novel approach to target speaker extraction (TSE) using Curriculum Learning (CL) techniques, addressing the challenge of distinguishing a target speaker's voice from a mixture containing interfering speakers. For efficient training, we propose designing a curriculum that selects subsets of increasing complexity, such as increasing similarity between target and interfering speakers, and that selects training data strategically. Our CL strategies include both variants using predefined difficulty measures (e.g. gender, speaker similarity, and signal-to-distortion ratio) and ones using the TSE's standard objective function, each designed to expose the model gradually to more challenging scenarios. Comprehensive testing on the Libri2talker dataset demonstrated that our CL strategies for TSE improved the performance, and the results markedly exceeded baseline models without CL about 1 dB.


title: DualVC 3: Leveraging Language Model Generated Pseudo Context for End-to-end Low Latency Streaming Voice Conversion

abstract: Streaming voice conversion has become increasingly popular for its potential in real-time applications. The recently proposed DualVC 2 has achieved robust and high-quality streaming voice conversion with a latency of about 180ms. Nonetheless, the recognition-synthesis framework hinders end-to-end optimization, and the instability of automatic speech recognition (ASR) model with short chunks makes it challenging to further reduce latency. To address these issues, we propose an end-to-end model, DualVC 3. With speaker-independent semantic tokens to guide the training of the content encoder, the dependency on ASR is removed and the model can operate under extremely small chunks, with cascading errors eliminated. A language model is trained on the content encoder output to produce pseudo context by iteratively predicting future frames, providing more contextual information for the decoder to improve conversion quality. Experimental results demonstrate that DualVC 3 achieves comparable performance to DualVC 2 in subjective and objective metrics, with a latency of only 50 ms.


title: Output-sensitive Conjunctive Query Evaluation

abstract: Join evaluation is one of the most fundamental operations performed by database systems and arguably the most well-studied problem in the Database community. A staggering number of join algorithms have been developed, and commercial database engines use finely tuned join heuristics that take into account many factors including the selectivity of predicates, memory, IO, etc. However, most of the results have catered to either full join queries or non-full join queries but with degree constraints (such as PK-FK relationships) that make joins \emph{easier} to evaluate. Further, most of the algorithms are also not output-sensitive. In this paper, we present a novel, output-sensitive algorithm for the evaluation of acyclic Conjunctive Queries (CQs) that contain arbitrary free variables. Our result is based on a novel generalization of the Yannakakis algorithm and shows that it is possible to improve the running time guarantee of the Yannakakis algorithm by a polynomial factor. Importantly, our algorithmic improvement does not depend on the use of fast matrix multiplication, as a recently proposed algorithm does. The upper bound is complemented with matching lower bounds conditioned on two variants of the $k$-clique conjecture. The application of our algorithm recovers known prior results and improves on known state-of-the-art results for common queries such as paths and stars.


title: Multi-agent Reinforcement Learning with Deep Networks for Diverse Q-Vectors

abstract: Multi-agent reinforcement learning (MARL) has become a significant research topic due to its ability to facilitate learning in complex environments. In multi-agent tasks, the state-action value, commonly referred to as the Q-value, can vary among agents because of their individual rewards, resulting in a Q-vector. Determining an optimal policy is challenging, as it involves more than just maximizing a single Q-value. Various optimal policies, such as a Nash equilibrium, have been studied in this context. Algorithms like Nash Q-learning and Nash Actor-Critic have shown effectiveness in these scenarios. This paper extends this research by proposing a deep Q-networks (DQN) algorithm capable of learning various Q-vectors using Max, Nash, and Maximin strategies. The effectiveness of this approach is demonstrated in an environment where dual robotic arms collaborate to lift a pot.


title: Bias-Corrected Joint Spectral Embedding for Multilayer Networks with Invariant Subspace: Entrywise Eigenvector Perturbation and Inference

abstract: In this paper, we propose to estimate the invariant subspace across heterogeneous multiple networks using a novel bias-corrected joint spectral embedding algorithm. The proposed algorithm recursively calibrates the diagonal bias of the sum of squared network adjacency matrices by leveraging the closed-form bias formula and iteratively updates the subspace estimator using the most recent estimated bias. Correspondingly, we establish a complete recipe for the entrywise subspace estimation theory for the proposed algorithm, including a sharp entrywise subspace perturbation bound and the entrywise eigenvector central limit theorem. Leveraging these results, we settle two multiple network inference problems: the exact community detection in multilayer stochastic block models and the hypothesis testing of the equality of membership profiles in multilayer mixed membership models. Our proof relies on delicate leave-one-out and leave-two-out analyses that are specifically tailored to block-wise symmetric random matrices and a martingale argument that is of fundamental interest for the entrywise eigenvector central limit theorem.


title: Dynamic Stochastic Decoding Strategy for Open-Domain Dialogue Generation

abstract: Stochastic sampling strategies such as top-k and top-p have been widely used in dialogue generation task. However, as an open-domain chatting system, there will be two different conversation scenarios, i.e. chit-chat and knowledge-based question answering. In the former situation, responses diversity is essential due to the one-to-many nature in dialogue. The latter, on the other hand, requires less randomness given that stochastic decoding strategy entails the risk of generating incorrect information. As a result, an adaptive and flexible decoding strategy is needed to cope with these two scenarios simultaneously. To this end, we propose the dynamic decoding strategy (DDS), which can adjust the decoding space w.r.t. different contexts. In DDS, both sequence-level and token-level adaptive search can be achieved to adjust the decoding process in a unified framework. Besides, our adaptive algorithm can not only be used during model inference, but it can also be applied during the model training stage to further enhance the performance. Comprehensive experiments indicate that the proposed decoding strategy can consistently improve the performance of pre-trained dialogue models when coupled with four well-used stochastic decoding algorithms.