title: Standardize: Aligning Language Models with Expert-Defined Standards for Content Generation

abstract: Domain experts across engineering, healthcare, and education follow strict standards for producing quality content such as technical manuals, medication instructions, and children's reading materials. However, current works in controllable text generation have yet to explore using these standards as references for control. Towards this end, we introduce Standardize, a retrieval-style in-context learning-based framework to guide large language models to align with expert-defined standards. Focusing on English language standards in the education domain as a use case, we consider the Common European Framework of Reference for Languages (CEFR) and Common Core Standards (CCS) for the task of open-ended content generation. Our findings show that models can gain 40% to 100% increase in precise accuracy for Llama2 and GPT-4, respectively, demonstrating that the use of knowledge artifacts extracted from standards and integrating them in the generation process can effectively guide models to produce better standard-aligned content.


abstract: Policy Brief on "Long Term Space Data and Informatics Needs", distilled from the corresponding panel that was part of the discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July 2023. Persistent space data gathering, retention, transmission, and analysis play a pivotal role in deepening our grasp of the Universe and fostering the achievement of global sustainable development goals. Long-term data storage and curation is crucial not only to make the wide range of burgeoning data sets available to the global science community, but also to stabilize those data sets, enabling new science in the future to analyse long-term trends over unprecedented time spans. In addition to this, over the long-term, the imperative to store all data on the ground should be ameliorated by use of space-based data stores --maintained and seen to be as reliable as any other data archive. This concept is sometimes referred to as Memory of the Sky. Storing the data must be accompanied by the ability to analyse them. Several concepts covered below acknowledge roots and inspiration based in the Virtual Observatory effort. Within this policy document, we delve into the complexities surrounding the long-term utilization of space data and informatics, shedding light on the challenges and opportunities inherent in this endeavour. Further, we present a series of pragmatic recommendations designed to address these challenges proactively. The policy webinar took place during the G20 presidency in India (2023). A summary based on the seven panels can be found here: arxiv:2401.04623.


title: Truncated Polynomial Expansion-Based Detection in Massive MIMO: A Model-Driven Deep Learning Approach

abstract: In this paper, we propose a deep learning (DL)-based approach for efficiently computing the inverse of Hermitian matrices using truncated polynomial expansion (TPE). Our model-driven approach involves optimizing the coefficients of the TPE during an offline training procedure for a given number of TPE terms. We apply this method to signal detection in uplink massive multiple-input multiple-output (MIMO) systems, where the matrix inverse operation required by linear detectors, such as zero-forcing (ZF) and minimum mean square error (MMSE), is approximated using TPE. Our simulation results demonstrate that the proposed learned TPE-based method outperforms the conventional TPE method with optimal coefficients in terms of asymptotic convergence speed and reduces the computational complexity of the online detection stage, albeit at the expense of the offline training stage. However, the limited number of trainable parameters leads to a swift offline training process.


title: The Radcliffe Wave is Oscillating

abstract: Our Sun lies within 300 pc of the 2.7-kpc-long sinusoidal chain of dense gas clouds known as the Radcliffe Wave. The structure's wave-like shape was discovered using 3D dust mapping, but initial kinematic searches for oscillatory motion were inconclusive. Here we present evidence that the Radcliffe Wave is oscillating through the Galactic plane while also drifting radially away from the Galactic Center. We use measurements of line-of-sight velocity for 12CO and 3D velocities of young stellar clusters to show that the most massive star-forming regions spatially associated with the Radcliffe Wave (including Orion, Cepheus, North America, and Cygnus X) move as if they are part of an oscillating wave driven by the gravitational acceleration of the Galactic potential. By treating the Radcliffe Wave as a coherently oscillating structure, we can derive its motion independently of the local Galactic mass distribution, and directly measure local properties of the Galactic potential as well as the Sun's vertical oscillation period. In addition, the measured drift of the Radcliffe Wave radially outward from the Galactic Center suggests that the cluster whose supernovae ultimately created today's expanding Local Bubble may have been born in the Radcliffe Wave.


title: Direct writing of room temperature polariton condensate lattice by top-down approach

abstract: Realizing lattices of exciton polariton condensates has been of much interest owing to the potential of such systems to realize analog Hamiltonian simulators and physical computing architectures. Prior work on polariton condensate lattices has primarily been on GaAs-based systems, with the recent advent of organic molecules and perovskite systems allowing room-temperature operation. However, in most of these room temperature systems, the lattices are defined using a bottom-up approach by patterning the bottom mirrors, significantly limiting the types of lattices and refractive index contrast that can be realized. Here, we report a direct write approach that uses a Focused Ion Beam (FIB) to etch 2D lattice into a planar microcavity. Such etching of the cavity allows for realizing high refractive index contrast lattices. We realize the polariton condensate lattice using the highly photostable host-guest Frenkel excitons of an organic dye small molecular ionic lattice (SMILES).1,2 The lattice structures are defined on a planar microcavity embedded with SMILES using FIB, allowing the realization of lattices with different geometries, including defect sites on demand. The band structure of the lattice and the emergence of condensation are imaged using momentum-resolved spectroscopy. The present approach allows us to study periodic, quasi-periodic, and disordered polariton condensate lattices at room temperature using a top-down approach without compromising on the quantum yield of the organic excitonic material embedded in the cavity.


title: Graph-based Virtual Sensing from Sparse and Partial Multivariate Observations

abstract: Virtual sensing techniques allow for inferring signals at new unmonitored locations by exploiting spatio-temporal measurements coming from physical sensors at different locations. However, as the sensor coverage becomes sparse due to costs or other constraints, physical proximity cannot be used to support interpolation. In this paper, we overcome this challenge by leveraging dependencies between the target variable and a set of correlated variables (covariates) that can frequently be associated with each location of interest. From this viewpoint, covariates provide partial observability, and the problem consists of inferring values for unobserved channels by exploiting observations at other locations to learn how such variables can correlate. We introduce a novel graph-based methodology to exploit such relationships and design a graph deep learning architecture, named GgNet, implementing the framework. The proposed approach relies on propagating information over a nested graph structure that is used to learn dependencies between variables as well as locations. GgNet is extensively evaluated under different virtual sensing scenarios, demonstrating higher reconstruction accuracy compared to the state-of-the-art.


title: Towards early fault tolerance on a 2$\times$N array of qubits equipped with shuttling

abstract: It is well understood that a two-dimensional grid of locally-interacting qubits is a promising platform for achieving fault tolerant quantum computing. However in the near-future, it may prove less challenging to develop lower dimensional structures. In this paper, we show that such constrained architectures can also support fault tolerance; specifically we explore a 2$\times$N array of qubits where the interactions between non-neighbouring qubits are enabled by shuttling the logical information along the rows of the array. Despite the apparent constraints of this setup, we demonstrate that error correction is possible and identify the classes of codes that are naturally suited to this platform. Focusing on silicon spin qubits as a practical example of qubits believed to meet our requirements, we provide a protocol for achieving full universal quantum computation with the surface code, while also addressing the additional constraints that are specific to a silicon spin qubit device. Through numerical simulations, we evaluate the performance of this architecture using a realistic noise model, demonstrating that both surface code and more complex qLDPC codes efficiently suppress gate and shuttling noise to a level that allows for the execution of quantum algorithms within the classically intractable regime. This work thus brings us one step closer to the execution of quantum algorithms that outperform classical machines.


title: Gravitational wave asteroseismology of dark matter hadronic stars

abstract: The influence of the dark matter mass~($M_{\chi}$) and the Fermi momentum~($k_{F}^{\dm}$) on the $f_0$-mode oscillation frequency, damping time parameter, and tidal deformability of hadronic stars are studied by employing a numerical integration of hydrostatic equilibrium, nonradial oscillation, and tidal deformability equations. The matter inside the hadronic stars follows the NL3* equation of state. We obtain that the influence of $M_{\chi}$ and $k_F^{\dm}$ is observed in the $f_0$-mode, damping tome parameter, and tidal deformability. Finally, the correlation between the tidal deformability of the GW$170817$ event with $M_{\chi}$ and $k_F^{\dm}$ are also investigated.


title: Deep Pa$\beta$ Imaging of the Candidate Accreting Protoplanet AB Aur b

abstract: Giant planets grow by accreting gas through circumplanetary disks, but little is known about the timescale and mechanisms involved in the planet assembly process because few accreting protoplanets have been discovered. Recent visible and infrared (IR) imaging revealed a potential accreting protoplanet within the transition disk around the young intermediate-mass Herbig Ae star, AB Aurigae (AB Aur). Additional imaging in H$\alpha$ probed for accretion and found agreement between the line-to-continuum flux ratio of the star and companion, raising the possibility that the emission source could be a compact disk feature seen in scattered starlight. We present new deep Keck/NIRC2 high-contrast imaging of AB Aur to characterize emission in Pa$\beta$, another accretion tracer less subject to extinction. Our narrow band observations reach a 5$\sigma$ contrast of 9.6 mag at 0.6$''$, but we do not detect significant emission at the expected location of the companion, nor from other any other source in the system. Our upper limit on Pa$\beta$ emission suggests that if AB Aur b is a protoplanet, it is not heavily accreting or accretion is stochastic and was weak during the observations.


title: Physically Consistent Modeling of Stacked Intelligent Metasurfaces Implemented with Beyond Diagonal RIS

abstract: Stacked intelligent metasurface (SIM) has emerged as a technology enabling wave domain beamforming through multiple stacked reconfigurable intelligent surfaces (RISs). SIM has been implemented so far with diagonal RIS (D-RIS), while SIM implemented with beyond diagonal RIS (BD-RIS) remains unexplored. Furthermore, a model of SIM accounting for mutual coupling is not yet available. To fill these gaps, we derive a physically consistent channel model for SIM-aided systems and clarify the assumptions needed to obtain the simplified model used in related works. Using this model, we show that 1-layer SIM implemented with BD-RIS achieves the performance upper bound with limited complexity.


title: Interlayer ferroelectric polarization modulated anomalous Hall effects in four-layer MnBi2Te4 antiferromagnets

abstract: Van der Waals (vdW) assembly could efficiently modulate the symmetry of two-dimensional (2D) materials that ultimately governs their physical properties. Of particular interest is the ferroelectric polarization being introduced by proper vdW assembly that enables the realization of novel electronic, magnetic and transport properties of 2D materials. Four-layer antiferromagnetic MnBi2Te4 (F-MBT) offers an excellent platform to explore ferroelectric polarization effects on magnetic order and topological transport properties of nanomaterials. Here, by applying symmetry analyses and density-functional-theory calculations, the ferroelectric interface effects on magnetic order, anomalous Hall effect (AHE) or even quantum AHE (QAHE) on the F-MBT are analyzed. Interlayer ferroelectric polarization in F-MBT efficiently violates the PT symmetry (the combination symmetry of central inversion (P) and time reverse (T) of the F-MBT by conferring magnetoelectric couplings, and stabilizes a specific antiferromagnetic order encompassing a ferromagnetic interface in the F-MBT. We predict that engineering an interlayer polarization in the top or bottom interface of F-MBT allows converting F-MBT from a trivial insulator to a Chern insulator. The switching of ferroelectric polarization at the middle interfaces results in a direction reversal of the quantum anomalous Hall current. Additionally, the interlayer polarization of the top and bottom interfaces can be aligned in the same direction, and the switching of polarization direction also reverses the direction of anomalous Hall currents. Overall, our work highlights the occurrence of quantum-transport phenomena in 2D vdW four-layer antiferromagnets through vdW assembly. These phenomena are absent in the bulk or thin-film in bulk-like stacking forms of MnBi2Te4.


title: Generative Adversarial Collaborations: A practical guide for conference organizers and participating scientists

abstract: Generative adversarial collaborations (GACs) are a form of formal teamwork between groups of scientists with diverging views. The goal of GACs is to identify and ultimately resolve the most important challenges, controversies, and exciting theoretical and empirical debates in a given research field. A GAC team would develop specific, agreed-upon avenues to resolve debates in order to move a field of research forward in a collaborative way. Such adversarial collaborations have many benefits and opportunities but also come with challenges. Here, we use our experience from (1) creating and running the GAC program for the Cognitive Computational Neuroscience (CCN) conference and (2) implementing and leading GACs on particular scientific problems to provide a practical guide for future GAC program organizers and leaders of individual GACs.


title: What is a word?

abstract: In order to design strong paradigms for isolating lexical access and semantics, we need to know what a word is. Surprisingly few linguists and philosophers have a clear model of what a word is, even though words impact basically every aspect of human life. Researchers that regularly publish academic papers about language often rely on outdated, or inaccurate, assumptions about wordhood. This short pedagogical document outlines what the lexicon is most certainly not (though is often mistakenly taken to be), what it might be (based on current good theories), and what some implications for experimental design are.


title: Intruder band mixing in an ab initio description of 12Be

abstract: The spectrum of 12Be exhibits exotic features, e.g., an intruder ground state and shape coexistence, normally associated with the breakdown of a shell closure. While previous phenomenological treatments indicated the ground state has substantial contributions from intruder configurations, it is only with advances in computational abilities and improved interactions that this intruder mixing is observed in ab initio no-core shell model (NCSM) predictions. In this work, we extract electromagnetic observables and symmetry decompositions from the NCSM wave functions to demonstrate that the low-lying positive parity spectrum can be explained in terms of mixing of rotational bands with very different intrinsic structure coexisting within the low-lying spectrum. These observed bands exhibit an approximate SU(3) symmetry and are qualitatively consistent with Elliott model predictions.


title: Inference on LATEs with covariates

abstract: In theory, two-stage least squares (TSLS) identifies a weighted average of covariate-specific local average treatment effects (LATEs) from a saturated specification without making parametric assumptions on how available covariates enter the model. In practice, TSLS is severely biased when saturation leads to a number of control dummies that is of the same order of magnitude as the sample size, and the use of many, arguably weak, instruments. This paper derives asymptotically valid tests and confidence intervals for an estimand that identifies the weighted average of LATEs targeted by saturated TSLS, even when the number of control dummies and instrument interactions is large. The proposed inference procedure is robust against four key features of saturated economic data: treatment effect heterogeneity, covariates with rich support, weak identification strength, and conditional heteroskedasticity.


title: Patient-Centric Knowledge Graphs: A Survey of Current Methods, Challenges, and Applications

abstract: Patient-Centric Knowledge Graphs (PCKGs) represent an important shift in healthcare that focuses on individualized patient care by mapping the patient's health information in a holistic and multi-dimensional way. PCKGs integrate various types of health data to provide healthcare professionals with a comprehensive understanding of a patient's health, enabling more personalized and effective care. This literature review explores the methodologies, challenges, and opportunities associated with PCKGs, focusing on their role in integrating disparate healthcare data and enhancing patient care through a unified health perspective. In addition, this review also discusses the complexities of PCKG development, including ontology design, data integration techniques, knowledge extraction, and structured representation of knowledge. It highlights advanced techniques such as reasoning, semantic search, and inference mechanisms essential in constructing and evaluating PCKGs for actionable healthcare insights. We further explore the practical applications of PCKGs in personalized medicine, emphasizing their significance in improving disease prediction and formulating effective treatment plans. Overall, this review provides a foundational perspective on the current state-of-the-art and best practices of PCKGs, guiding future research and applications in this dynamic field.


title: Existence of Approximately Macroscopically Unique States

abstract: Let $H$ be an infinite dimensional separable Hilbert space and $B(H)$ the C*-algebra of bounded operators on $H.$ Suppose that $T_1,T_2,..., T_n$ are self-adjoint operators in $B(H).$ We show that, if commutators $[T_i, T_j]$ are sufficiently small in norm, then ``Approximately Macroscopically Unique" states always exist for any values in a synthetic spectrum of the $n$-tuple of self-adjoint operators. This is achieved under the circumstance for which the $n$-tuple may not be approximated by commuting ones. This answers a question proposed by David Mumford for measurements in quantum theory. If commutators are not small in norm but small modulo compact operators, then ``Approximate Macroscopic Uniqueness" states also exist.


title: Nature of Topological Phase Transition of Kitaev Quantum Spin Liquids

abstract: We investigate the nature of the topological quantum phase transition between the gapless and gapped Kitaev quantum spin liquid phases away from the exactly solvable point. The transition is driven by anisotropy of the Kitaev couplings. At the critical point the two Dirac points of the gapless Majorana modes merge, resulting in the formation of a semi-Dirac point with quadratic and linear band touching directions. We derive an effective Gross-Neveu-Yukawa type field theory that describes the topological phase transition in the presence of additional magnetic interactions. We obtain the infrared scaling form of the propagator of the dynamical Ising order parameter field and perform a renormalization-group analysis. The universality of the transition is found to be different to that of symmetry-breaking phase transitions of semi-Dirac electrons. However, as in the electronic case, the Majorana fermions acquire an anomalous dimension, indicative of the breakdown of the fractionalized quasiparticle description.


title: On Jordan superderivations and Jordan super-biderivations of trivial extensions and triangular matrix rings

abstract: Triangular matrix rings are example of trivial extensions. In this article we describe the Jordan superderivations of the trivial extensions and upper triangular matrix rings. We deduce then that any Jordan superderivation of an upper triangular matrix ring, under some conditions, is a derivation, and any Jordan super-biderivation of a trivial extension, and hence an upper triangular matrix ring, is a Jordan biderivation.


title: A System Development Kit for Big Data Applications on FPGA-based Clusters: The EVEREST Approach

abstract: Modern big data workflows are characterized by computationally intensive kernels. The simulated results are often combined with knowledge extracted from AI models to ultimately support decision-making. These energy-hungry workflows are increasingly executed in data centers with energy-efficient hardware accelerators since FPGAs are well-suited for this task due to their inherent parallelism. We present the H2020 project EVEREST, which has developed a system development kit (SDK) to simplify the creation of FPGA-accelerated kernels and manage the execution at runtime through a virtualization environment. This paper describes the main components of the EVEREST SDK and the benefits that can be achieved in our use cases.


title: Analysis of Using Sigmoid Loss for Contrastive Learning

abstract: Contrastive learning has emerged as a prominent branch of self-supervised learning for several years. Especially, CLIP, which applies contrastive learning to large sets of captioned images, has garnered significant attention. Recently, SigLIP, a variant of CLIP, has been proposed, which uses the sigmoid loss instead of the standard InfoNCE loss. SigLIP achieves the performance comparable to CLIP in a more efficient manner by eliminating the need for a global view. However, theoretical understanding of using the sigmoid loss in contrastive learning is underexplored. In this paper, we provide a theoretical analysis of using the sigmoid loss in contrastive learning, in the perspective of the geometric structure of learned embeddings. First, we propose the double-Constant Embedding Model (CCEM), a framework for parameterizing various well-known embedding structures by a single variable. Interestingly, the proposed CCEM is proven to contain the optimal embedding with respect to the sigmoid loss. Second, we mathematically analyze the optimal embedding minimizing the sigmoid loss for contrastive learning. The optimal embedding ranges from simplex equiangular-tight-frame to antipodal structure, depending on the temperature parameter used in the sigmoid loss. Third, our experimental results on synthetic datasets coincide with the theoretical results on the optimal embedding structures.


title: Sharing Bell nonlocality of bipartite high-dimensional pure states using only projective measurements

abstract: Bell nonlocality is the key quantum resource in some device-independent quantum information processing. It is of great importance to study the efficient sharing of this resource. Unsharp measurements are widely used in sharing the nonlocality of an entangled state shared among several sequential observers. Recently, the authors in [Phys. Rev. Lett.129, 230402(2022)] showed that the Bell nonlocality of two-qubit pure states can be shared even when one only uses projective measurements and local randomness. We demonstrate that projective measurements are also sufficient for sharing the Bell nonlocality of arbitrary high-dimensional pure bipartite states. Our results promote further understanding of the nonlocality sharing of high-dimensional quantum states under projective measurements.


title: On linearisation and existence of preduals

abstract: We study the problem of existence of preduals of locally convex Hausdorff spaces. We derive necessary and sufficient conditions for the existence of a predual with certain properties of a bornological locally convex Hausdorff space $X$. Then we turn to the case that $X=\mathcal{F}(\Omega)$ is a space of scalar-valued functions on a non-empty set $\Omega$ and characterise those among them which admit a special predual, namely a strong linearisation, i.e. there are a locally convex Hausdorff space $Y$, a map $\delta\colon\Omega\to Y$ and a topological isomorphism $T\colon\mathcal{F}(\Omega)\to Y_{b}'$ such that $T(f)\circ \delta= f$ for all $f\in\mathcal{F}(\Omega)$.


title: Multi-objective Binary Coordinate Search for Feature Selection

abstract: A supervised feature selection method selects an appropriate but concise set of features to differentiate classes, which is highly expensive for large-scale datasets. Therefore, feature selection should aim at both minimizing the number of selected features and maximizing the accuracy of classification, or any other task. However, this crucial task is computationally highly demanding on many real-world datasets and requires a very efficient algorithm to reach a set of optimal features with a limited number of fitness evaluations. For this purpose, we have proposed the binary multi-objective coordinate search (MOCS) algorithm to solve large-scale feature selection problems. To the best of our knowledge, the proposed algorithm in this paper is the first multi-objective coordinate search algorithm. In this method, we generate new individuals by flipping a variable of the candidate solutions on the Pareto front. This enables us to investigate the effectiveness of each feature in the corresponding subset. In fact, this strategy can play the role of crossover and mutation operators to generate distinct subsets of features. The reported results indicate the significant superiority of our method over NSGA-II, on five real-world large-scale datasets, particularly when the computing budget is limited. Moreover, this simple hyper-parameter-free algorithm can solve feature selection much faster and more efficiently than NSGA-II.


title: Generative AI Security: Challenges and Countermeasures

abstract: Generative AI's expanding footprint across numerous industries has led to both excitement and increased scrutiny. This paper delves into the unique security challenges posed by Generative AI, and outlines potential research directions for managing these risks.


title: Nonlocal Symmetries of Two 2-component Equations of Camassa-Holm Type

abstract: For a 2-component Camassa-Holm equation, as well as a 2-component generalization of the modified Camassa-Holm equation, nonlocal infinitesimal symmetries quadratically depending on eigenfunctions of linear spectral problems are constructed from functional gradients of spectral parameters. With appropriate pseudo-potentials, these nonlocal infinitesimal symmetries are prolonged to enlarged systems, and then explicitly integrated to generate symmetry transformations in finite form for enlarged systems. As implementations of these finite symmetry transformations, some kinds of nontrivial solutions and B\"{a}cklund transformations are derived for both equations.


title: On Commuting graphs of triangular rings

abstract: Let $R$ be a noncommutative ring with identity. The commuting graph of $R$, denoted by $\Gamma(R)$, is a graph with vertex set $R \setminus Z(R)$, and two vertices $a$, $b$ are adjacent if $a\neq b$ and $ab=ba$. Let $T=Tr(R)$ be the ring of all $2\times 2$ upper triangular matrices over $R$ and $\Gamma(T)$ be the commuting graph of $T$. In this article, we find the number of edges, cliques, clique number, and independence number of $\Gamma (T)$ when $R$ is a finite field. Moreover, we show that for the case when $R= \mathbb{Z}_{n}$ is not a field, $\Gamma (T)$ is connected with diameter 3. Some useful related results are also obtained, some examples are presented and a question is posed.


title: Are Large Language Models (LLMs) Good Social Predictors?

abstract: The prediction has served as a crucial scientific method in modern social studies. With the recent advancement of Large Language Models (LLMs), efforts have been made to leverage LLMs to predict the human features in social life, such as presidential voting. These works suggest that LLMs are capable of generating human-like responses. However, we find that the promising performance achieved by previous studies is because of the existence of input shortcut features to the response. In fact, by removing these shortcuts, the performance is reduced dramatically. To further revisit the ability of LLMs, we introduce a novel social prediction task, Soc-PRF Prediction, which utilizes general features as input and simulates real-world social study settings. With the comprehensive investigations on various LLMs, we reveal that LLMs cannot work as expected on social prediction when given general input features without shortcuts. We further investigate possible reasons for this phenomenon that suggest potential ways to enhance LLMs for social prediction.


title: Reflect-RL: Two-Player Online RL Fine-Tuning for LMs

abstract: As language models (LMs) demonstrate their capabilities in various fields, their application to tasks requiring multi-round interactions has become increasingly popular. These tasks usually have complex dynamics, so supervised fine-tuning (SFT) on a limited offline dataset does not yield good performance. However, only a few works attempted to directly train the LMs within interactive decision-making environments. We aim to create an effective approach to fine-tune LMs with online reinforcement learning (RL) in these environments. We propose Reflect-RL, a two-player system to fine-tune an LM using SFT and online RL, where a frozen reflection model (player) assists the policy model (player). To generate data for the warm-up SFT stage, we use negative example generation to enhance the error-correction ability of the reflection model. Furthermore, we designed single-prompt action enumeration and applied curriculum learning to allow the policy model to learn more efficiently. Empirically, we verify that Reflect-RL outperforms SFT and online RL without reflection. Testing results indicate GPT-2 XL 1.56B fine-tuned with Reflect-RL outperforms larger open-source LMs, such as Mistral 7B. The benchmarks, dataset, and code involved in this work are publicly available: https://github.com/zhourunlong/Reflect-RL.


title: Studies on $R_K$ with Large Dilepton Invariant-Mass, Scalable Pythonic Fitting, and Online Event Interpretation with GNNs at LHCb

abstract: The Standard Model of particle physics is well established, yet recently showed tensions with experimental observations. A large part of this thesis is dedicated to the first measurement of the ratio of branching fractions of the decays $B^+ \rightarrow K^+ \mu^+ \mu^-$ and $B^+ \rightarrow K^+ e^+ e^-$ , referred to as $R_K$ , in the high dilepton invariant-mass region. The presented analysis uses the full dataset of proton-proton collisions collected by the LHCb experiment in the years 2011-2018, corresponding to an integrated luminosity of 9 $fb^{-1}$. The final result for $R_K$ is still blinded. The sensitivity of the developed analysis is estimated to be $\sigma_{R_K}^{\mathrm{stat}} = 0.073$ and $\sigma_{R_K}^{\mathrm{stat}} = 0.031$. In addition to the precision measurement of $R_K$ at a high dilepton invariant mass, this thesis contains two more technical topics. First, an algorithm that selects particles in an event in the LHCb detector by performing a full event interpretation, referred to as DFEI. This tool is based on multiple Graph Neural Networks and aims to cope with the increase in luminosity in current and future upgrades of the LHCb detector. Comparisons with the current approach show at least similar, sometimes better, performance with respect to decay reconstruction and selection using charged particles. The efficiency is mostly independent of the luminosity, which is crucial for future upgrades. Second, a Python package for likelihood model fitting called zfit. The increasing popularity of the Python programming language in High Energy Physics creates a need for a flexible, modular, and performant fitting library. The zfit package is well integrated into the Python ecosystem, highly customizable and fast thanks to its computational backend TensorFlow.


title: Effective Edge Ranking via Random Walk with Restart

abstract: Given a network G, edge centrality is a metric used to evaluate the importance of edges in G, which is a key concept in analyzing networks and finds vast applications involving edge ranking. In spite of a wealth of research on devising edge centrality measures, they incur either prohibitively high computation costs or varied deficiencies that lead to sub-optimal ranking quality. To overcome their limitations, this paper proposes EdgeRAKE, a new centrality measure for edge ranking that leverages the novel notion of the edgewise random walk with restart. Based thereon, we present a linear-complexity algorithm for EdgeRAKE approximation, followed by an in-depth theoretical analysis in terms of various aspects. Extensive experiments comparing EdgeRAKE against six edge centrality metrics in graph analytics tasks on real networks showcase that EdgeRAKE offers superior practical effectiveness without significantly reducing computation efficiency


title: Efficient Parameter Mining and Freezing for Continual Object Detection

abstract: Continual Object Detection is essential for enabling intelligent agents to interact proactively with humans in real-world settings. While parameter-isolation strategies have been extensively explored in the context of continual learning for classification, they have yet to be fully harnessed for incremental object detection scenarios. Drawing inspiration from prior research that focused on mining individual neuron responses and integrating insights from recent developments in neural pruning, we proposed efficient ways to identify which layers are the most important for a network to maintain the performance of a detector across sequential updates. The presented findings highlight the substantial advantages of layer-level parameter isolation in facilitating incremental learning within object detection models, offering promising avenues for future research and application in real-world scenarios.


title: Compact NSGA-II for Multi-objective Feature Selection

abstract: Feature selection is an expensive challenging task in machine learning and data mining aimed at removing irrelevant and redundant features. This contributes to an improvement in classification accuracy, as well as the budget and memory requirements for classification, or any other post-processing task conducted after feature selection. In this regard, we define feature selection as a multi-objective binary optimization task with the objectives of maximizing classification accuracy and minimizing the number of selected features. In order to select optimal features, we have proposed a binary Compact NSGA-II (CNSGA-II) algorithm. Compactness represents the population as a probability distribution to enhance evolutionary algorithms not only to be more memory-efficient but also to reduce the number of fitness evaluations. Instead of holding two populations during the optimization process, our proposed method uses several Probability Vectors (PVs) to generate new individuals. Each PV efficiently explores a region of the search space to find non-dominated solutions instead of generating candidate solutions from a small population as is the common approach in most evolutionary algorithms. To the best of our knowledge, this is the first compact multi-objective algorithm proposed for feature selection. The reported results for expensive optimization cases with a limited budget on five datasets show that the CNSGA-II performs more efficiently than the well-known NSGA-II method in terms of the hypervolume (HV) performance metric requiring less memory. The proposed method and experimental results are explained and analyzed in detail.


title: Indiscriminate Data Poisoning Attacks on Pre-trained Feature Extractors

abstract: Machine learning models have achieved great success in supervised learning tasks for end-to-end training, which requires a large amount of labeled data that is not always feasible. Recently, many practitioners have shifted to self-supervised learning methods that utilize cheap unlabeled data to learn a general feature extractor via pre-training, which can be further applied to personalized downstream tasks by simply training an additional linear layer with limited labeled data. However, such a process may also raise concerns regarding data poisoning attacks. For instance, indiscriminate data poisoning attacks, which aim to decrease model utility by injecting a small number of poisoned data into the training set, pose a security risk to machine learning models, but have only been studied for end-to-end supervised learning. In this paper, we extend the exploration of the threat of indiscriminate attacks on downstream tasks that apply pre-trained feature extractors. Specifically, we propose two types of attacks: (1) the input space attacks, where we modify existing attacks to directly craft poisoned data in the input space. However, due to the difficulty of optimization under constraints, we further propose (2) the feature targeted attacks, where we mitigate the challenge with three stages, firstly acquiring target parameters for the linear head; secondly finding poisoned features by treating the learned feature representations as a dataset; and thirdly inverting the poisoned features back to the input space. Our experiments examine such attacks in popular downstream tasks of fine-tuning on the same dataset and transfer learning that considers domain adaptation. Empirical results reveal that transfer learning is more vulnerable to our attacks. Additionally, input space attacks are a strong threat if no countermeasures are posed, but are otherwise weaker than feature targeted attacks.


title: A Comprehensive Review of Machine Learning Advances on Data Change: A Cross-Field Perspective

abstract: Recent artificial intelligence (AI) technologies show remarkable evolution in various academic fields and industries. However, in the real world, dynamic data lead to principal challenges for deploying AI models. An unexpected data change brings about severe performance degradation in AI models. We identify two major related research fields, domain shift and concept drift according to the setting of the data change. Although these two popular research fields aim to solve distribution shift and non-stationary data stream problems, the underlying properties remain similar which also encourages similar technical approaches. In this review, we regroup domain shift and concept drift into a single research problem, namely the data change problem, with a systematic overview of state-of-the-art methods in the two research fields. We propose a three-phase problem categorization scheme to link the key ideas in the two technical fields. We thus provide a novel scope for researchers to explore contemporary technical strategies, learn industrial applications, and identify future directions for addressing data change challenges.


title: On the sum of character codegrees of finite groups

abstract: Let $\chi$ be an irreducible character of a group $G.$ We denote the sum of the codegrees of the irreducible characters of $G$ by $S_c(G)=\sum_{\chi\in {\rm Irr}(G)}{\rm cod}(\chi).$ We consider the question if $S_c(G)\leq S_c(C_n)$ is true for any finite group $G,$ where $n=|G|$ and $C_n$ is a cyclic group of order $n.$ We show this inequality holds for many classes of groups. In particular, we provide an affirmative answer for any finite group whose order is divisible by up to 99 primes. However, we show that the question does not hold true in all cases, by evidence of a counterexample.


title: Television Discourse Decoded: Comprehensive Multimodal Analytics at Scale

abstract: In this paper, we tackle the complex task of analyzing televised debates, with a focus on a prime time news debate show from India. Previous methods, which often relied solely on text, fall short in capturing the multimedia essence of these debates. To address this gap, we introduce a comprehensive automated toolkit that employs advanced computer vision and speech-to-text techniques for large-scale multimedia analysis. Utilizing state-of-the-art computer vision algorithms and speech-to-text methods, we transcribe, diarize, and analyze thousands of YouTube videos of prime-time television debates in India. These debates are a central part of Indian media but have been criticized for compromised journalistic integrity and excessive dramatization. Our toolkit provides concrete metrics to assess bias and incivility, capturing a comprehensive multimedia perspective that includes text, audio utterances, and video frames. Our findings reveal significant biases in topic selection and panelist representation, along with alarming levels of incivility. This work offers a scalable, automated approach for future research in multimedia analysis, with profound implications for the quality of public discourse and democratic debate. We will make our data analysis pipeline and collected data publicly available to catalyze further research in this domain.


title: FAST: An Optimization Framework for Fast Additive Segmentation in Transparent ML

abstract: We present FAST, an optimization framework for fast additive segmentation. FAST segments piecewise constant shape functions for each feature in a dataset to produce transparent additive models. The framework leverages a novel optimization procedure to fit these models $\sim$2 orders of magnitude faster than existing state-of-the-art methods, such as explainable boosting machines \citep{nori2019interpretml}. We also develop new feature selection algorithms in the FAST framework to fit parsimonious models that perform well. Through experiments and case studies, we show that FAST improves the computational efficiency and interpretability of additive models.


title: Guarantees on Warm-Started QAOA: Single-Round Approximation Ratios for 3-Regular MAXCUT and Higher-Round Scaling Limits

abstract: We generalize Farhi et al.'s 0.6924-approximation result technique of the Max-Cut Quantum Approximate Optimization Algorithm (QAOA) on 3-regular graphs to obtain provable lower bounds on the approximation ratio for warm-started QAOA. Given an initialization angle $\theta$, we consider warm-starts where the initial state is a product state where each qubit position is angle $\theta$ away from either the north or south pole of the Bloch sphere; of the two possible qubit positions the position of each qubit is decided by some classically obtained cut encoded as a bitstring $b$. We illustrate through plots how the properties of $b$ and the initialization angle $\theta$ influence the bound on the approximation ratios of warm-started QAOA. We consider various classical algorithms (and the cuts they produce which we use to generate the warm-start). Our results strongly suggest that there does not exist any choice of initialization angle that yields a (worst-case) approximation ratio that simultaneously beats standard QAOA and the classical algorithm used to create the warm-start. Additionally, we show that at $\theta=60^\circ$, warm-started QAOA is able to (effectively) recover the cut used to generate the warm-start, thus suggesting that in practice, this value could be a promising starting angle to explore alternate solutions in a heuristic fashion. Finally, for any combinatorial optimization problem with integer-valued objective values, we provide bounds on the required circuit depth needed for warm-started QAOA to achieve some change in approximation ratio; more specifically, we show that for small $\theta$, the bound is roughly proportional to $1/\theta$.


title: A note on the codegree of finite groups

abstract: Let $\chi$ be an irreducible character of a group $G,$ and $S_c(G)=\sum_{\chi\in {\rm Irr}(G)}{\rm cod}(\chi)$ be the sum of the codegrees of the irreducible characters of $G.$ Write ${\rm fcod} (G)=\frac{S_c(G)}{|G|}.$ We aim to explore the structure of finite groups in terms of ${\rm fcod} (G).$ On the other hand, we determine the lower bound of $S_c(G)$ for nonsolvable groups and prove that if $G$ is nonsolvable, then $S_c(G)\geq S_c(A_5)=68,$ with equality if and only if $G\cong A_5.$ Additionally, we show that there is a solvable group so that it has the codegree sum as $A_5.$


title: Scalar curvature rigidity of the four-dimensional sphere

abstract: Let $(M,g)$ be a closed connected oriented (possibly non-spin) smooth four-dimensional manifold with scalar curvature bounded below by $n(n-1)$. In this paper, we prove that if $f$ is a smooth map of non-zero degree from $(M, g)$ to the unit four-sphere, then $f$ is an isometry. Following ideas of Gromov, we use $\mu$-bubbles and a version with coefficients of the rigidity of the three-sphere to rule out the case of strict inequality. Our proof of rigidity is based on the harmonic map heat flow coupled with the Ricci flow.


title: Data Storytelling in Data Visualisation: Does it Enhance the Efficiency and Effectiveness of Information Retrieval and Insights Comprehension?

abstract: Data storytelling (DS) is rapidly gaining attention as an approach that integrates data, visuals, and narratives to create data stories that can help a particular audience to comprehend the key messages underscored by the data with enhanced efficiency and effectiveness. It has been posited that DS can be especially advantageous for audiences with limited visualisation literacy, by presenting the data clearly and concisely. However, empirical studies confirming whether data stories indeed provide these benefits over conventional data visualisations are scarce. To bridge this gap, we conducted a study with 103 participants to determine whether DS indeed improve both efficiency and effectiveness in tasks related to information retrieval and insights comprehension. Our findings suggest that data stories do improve the efficiency of comprehension tasks, as well as the effectiveness of comprehension tasks that involve a single insight compared with conventional visualisations. Interestingly, these benefits were not associated with participants' visualisation literacy.


title: User Feedback-Informed Interface Design for Flow Management Data and Services (FMDS)

abstract: The transition to a microservices-based Flow Management Data and Services (FMDS) architecture from the existing Traffic Flow Management System (TFMS) is a critical enabler of the vision for an Information-Centric National Airspace System (NAS). The need to design a user-centric interface for FMDS is a key technical gap, as this interface connects NAS data and services to the traffic management specialists within all stakeholder groups (e.g., FAA, airlines). We provide a research-driven approach towards designing such a graphical user interface (GUI) for FMDS. Major goals include unifying the more than 50 disparate traffic management services currently hosted on TFMS, as well as streamlining the process of evaluating, modeling, and monitoring Traffic Management Initiatives (TMIs). Motivated by this, we iteratively designed a GUI leveraging human factors engineering and user experience design principles, as well as user interviews. Through user testing and interviews, we identify workflow benefits of our GUI (e.g., reduction in task completion time), along with next steps for developing a live prototype.


title: StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing

abstract: Given a script, the challenge in Movie Dubbing (Visual Voice Cloning, V2C) is to generate speech that aligns well with the video in both time and emotion, based on the tone of a reference audio track. Existing state-of-the-art V2C models break the phonemes in the script according to the divisions between video frames, which solves the temporal alignment problem but leads to incomplete phoneme pronunciation and poor identity stability. To address this problem, we propose StyleDubber, which switches dubbing learning from the frame level to phoneme level. It contains three main components: (1) A multimodal style adaptor operating at the phoneme level to learn pronunciation style from the reference audio, and generate intermediate representations informed by the facial emotion presented in the video; (2) An utterance-level style learning module, which guides both the mel-spectrogram decoding and the refining processes from the intermediate embeddings to improve the overall style expression; And (3) a phoneme-guided lip aligner to maintain lip sync. Extensive experiments on two of the primary benchmarks, V2C and Grid, demonstrate the favorable performance of the proposed method as compared to the current state-of-the-art. The source code and trained models will be released to the public.


title: Getting into the Flow: Towards Better Type Error Messages for Constraint-Based Type Inference

abstract: Creating good type error messages for constraint-based type inference systems is difficult. Typical type error messages reflect implementation details of the underlying constraint-solving algorithms rather than the specific factors leading to type mismatches. We propose using subtyping constraints that capture data flow to classify and explain type errors. Our algorithm explains type errors as faulty data flows, which programmers are already used to reasoning about, and illustrates these data flows as sequences of relevant program locations. We show that our ideas and algorithm are not limited to languages with subtyping, as they can be readily integrated with Hindley-Milner type inference. In addition to these core contributions, we present the results of a user study to evaluate the quality of our messages compared to other implementations. While the quantitative evaluation does not show that flow-based messages improve the localization or understanding of the causes of type errors, the qualitative evaluation suggests a real need and demand for flow-based messages.


title: Social Mechanics

abstract: Social physics is the application of ideas, concepts and tools from physics to study social phenomena. In this article, we present a mechanical theory underlying a mathematical treatment of social physics. We explore the possibility of using fundamental concepts like position, motion, inertia, and interaction, to effectively regard social phenomena analogously to particles interacting with each other in physics. From these concepts, along with heuristics of social change, we investigate the notions of free motion, motion under the influence of a net deterministic, as well as stochastic force. To test these ideas we model partisan preferences in the United States according to the outcomes of presidential elections.


title: Removal paths avoiding vertices

abstract: In this paper, we show that for any positive integer $m$ and $k\in [2]$, let $G$ be a $(2m+2k+2)$-connected graph and let $a_1,\ldots , a_m, s, t$ be any distinct vertices of $G$, there are $k$ internally disjoint $s$-$t$ paths $P_1, \ldots, P_k$ in $G$ such that $\{a_1,\ldots , a_m\} \cap \bigcup^{k}_{i=1}V (P_i) = \emptyset$ and $G- \bigcup^{k}_{i=1}V (P_i)$ is 2-connected, which generalizes the result by Chen, Gould and Yu [Combinatorica 23 (2003) 185--203], and Kriesell [J. Graph Theory 36 (2001) 52--58]. The case $k=1$ implies that for any $(2m+5)$-connected graph $G$, any edge $e \in E(G)$, and any distinct vertices $a_1,\ldots , a_m$ of $G-V(e)$, there exists a cycle $C$ in $G- \{a_1,\ldots , a_m\}$ such that $e\in E(C)$ and $G- V(C)$ is 2-connected, which improves the bound $10m+11$ of Y. Hong, L. Kang and X. Yu in [J. Graph Theory 80 (2015) 253--267].


title: Invertibility of local geodesic transverse and mixed ray transforms II: higher order tensors

abstract: Consider a compact Riemannian manifold in dimension $n$ with strictly convex boundary. We show the local invertibility near a boundary point of the transverse ray transform of $2$ tensors for $n\geq 3$ and the mixed ray transform of $2+2$ tensors for $n=3$. When the manifold admits a strictly convex function, this local invertibility result leads to global invertibility.


title: YOLO-Ant: A Lightweight Detector via Depthwise Separable Convolutional and Large Kernel Design for Antenna Interference Source Detection

abstract: In the era of 5G communication, removing interference sources that affect communication is a resource-intensive task. The rapid development of computer vision has enabled unmanned aerial vehicles to perform various high-altitude detection tasks. Because the field of object detection for antenna interference sources has not been fully explored, this industry lacks dedicated learning samples and detection models for this specific task. In this article, an antenna dataset is created to address important antenna interference source detection issues and serves as the basis for subsequent research. We introduce YOLO-Ant, a lightweight CNN and transformer hybrid detector specifically designed for antenna interference source detection. Specifically, we initially formulated a lightweight design for the network depth and width, ensuring that subsequent investigations were conducted within a lightweight framework. Then, we propose a DSLK-Block module based on depthwise separable convolution and large convolution kernels to enhance the network's feature extraction ability, effectively improving small object detection. To address challenges such as complex backgrounds and large interclass differences in antenna detection, we construct DSLKVit-Block, a powerful feature extraction module that combines DSLK-Block and transformer structures. Considering both its lightweight design and accuracy, our method not only achieves optimal performance on the antenna dataset but also yields competitive results on public datasets.


title: Rampo: A CEGAR-based Integration of Binary Code Analysis and System Falsification for Cyber-Kinetic Vulnerability Detection

abstract: This paper presents a novel tool, named Rampo, that can perform binary code analysis to identify cyber kinetic vulnerabilities in CPS. The tool takes as input a Signal Temporal Logic (STL) formula that describes the kinetic effect, i.e., the behavior of the physical system, that one wants to avoid. The tool then searches the possible cyber trajectories in the binary code that may lead to such physical behavior. This search integrates binary code analysis tools and hybrid systems falsification tools using a Counter-Example Guided Abstraction Refinement (CEGAR) approach. Rampo starts by analyzing the binary code to extract symbolic constraints that represent the different paths in the code. These symbolic constraints are then passed to a Satisfiability Modulo Theories (SMT) solver to extract the range of control signals that can be produced by each path in the code. The next step is to search over possible physical trajectories using a hybrid systems falsification tool that adheres to the behavior of the cyber paths and yet leads to violations of the STL formula. Since the number of cyber paths that need to be explored increases exponentially with the length of physical trajectories, we iteratively perform refinement of the cyber path constraints based on the previous falsification result and traverse the abstract path tree obtained from the control program to explore the search space of the system. To illustrate the practical utility of binary code analysis in identifying cyber kinetic vulnerabilities, we present case studies from diverse CPS domains, showcasing how they can be discovered in their control programs. Our tool could compute the same number of vulnerabilities while leading to a speedup that ranges from 3x to 98x.


title: Decreasing paths of polygons

abstract: We call a continuous path of polygons decreasing if the convex hulls of the polygons form a decreasing family of sets. For an arbitrary polygon of more than three vertices, we characterize the polygons contained in it that can be reached by a decreasing path (attainability problem), and we show that this can be done by a finite application of "pull-in" moves (bang-bang problem). In the case of triangles, this problems was investigated by Goodman, Johansen, Ramsey, and Frydman among others, in connection with the embeddability problem for non-homogeneous Markov processes.


title: Neuromorphic Synergy for Video Binarization

abstract: Bimodal objects, such as the checkerboard pattern used in camera calibration, markers for object tracking, and text on road signs, to name a few, are prevalent in our daily lives and serve as a visual form to embed information that can be easily recognized by vision systems. While binarization from intensity images is crucial for extracting the embedded information in the bimodal objects, few previous works consider the task of binarization of blurry images due to the relative motion between the vision sensor and the environment. The blurry images can result in a loss in the binarization quality and thus degrade the downstream applications where the vision system is in motion. Recently, neuromorphic cameras offer new capabilities for alleviating motion blur, but it is non-trivial to first deblur and then binarize the images in a real-time manner. In this work, we propose an event-based binary reconstruction method that leverages the prior knowledge of the bimodal target's properties to perform inference independently in both event space and image space and merge the results from both domains to generate a sharp binary image. We also develop an efficient integration method to propagate this binary image to high frame rate binary video. Finally, we develop a novel method to naturally fuse events and images for unsupervised threshold identification. The proposed method is evaluated in publicly available and our collected data sequence, and shows the proposed method can outperform the SOTA methods to generate high frame rate binary video in real-time on CPU-only devices.


title: Optimal PSPACE-hardness of Approximating Set Cover Reconfiguration

abstract: In the Minmax Set Cover Reconfiguration problem, given a set system $\mathcal{F}$ over a universe and its two covers $\mathcal{C}^\mathsf{start}$ and $\mathcal{C}^\mathsf{goal}$ of size $k$, we wish to transform $\mathcal{C}^\mathsf{start}$ into $\mathcal{C}^\mathsf{goal}$ by repeatedly adding or removing a single set of $\mathcal{F}$ while covering the universe in any intermediate state. Then, the objective is to minimize the maximize size of any intermediate cover during transformation. We prove that Minmax Set Cover Reconfiguration and Minmax Dominating Set Reconfiguration are $\mathsf{PSPACE}$-hard to approximate within a factor of $2-\frac{1}{\operatorname{polyloglog} N}$, where $N$ is the size of the universe and the number of vertices in a graph, respectively, improving upon Ohsaka (SODA 2024) and Karthik C. S. and Manurangsi (2023). This is the first result that exhibits a sharp threshold for the approximation factor of any reconfiguration problem because both problems admit a $2$-factor approximation algorithm as per Ito, Demaine, Harvey, Papadimitriou, Sideri, Uehara, and Uno (Theor. Comput. Sci., 2011). Our proof is based on a reconfiguration analogue of the FGLSS reduction from Probabilistically Checkable Reconfiguration Proofs of Hirahara and Ohsaka (2024). We also prove that for any constant $\varepsilon \in (0,1)$, Minmax Hypergraph Vertex Cover Reconfiguration on $\operatorname{poly}(\varepsilon^{-1})$-uniform hypergraphs is $\mathsf{PSPACE}$-hard to approximate within a factor of $2-\varepsilon$.


title: Training Artificial Neural Networks by Coordinate Search Algorithm

abstract: Training Artificial Neural Networks poses a challenging and critical problem in machine learning. Despite the effectiveness of gradient-based learning methods, such as Stochastic Gradient Descent (SGD), in training neural networks, they do have several limitations. For instance, they require differentiable activation functions, and cannot optimize a model based on several independent non-differentiable loss functions simultaneously; for example, the F1-score, which is used during testing, can be used during training when a gradient-free optimization algorithm is utilized. Furthermore, the training in any DNN can be possible with a small size of the training dataset. To address these concerns, we propose an efficient version of the gradient-free Coordinate Search (CS) algorithm, an instance of General Pattern Search methods, for training neural networks. The proposed algorithm can be used with non-differentiable activation functions and tailored to multi-objective/multi-loss problems. Finding the optimal values for weights of ANNs is a large-scale optimization problem. Therefore instead of finding the optimal value for each variable, which is the common technique in classical CS, we accelerate optimization and convergence by bundling the weights. In fact, this strategy is a form of dimension reduction for optimization problems. Based on the experimental results, the proposed method, in some cases, outperforms the gradient-based approach, particularly, in situations with insufficient labeled training data. The performance plots demonstrate a high convergence rate, highlighting the capability of our suggested method to find a reasonable solution with fewer function calls. As of now, the only practical and efficient way of training ANNs with hundreds of thousands of weights is gradient-based algorithms such as SGD or Adam. In this paper we introduce an alternative method for training ANN.


title: DiffusionNOCS: Managing Symmetry and Uncertainty in Sim2Real Multi-Modal Category-level Pose Estimation

abstract: This paper addresses the challenging problem of category-level pose estimation. Current state-of-the-art methods for this task face challenges when dealing with symmetric objects and when attempting to generalize to new environments solely through synthetic data training. In this work, we address these challenges by proposing a probabilistic model that relies on diffusion to estimate dense canonical maps crucial for recovering partial object shapes as well as establishing correspondences essential for pose estimation. Furthermore, we introduce critical components to enhance performance by leveraging the strength of the diffusion models with multi-modal input representations. We demonstrate the effectiveness of our method by testing it on a range of real datasets. Despite being trained solely on our generated synthetic data, our approach achieves state-of-the-art performance and unprecedented generalization qualities, outperforming baselines, even those specifically trained on the target domain.


title: On the group pseudo-algebra of finite groups

abstract: Let $G$ be a finite group. The group pseudo-algebra of $G$ is defined as the multi-set $C(G)=\{(d,m_G(d))\mid d\in{\rm Cod}(G)\},$ where $m_G(d)$ is the number of irreducible characters of with codegree $d\in {\rm Cod}(G)$. We show that there exist two finite $p$-groups with distinct orders that have the same group pseudo-algebra, providing an answer to Question 3.2 in \cite{Moreto2023}. In addition, we also discuss under what hypothesis two $p$-groups with the same group pseudo-algebra will be isomorphic.


title: Bias in Language Models: Beyond Trick Tests and Toward RUTEd Evaluation

abstract: Bias benchmarks are a popular method for studying the negative impacts of bias in LLMs, yet there has been little empirical investigation of whether these benchmarks are actually indicative of how real world harm may manifest in the real world. In this work, we study the correspondence between such decontextualized "trick tests" and evaluations that are more grounded in Realistic Use and Tangible {Effects (i.e. RUTEd evaluations). We explore this correlation in the context of gender-occupation bias--a popular genre of bias evaluation. We compare three de-contextualized evaluations adapted from the current literature to three analogous RUTEd evaluations applied to long-form content generation. We conduct each evaluation for seven instruction-tuned LLMs. For the RUTEd evaluations, we conduct repeated trials of three text generation tasks: children's bedtime stories, user personas, and English language learning exercises. We found no correspondence between trick tests and RUTEd evaluations. Specifically, selecting the least biased model based on the de-contextualized results coincides with selecting the model with the best performance on RUTEd evaluations only as often as random chance. We conclude that evaluations that are not based in realistic use are likely insufficient to mitigate and assess bias and real-world harms.


title: Electron-phonon coupling in ferromagnetic Fe-Co alloys from first principles

abstract: We calculate from first principles the electron-phonon coupling strength in ferromagnetic iron-cobalt Fe$_{1-x}$Co$_x$ alloys for compositions ranging from $x=0$ to $x=0.75$. We find strong, spin-dependent variation of the electron-phonon coupling strength with alloy composition. The minimum of the electron-phonon interaction is found near the composition $x=0.25$. We analyze the variation of the electron-phonon interaction with composition, as a function of electron spin, density of states, electron-phonon matrix elements, and phonon frequencies. Our results are in good qualitative agreement with magnetization dynamics experiments.


title: Null controllability for stochastic semi-discrete parabolic equations

abstract: In this paper, we present a null controllability result for a class of stochastic semi-discrete parabolic equations. For this purpose, an observability estimate is established for backward stochastic semi-discrete parabolic equations, with an explicit observability constant that depends on the discretization parameter. This estimate is obtained by a new Carleman estimate for backward stochastic semi-discrete parabolic operators.


title: PDEformer: Towards a Foundation Model for One-Dimensional Partial Differential Equations

abstract: This paper introduces PDEformer, a neural solver for partial differential equations (PDEs) capable of simultaneously addressing various types of PDEs. We propose to represent the PDE in the form of a computational graph, facilitating the seamless integration of both symbolic and numerical information inherent in a PDE. A graph Transformer and an implicit neural representation (INR) are employed to generate mesh-free predicted solutions. Following pretraining on data exhibiting a certain level of diversity, our model achieves zero-shot accuracies on benchmark datasets that is comparable to those of specifically trained expert models. Additionally, PDEformer demonstrates promising results in the inverse problem of PDE coefficient recovery.


title: Unbiased Estimation for Total Treatment Effect Under Interference Using Aggregated Dyadic Data

abstract: In social media platforms, user behavior is often influenced by interactions with other users, complicating the accurate estimation of causal effects in traditional A/B experiments. This study investigates situations where an individual's outcome can be broken down into the sum of multiple pairwise outcomes, a reflection of user interactions. These outcomes, referred to as dyadic data, are prevalent in many social network contexts. Utilizing a Bernoulli randomized design, we introduce a novel unbiased estimator for the total treatment effect (TTE), which quantifies the difference in population mean when all individuals are assigned to treatment versus control groups. We further explore the bias of our estimator in scenarios where it is impractical to include all individuals in the experiment, a common constraint in online control experiments. Our numerical results reveal that our proposed estimator consistently outperforms some commonly used estimators, underscoring its potential for more precise causal effect estimation in social media environments.


title: OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identification

abstract: There has been an increasing interest in large speech models that can perform multiple tasks in a single model. Such models usually adopt an encoder-decoder or decoder-only architecture due to their popularity and good performance in many domains. However, autoregressive models can be slower during inference compared to non-autoregressive models and also have potential risks of hallucination. Though prior studies observed promising results of non-autoregressive models for certain tasks at small scales, it remains unclear if they can be scaled to speech-to-text generation in diverse languages and tasks. Inspired by the Open Whisper-style Speech Model (OWSM) project, we propose OWSM-CTC, a novel encoder-only speech foundation model based on Connectionist Temporal Classification (CTC). It is trained on 180k hours of public audio data for multilingual automatic speech recognition (ASR), speech translation (ST), and language identification (LID). Compared to encoder-decoder OWSM, our OWSM-CTC achieves competitive results on ASR and up to 24% relative improvement on ST, while it is more robust and 3 to 4 times faster for inference. OWSM-CTC also improves the long-form ASR result with 20x speed-up. We will publicly release our code, pre-trained model, and training logs to promote open science in speech foundation models.


title: Ego Group Partition: A Novel Framework for Improving Ego Experiments in Social Networks

abstract: Estimating the average treatment effect in social networks is challenging due to individuals influencing each other. One approach to address interference is ego cluster experiments, where each cluster consists of a central individual (ego) and its peers (alters). Clusters are randomized, and only the effects on egos are measured. In this work, we propose an improved framework for ego cluster experiments called ego group partition (EGP), which directly generates two groups and an ego sub-population instead of ego clusters. Under specific model assumptions, we propose two ego group partition algorithms. Compared to the original ego clustering algorithm, our algorithms produce more egos, yield smaller biases, and support parallel computation. The performance of our algorithms is validated through simulation and real-world case studies.


title: HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts

abstract: The Mixture of Experts (MoE) for language models has been proven effective in augmenting the capacity of models by dynamically routing each input token to a specific subset of experts for processing. Despite the success, most existing methods face a challenge for balance between sparsity and the availability of expert knowledge: enhancing performance through increased use of expert knowledge often results in diminishing sparsity during expert selection. To mitigate this contradiction, we propose HyperMoE, a novel MoE framework built upon Hypernetworks. This framework integrates the computational processes of MoE with the concept of knowledge transferring in multi-task learning. Specific modules generated based on the information of unselected experts serve as supplementary information, which allows the knowledge of experts not selected to be used while maintaining selection sparsity. Our comprehensive empirical evaluations across multiple datasets and backbones establish that HyperMoE significantly outperforms existing MoE methods under identical conditions concerning the number of experts.


title: Coded Backscattering Communication with LTE Pilots as Ambient Signal

abstract: The 3GPP has recently conducted a study on the Ambient Internet of Things (AIoT), with a particular emphasis on examining backscatter communications as one of the primary techniques under consideration. Previous investigations into Ambient Backscatter Communications (AmBC) within the long term evolution (LTE) downlink have shown that it is feasible to utilize the user equipment channel estimator as a receiver for demodulating frequency shift keyed (FSK) messages transmitted by the backscatter devices. In practical deployment scenarios, the backscattered link often experiences a low signal-to-noise ratio, leading to subpar bit error rate (BER) performance in the case of uncoded transmissions. In this paper, we propose the adoption of the same convolutional coding methodology for backscatter links that is already employed for LTE downlink control signals. This approach facilitates the reuse of identical demodulation functions at the modem for both control signals and backscattered AIoT messages. To assess the performance of the proposed scheme, we conducted experiments utilizing real LTE downlink signals generated by a mobile operator within an office environment. When compared to uncoded FSK, convolutional channel coding delivers a notable gain of approximately 6 dB at a BER of $10^{-3}$. Consequently, the AmBC system demonstrates a high level of reliability, achieving a BER of $10^{-3}$ at a Signal-to-Noise Ratio (SNR) of 5 dB.


title: Guiding the underwater acoustic target recognition with interpretable contrastive learning

abstract: Recognizing underwater targets from acoustic signals is a challenging task owing to the intricate ocean environments and variable underwater channels. While deep learning-based systems have become the mainstream approach for underwater acoustic target recognition, they have faced criticism for their lack of interpretability and weak generalization performance in practical applications. In this work, we apply the class activation mapping (CAM) to generate visual explanations for the predictions of a spectrogram-based recognition system. CAM can help to understand the behavior of recognition models by highlighting the regions of the input features that contribute the most to the prediction. Our explorations reveal that recognition models tend to focus on the low-frequency line spectrum and high-frequency periodic modulation information of underwater signals. Based on the observation, we propose an interpretable contrastive learning (ICL) strategy that employs two encoders to learn from acoustic features with different emphases (line spectrum and modulation information). By imposing constraints between encoders, the proposed strategy can enhance the generalization performance of the recognition system. Our experiments demonstrate that the proposed contrastive learning approach can improve the recognition accuracy and bring significant improvements across various underwater databases.


title: FinBen: A Holistic Financial Benchmark for Large Language Models

abstract: LLMs have transformed NLP and shown promise in various fields, yet their potential in finance is underexplored due to a lack of comprehensive evaluation benchmarks, the rapid development of LLMs, and the complexity of financial tasks. In this paper, we introduce FinBen, the first extensive open-source evaluation benchmark, including 36 datasets spanning 24 financial tasks, covering seven critical aspects: information extraction (IE), textual analysis, question answering (QA), text generation, risk management, forecasting, and decision-making. FinBen offers several key innovations: a broader range of tasks and datasets, the first evaluation of stock trading, novel agent and Retrieval-Augmented Generation (RAG) evaluation, and three novel open-source evaluation datasets for text summarization, question answering, and stock trading. Our evaluation of 15 representative LLMs, including GPT-4, ChatGPT, and the latest Gemini, reveals several key findings: While LLMs excel in IE and textual analysis, they struggle with advanced reasoning and complex tasks like text generation and forecasting. GPT-4 excels in IE and stock trading, while Gemini is better at text generation and forecasting. Instruction-tuned LLMs improve textual analysis but offer limited benefits for complex tasks such as QA. FinBen has been used to host the first financial LLMs shared task at the FinNLP-AgentScen workshop during IJCAI-2024, attracting 12 teams. Their novel solutions outperformed GPT-4, showcasing FinBen's potential to drive innovation in financial LLMs. All datasets, results, and codes are released for the research community: https://github.com/The-FinAI/PIXIU.


title: SingVisio: Visual Analytics of Diffusion Model for Singing Voice Conversion

abstract: In this study, we present SingVisio, an interactive visual analysis system that aims to explain the diffusion model used in singing voice conversion. SingVisio provides a visual display of the generation process in diffusion models, showcasing the step-by-step denoising of the noisy spectrum and its transformation into a clean spectrum that captures the desired singer's timbre. The system also facilitates side-by-side comparisons of different conditions, such as source content, melody, and target timbre, highlighting the impact of these conditions on the diffusion generation process and resulting conversions. Through comprehensive evaluations, SingVisio demonstrates its effectiveness in terms of system design, functionality, explainability, and user-friendliness. It offers users of various backgrounds valuable learning experiences and insights into the diffusion model for singing voice conversion.


title: Dynamics of Symmetry-Protected Topological Matter on a Quantum Computer

abstract: Control of topological edge modes is desirable for encoding quantum information resiliently against external noise. Their implementation on quantum hardware, however, remains a long-standing problem due to current limitations of circuit depth and noise, which grows with the number of time steps. By utilizing recently developed constant-depth quantum circuits in which the circuit depth is independent of time, we demonstrate successful long-time dynamics simulation of bulk and surface modes in topological insulators on noisy intermediate-scale quantum (NISQ) processors, which exhibits robust signatures of localized topological modes. We further identify a class of one-dimensional topological Hamiltonians that can be readily simulated with NISQ hardware. Our results provide a pathway towards stable long-time implementation of interacting many-body systems on present day quantum processors.

categories: quant-ph cond-mat.mes-hall cond-mat.str-el physics.comp-ph


title: Turbulent vortex with moderate dust settling probed by scattering-induced polarization in the IRS 48 system

abstract: We investigate the crescent-shaped dust trap in the transition disk, Oph IRS 48, using well-resolved (sub)millimeter polarimetric observations at ALMA Band 7 (870 $\mu$m). The dust polarization map reveals patterns consistent with dust scattering-induced polarization. There is a relative displacement between the polarized flux and the total flux, which holds the key to understanding the dust scale heights in this system. We model the polarization observations, focusing on the effects of dust scale heights. We find that the interplay between the inclination-induced polarization and the polarization arising from radiation anisotropy in the crescent determines the observed polarization; the anisotropy is controlled by the dust optical depth along the midplane, which is, in turn, determined by the dust scale height in the vertical direction. We find that the dust grains can neither be completely settled nor well mixed with the gas. The completely settled case produces little radial displacement between the total and polarized flux, while the well-mixed case produces an azimuthal pattern in the outer (radial) edge of the crescent that is not observed. Our best model has a gas-to-dust scale height ratio of 2, and can reproduce both the radial displacement and the azimuthal displacement between the total and polarized flux. We infer an effective turbulence $\alpha$ parameter of approximately $0.0001-0.005$. The scattering-induced polarization provides insight into a turbulent vortex with a moderate level of dust settling in the IRS 48 system, which is hard to achieve otherwise.


title: SoftQE: Learned Representations of Queries Expanded by LLMs

abstract: We investigate the integration of Large Language Models (LLMs) into query encoders to improve dense retrieval without increasing latency and cost, by circumventing the dependency on LLMs at inference time. SoftQE incorporates knowledge from LLMs by mapping embeddings of input queries to those of the LLM-expanded queries. While improvements over various strong baselines on in-domain MS-MARCO metrics are marginal, SoftQE improves performance by 2.83 absolute percentage points on average on five out-of-domain BEIR tasks.


title: Discriminant Distance-Aware Representation on Deterministic Uncertainty Quantification Methods

abstract: Uncertainty estimation is a crucial aspect of deploying dependable deep learning models in safety-critical systems. In this study, we introduce a novel and efficient method for deterministic uncertainty estimation called Discriminant Distance-Awareness Representation (DDAR). Our approach involves constructing a DNN model that incorporates a set of prototypes in its latent representations, enabling us to analyze valuable feature information from the input data. By leveraging a distinction maximization layer over optimal trainable prototypes, DDAR can learn a discriminant distance-awareness representation. We demonstrate that DDAR overcomes feature collapse by relaxing the Lipschitz constraint that hinders the practicality of deterministic uncertainty methods (DUMs) architectures. Our experiments show that DDAR is a flexible and architecture-agnostic method that can be easily integrated as a pluggable layer with distance-sensitive metrics, outperforming state-of-the-art uncertainty estimation methods on multiple benchmark problems.


title: Antifragile Perimeter Control: Anticipating and Gaining from Disruptions with Reinforcement Learning

abstract: The optimal operation of transportation networks is often susceptible to unexpected disruptions, such as traffic incidents and social events. Many established control strategies rely on mathematical models that struggle to cope with real-world uncertainties, leading to a significant decline in effectiveness when faced with substantial disruptions. While previous research works have dedicated efforts to improving the robustness or resilience of transportation systems against disruptions, this paper applies the cutting-edge concept of antifragility to better design a traffic control strategy for urban road networks. Antifragility sets itself apart from robustness and resilience as it represents a system's ability to not only withstand stressors, shocks, and volatility but also thrive and enhance performance in the presence of such adversarial events. Hence, modern transportation systems call for solutions that are antifragile. In this work, we propose a model-free deep Reinforcement Learning (RL) scheme to control a two-region urban traffic perimeter network. The system exploits the learning capability of RL under disruptions to achieve antifragility. By monitoring the change rate and curvature of the traffic state with the RL framework, the proposed algorithm anticipates imminent disruptions. An additional term is also integrated into the RL algorithm as redundancy to improve the performance under disruption scenarios. When compared to a state-of-the-art model predictive control approach and a state-of-the-art RL algorithm, our proposed method demonstrates two antifragility-related properties: (a) gradual performance improvement under disruptions of constant magnitude; and (b) increasingly superior performance under growing disruptions.


title: Pre-trained Transformer-Enabled Strategies with Human-Guided Fine-Tuning for End-to-end Navigation of Autonomous Vehicles

abstract: Autonomous driving (AD) technology, leveraging artificial intelligence, strives for vehicle automation. End-toend strategies, emerging to simplify traditional driving systems by integrating perception, decision-making, and control, offer new avenues for advanced driving functionalities. Despite their potential, current challenges include data efficiency, training complexities, and poor generalization. This study addresses these issues with a novel end-to-end AD training model, enhancing system adaptability and intelligence. The model incorporates a Transformer module into the policy network, undergoing initial behavior cloning (BC) pre-training for update gradients. Subsequently, fine-tuning through reinforcement learning with human guidance (RLHG) adapts the model to specific driving environments, aiming to surpass the performance limits of imitation learning (IL). The fine-tuning process involves human interactions, guiding the model to acquire more efficient and safer driving behaviors through supervision, intervention, demonstration, and reward feedback. Simulation results demonstrate that this framework accelerates learning, achieving precise control and significantly enhancing safety and reliability. Compared to other advanced baseline methods, the proposed approach excels in challenging AD tasks. The introduction of the Transformer module and human-guided fine-tuning provides valuable insights and methods for research and applications in the AD field.


title: Remote Possibilities: Where there is a WIL, is there a Way? AI Education for Remote Learners in a New Era of Work-Integrated-Learning

abstract: Increasing diversity in educational settings is challenging in part due to the lack of access to resources for non-traditional learners in remote communities. Post-pandemic platforms designed specifically for remote and hybrid learning -- supporting team-based collaboration online -- are positioned to bridge this gap. Our work combines the use of these new platforms with co-creation and collaboration tools for AI assisted remote Work-Integrated-Learning (WIL) opportunities, including efforts in community and with the public library system. This paper outlines some of our experiences to date, and proposes methods to further integrate AI education into community-driven applications for remote WIL.


title: Randomization Can Reduce Both Bias and Variance: A Case Study in Random Forests

abstract: We study the often overlooked phenomenon, first noted in \cite{breiman2001random}, that random forests appear to reduce bias compared to bagging. Motivated by an interesting paper by \cite{mentch2020randomization}, where the authors argue that random forests reduce effective degrees of freedom and only outperform bagging ensembles in low signal-to-noise ratio (SNR) settings, we explore how random forests can uncover patterns in the data missed by bagging. We empirically demonstrate that in the presence of such patterns, random forests reduce bias along with variance and increasingly outperform bagging ensembles when SNR is high. Our observations offer insights into the real-world success of random forests across a range of SNRs and enhance our understanding of the difference between random forests and bagging ensembles with respect to the randomization injected into each split. Our investigations also yield practical insights into the importance of tuning $mtry$ in random forests.


title: Lax-Wendroff Flux Reconstruction for advection-diffusion equations with error-based time stepping

abstract: This work introduces an extension of the high order, single stage Lax-Wendroff Flux Reconstruction (LWFR) of Babbar et al., JCP (2022) to solve second order time-dependent partial differential equations in conservative form on curvilinear meshes. The method uses BR1 scheme to reduce the system to first order so that the earlier LWFR scheme can be applied. The work makes use of the embedded error-based time stepping introduced in Babbar, Chandrashekar (2024) which becomes particularly relevant in the absence of CFL stability limit for parabolic equations. The scheme is verified to show optimal order convergence and validated with transonic flow over airfoil and unsteady flow over cylinder.


title: Towards Validation of Autonomous Vehicles Across Scales using an Integrated Digital Twin Framework

abstract: Autonomous vehicle platforms of varying spatial scales are employed within the research and development spectrum based on space, safety and monetary constraints. However, deploying and validating autonomy algorithms across varying operational scales presents challenges due to scale-specific dynamics, sensor integration complexities, computational constraints, regulatory considerations, environmental variability, interaction with other traffic participants and scalability concerns. In such a milieu, this work focuses on developing a unified framework for modeling and simulating digital twins of autonomous vehicle platforms across different scales and operational design domains (ODDs) to help support the streamlined development and validation of autonomy software stacks. Particularly, this work discusses the development of digital twin representations of 4 autonomous ground vehicles, which span across 3 different scales and target 3 distinct ODDs. We study the adoption of these autonomy-oriented digital twins to deploy a common autonomy software stack with an aim of end-to-end map-based navigation to achieve the ODD-specific objective(s) for each vehicle. Finally, we also discuss the flexibility of the proposed framework to support virtual, hybrid as well as physical testing with seamless sim2real transfer.


title: Phonon-lithium ion interactions: A case study of LiM(SeO3)2

abstract: Li ion diffusion is fundamentally a thermally activated ion hopping process. Recently, soft lattice, anharmonic phonon and paddlewheel mechanism have been proposed to potentially benefit the ion transport, while the understanding of vibrational couplings of mobile ion and anions is still limited but essential. Herein, we access the ionic conductivity, the stability and the lattice dynamics in LiM(SeO3)2 (M =Al, Ga, In, Sc, Y, and La) with two types of oxygen anions within LiO4 polyhedron, namely edge-shared and corner-shared, the prototype of which, LiGa(SeO3)2, has been experimentally synthesized. We studied in detail the anharmonic and harmonic phonon interactions, as well as couplings between vibrations of edge-bonded or corner-bonded anions in Li polyanions and Li ion diffusion. As M changing from Sc to La, anharmonic phonons increase alongside reduced activation energy for Li diffusion. Phonon modes involving edge-bonded oxygen anions contribute more to Li migration than corner-bonded oxygen anions, owing to greater atomic interactions between Li ions and edge-bonded anions. Thus, rather than the overall lattice softness, attentions shall be paid to reduce the frequency of the critical phonons contributing to Li ion diffusions as well as to increase the anharmonicity, for the design of Li ion superionic conductors for all-solid-state-batteries.


title: Quantum diffusion and large primordial perturbations from inflation

abstract: Quantum diffusion describes the inflow of vacuum quantum fluctuations as they get amplified by gravitational instability, and stretched to large distances during inflation. In this picture, the dynamics of the universe's expansion becomes stochastic, and the statistics of the curvature perturbation is encoded in the distribution of the duration of inflation. This provides a non-perturbative framework to study cosmological fluctuations during inflation, which is well-suited to the case of primordial black holes since they originate from large fluctuations. We show that standard, perturbative expectations for the primordial black hole abundance can be significantly modified by quantum-diffusion effects, and we identify a few open challenges.


title: Beyond Worst-case Attacks: Robust RL with Adaptive Defense via Non-dominated Policies

abstract: In light of the burgeoning success of reinforcement learning (RL) in diverse real-world applications, considerable focus has been directed towards ensuring RL policies are robust to adversarial attacks during test time. Current approaches largely revolve around solving a minimax problem to prepare for potential worst-case scenarios. While effective against strong attacks, these methods often compromise performance in the absence of attacks or the presence of only weak attacks. To address this, we study policy robustness under the well-accepted state-adversarial attack model, extending our focus beyond only worst-case attacks. We first formalize this task at test time as a regret minimization problem and establish its intrinsic hardness in achieving sublinear regret when the baseline policy is from a general continuous policy class, $\Pi$. This finding prompts us to \textit{refine} the baseline policy class $\Pi$ prior to test time, aiming for efficient adaptation within a finite policy class $\Tilde{\Pi}$, which can resort to an adversarial bandit subroutine. In light of the importance of a small, finite $\Tilde{\Pi}$, we propose a novel training-time algorithm to iteratively discover \textit{non-dominated policies}, forming a near-optimal and minimal $\Tilde{\Pi}$, thereby ensuring both robustness and test-time efficiency. Empirical validation on the Mujoco corroborates the superiority of our approach in terms of natural and robust performance, as well as adaptability to various attack scenarios.


title: Iterated learning and multiscale modeling of history-dependent architectured metamaterials

abstract: Neural network based models have emerged as a powerful tool in multiscale modeling of materials. One promising approach is to use a neural network based model, trained using data generated from repeated solution of an expensive small scale model, as a surrogate for the small scale model in application scale simulations. Such approaches have been shown to have the potential accuracy of concurrent multiscale methods like FE2, but at the cost comparable to empirical methods like classical constitutive models or parameter passing. A key question is to understand how much and what kind of data is necessary to obtain an accurate surrogate. This paper examines this question for history dependent elastic-plastic behavior of an architected metamaterial modeled as a truss. We introduce an iterative approach where we use the rich arbitrary class of trajectories to train an initial model, but then iteratively update the class of trajectories with those that arise in large scale simulation and use transfer learning to update the model. We show that such an approach converges to a highly accurate surrogate, and one that is transferable.


title: Visual Reasoning in Object-Centric Deep Neural Networks: A Comparative Cognition Approach

abstract: Achieving visual reasoning is a long-term goal of artificial intelligence. In the last decade, several studies have applied deep neural networks (DNNs) to the task of learning visual relations from images, with modest results in terms of generalization of the relations learned. However, in recent years, object-centric representation learning has been put forward as a way to achieve visual reasoning within the deep learning framework. Object-centric models attempt to model input scenes as compositions of objects and relations between them. To this end, these models use several kinds of attention mechanisms to segregate the individual objects in a scene from the background and from other objects. In this work we tested relation learning and generalization in several object-centric models, as well as a ResNet-50 baseline. In contrast to previous research, which has focused heavily in the same-different task in order to asses relational reasoning in DNNs, we use a set of tasks -- with varying degrees of difficulty -- derived from the comparative cognition literature. Our results show that object-centric models are able to segregate the different objects in a scene, even in many out-of-distribution cases. In our simpler tasks, this improves their capacity to learn and generalize visual relations in comparison to the ResNet-50 baseline. However, object-centric models still struggle in our more difficult tasks and conditions. We conclude that abstract visual reasoning remains an open challenge for DNNs, including object-centric models.


title: Advancing Monocular Video-Based Gait Analysis Using Motion Imitation with Physics-Based Simulation

abstract: Gait analysis from videos obtained from a smartphone would open up many clinical opportunities for detecting and quantifying gait impairments. However, existing approaches for estimating gait parameters from videos can produce physically implausible results. To overcome this, we train a policy using reinforcement learning to control a physics simulation of human movement to replicate the movement seen in video. This forces the inferred movements to be physically plausible, while improving the accuracy of the inferred step length and walking velocity.