title: Regulating trusted autonomous systems in Australia

abstract: Australia is a leader in autonomous systems technology, particularly in the mining industry, borne from necessity in a geographically dispersed and complex natural environment. Increasingly advanced autonomous systems are becoming more prevalent in Australia, particularly as the safety, environmental and efficiency benefits become better understood, and the increasing sophistication of technology improves capability and availability. Increasing use of these systems, including in the maritime domain and air domain, is placing pressure on the national safety regulators, who must either continue to apply their traditional regulatory approach requiring exemptions to enable operation of emerging technology, or seize the opportunity to put in place an agile and adaptive approach better suited to the rapid developments of the twenty first century. In Australia the key national safety regulators have demonstrated an appetite for working with industry to facilitate innovation, but their limited resources mean progress is slow. There is a critical role to be played by third parties from industry, government, and academia who can work together to develop, test and publish new assurance and accreditation frameworks for trusted autonomous systems, and assist in the transition to an adaptive and agile regulatory philosophy. This is necessary to ensure the benefits of autonomous systems can be realised, without compromising safety. This paper will identify the growing use cases for autonomous systems in Australia, in the maritime, air and land domains, assess the current regulatory framework, argue that Australia's regulatory approach needs to become more agile and anticipatory, and investigate how third party projects could positively impact the assurance and accreditation process for autonomous systems in the future.


title: Swarm Intelligence-based Extraction and Manifold Crawling Along the Large-Scale Structure

abstract: The distribution of galaxies and clusters of galaxies on the mega-parsec scale of the Universe follows an intricate pattern now famously known as the Large-Scale Structure or the Cosmic Web. To study the environments of this network, several techniques have been developed that are able to describe its properties and the properties of groups of galaxies as a function of their environment. In this work we analyze the previously introduced framework: 1-Dimensional Recovery, Extraction, and Analysis of Manifolds (1-DREAM) on N-body cosmological simulation data of the Cosmic Web. The 1-DREAM toolbox consists of five Machine Learning methods, whose aim is the extraction and modelling of 1-dimensional structures in astronomical big data settings. We show that 1-DREAM can be used to extract structures of different density ranges within the Cosmic Web and to create probabilistic models of them. For demonstration, we construct a probabilistic model of an extracted filament and move through the structure to measure properties such as local density and velocity. We also compare our toolbox with a collection of methodologies which trace the Cosmic Web. We show that 1-DREAM is able to split the network into its various environments with results comparable to the state-of-the-art methodologies. A detailed comparison is then made with the public code DisPerSE, in which we find that 1-DREAM is robust against changes in sample size making it suitable for analyzing sparse observational data, and finding faint and diffuse manifolds in low density regions.


title: Reliable Natural Language Understanding with Large Language Models and Answer Set Programming

abstract: Humans understand language by extracting information (meaning) from sentences, combining it with existing commonsense knowledge, and then performing reasoning to draw conclusions. While large language models (LLMs) such as GPT-3 and ChatGPT are able to leverage patterns in the text to solve a variety of NLP tasks, they fall short in problems that require reasoning. They also cannot reliably explain the answers generated for a given question. In order to emulate humans better, we propose STAR, a framework that combines LLMs with Answer Set Programming (ASP). We show how LLMs can be used to effectively extract knowledge -- represented as predicates -- from language. Goal-directed ASP is then employed to reliably reason over this knowledge. We apply the STAR framework to three different NLU tasks requiring reasoning: qualitative reasoning, mathematical reasoning, and goal-directed conversation. Our experiments reveal that STAR is able to bridge the gap of reasoning in NLU tasks, leading to significant performance improvements, especially for smaller LLMs, i.e., LLMs with a smaller number of parameters. NLU applications developed using the STAR framework are also explainable: along with the predicates generated, a justification in the form of a proof tree can be produced for a given output.


title: Cardinality-Constrained Continuous Knapsack Problem with Concave Piecewise-Linear Utilities

abstract: We study an extension of the cardinality-constrained knapsack problem wherein each item has a concave piecewise linear utility structure (CCKP), which is motivated by applications such as resource management problems in monitoring and surveillance tasks. Our main contributions are combinatorial algorithms for the offline CCKP and an online version of the CCKP. For the offline problem, we present a fully polynomial-time approximation scheme and show that it can be cast as the maximization of a submodular function with cardinality constraints; the latter property allows us to derive a greedy $(1 - \frac{1}{e})$-approximation algorithm. For the online CCKP in the random order model, we derive a $\frac{10.427}{\alpha}$-competitive algorithm based on $\alpha$-approximation algorithms for the offline CCKP; moreover, we derive stronger guarantees for the cases wherein the cardinality capacity is very small or relatively large. Finally, we investigate the empirical performance of the proposed algorithms in numerical experiments.


title: Does AI-Assisted Fact-Checking Disproportionately Benefit Majority Groups Online?

abstract: In recent years, algorithms have been incorporated into fact-checking pipelines. They are used not only to flag previously fact-checked misinformation, but also to provide suggestions about which trending claims should be prioritized for fact-checking - a paradigm called `check-worthiness.' While several studies have examined the accuracy of these algorithms, none have investigated how the benefits from these algorithms (via reduction in exposure to misinformation) are distributed amongst various online communities. In this paper, we investigate how diverse representation across multiple stages of the AI development pipeline affects the distribution of benefits from AI-assisted fact-checking for different online communities. We simulate information propagation through the network using our novel Topic-Aware, Community-Impacted Twitter (TACIT) simulator on a large Twitter followers network, tuned to produce realistic cascades of true and false information across multiple topics. Finally, using simulated data as a test bed, we implement numerous algorithmic fact-checking interventions that explicitly account for notions of diversity. We find that both representative and egalitarian methods for sampling and labeling check-worthiness model training data can lead to network-wide benefit concentrated in majority communities, while incorporating diversity into how fact-checkers use algorithmic recommendations can actively reduce inequalities in benefits between majority and minority communities. These findings contribute to an important conversation around the responsible implementation of AI-assisted fact-checking by social media platforms and fact-checking organizations.


title: Finite element grad grad complexes and elasticity complexes on cuboid meshes

abstract: This paper constructs two conforming finite element grad grad and elasticity complexes on the cuboid meshes. For the finite element grad grad complex, an $H^2$ conforming finite element space, an $\boldsymbol{H}(\operatorname{curl}; \mathbb{S})$ conforming finite element space, an $\boldsymbol{H}(\operatorname{div}; \mathbb{T})$ conforming finite element space and an $\boldsymbol{L}^2$ finite element space are constructed. Further, a finite element complex with reduced regularity is also constructed, whose degrees of freedom for the three diagonal components are coupled. For the finite element elasticity complex, a vector $\boldsymbol{H}^1$ conforming space and an $\boldsymbol{H}(\operatorname{curl}\operatorname{curl}^{T}; \mathbb{S})$ conforming space are constructed. Combining with an existing $\boldsymbol{H}(\operatorname{div}; \mathbb{S}) \cap \boldsymbol{H}(\operatorname{div}\operatorname{div}; \mathbb{S})$ element and $\boldsymbol{H}(\operatorname{div}; \mathbb{S})$ element, respectively, these finite element spaces form two different finite element elasticity complexes. The exactness of all the finite element complexes is proved.


title: Leveraging User-Triggered Supervision in Contextual Bandits

abstract: We study contextual bandit (CB) problems, where the user can sometimes respond with the best action in a given context. Such an interaction arises, for example, in text prediction or autocompletion settings, where a poor suggestion is simply ignored and the user enters the desired text instead. Crucially, this extra feedback is user-triggered on only a subset of the contexts. We develop a new framework to leverage such signals, while being robust to their biased nature. We also augment standard CB algorithms to leverage the signal, and show improved regret guarantees for the resulting algorithms under a variety of conditions on the helpfulness of and bias inherent in this feedback.


title: Single and two-cells shape analysis from energy functionals for three-dimensional vertex models

abstract: Vertex models have been extensively used for simulating the evolution of multicellular systems, and have given rise to important global properties concerning their macroscopic rheology or jamming transitions. These models are based on the definition of an energy functional, which fully determines the cellular response and conclusions. While two-dimensional vertex models have been widely employed, three-dimensional models are far more scarce, mainly due to the large amount of configurations that they may adopt and the complex geometrical transitions they undergo. We here investigate the shape of single and two-cells configurations as a function of the energy terms, and we study the dependence of the final shape on the model parameters: namely the exponent of the term penalising cell-cell adhesion and surface contractility. In single cell analysis, we deduce analytically the radius and limit values of the contractility for linear and quadratic surface energy terms, in 2D and 3D. In two-cells systems, we deduce the evolution of the aspect ratio. While in functionals with linear surface terms yield the same aspect ratio in 2D and 3D, the configurations when using quadratic surface terms are distinct. We relate our results with well-known solutions from capillarity theory, and verify our analytical findings with a three-dimensional vertex model.


title: Analyzing the Performance of Deep Encoder-Decoder Networks as Surrogates for a Diffusion Equation

abstract: Neural networks (NNs) have proven to be a viable alternative to traditional direct numerical algorithms, with the potential to accelerate computational time by several orders of magnitude. In the present paper we study the use of encoder-decoder convolutional neural network (CNN) as surrogates for steady-state diffusion solvers. The construction of such surrogates requires the selection of an appropriate task, network architecture, training set structure and size, loss function, and training algorithm hyperparameters. It is well known that each of these factors can have a significant impact on the performance of the resultant model. Our approach employs an encoder-decoder CNN architecture, which we posit is particularly well-suited for this task due to its ability to effectively transform data, as opposed to merely compressing it. We systematically evaluate a range of loss functions, hyperparameters, and training set sizes. Our results indicate that increasing the size of the training set has a substantial effect on reducing performance fluctuations and overall error. Additionally, we observe that the performance of the model exhibits a logarithmic dependence on the training set size. Furthermore, we investigate the effect on model performance by using different subsets of data with varying features. Our results highlight the importance of sampling the configurational space in an optimal manner, as this can have a significant impact on the performance of the model and the required training time. In conclusion, our results suggest that training a model with a pre-determined error performance bound is not a viable approach, as it does not guarantee that edge cases with errors larger than the bound do not exist. Furthermore, as most surrogate tasks involve a high dimensional landscape, an ever increasing training set size is, in principle, needed, however it is not a practical solution.


title: Deep Neural Network Uncertainty Quantification for LArTPC Reconstruction

abstract: We evaluate uncertainty quantification (UQ) methods for deep learning applied to liquid argon time projection chamber (LArTPC) physics analysis tasks. As deep learning applications enter widespread usage among physics data analysis, neural networks with reliable estimates of prediction uncertainty and robust performance against overconfidence and out-of-distribution (OOD) samples are critical for their full deployment in analyzing experimental data. While numerous UQ methods have been tested on simple datasets, performance evaluations for more complex tasks and datasets are scarce. We assess the application of selected deep learning UQ methods on the task of particle classification using the PiLArNet [1] monte carlo 3D LArTPC point cloud dataset. We observe that UQ methods not only allow for better rejection of prediction mistakes and OOD detection, but also generally achieve higher overall accuracy across different task settings. We assess the precision of uncertainty quantification using different evaluation metrics, such as distributional separation of prediction entropy across correctly and incorrectly identified samples, receiver operating characteristic curves (ROCs), and expected calibration error from observed empirical accuracy. We conclude that ensembling methods can obtain well calibrated classification probabilities and generally perform better than other existing methods in deep learning UQ literature.


title: Toward a Theory of Causation for Interpreting Neural Code Models

abstract: Neural Language Models of Code, or Neural Code Models (NCMs), are rapidly progressing from research prototypes to commercial developer tools. As such, understanding the capabilities and limitations of such models is becoming critical. However, the abilities of these models are typically measured using automated metrics that often only reveal a portion of their real-world performance. While, in general, the performance of NCMs appears promising, currently much is unknown about how such models arrive at decisions. To this end, this paper introduces $do_{code}$, a post hoc interpretability method specific to NCMs that is capable of explaining model predictions. $do_{code}$ is based upon causal inference to enable programming language-oriented explanations. While the theoretical underpinnings of $do_{code}$ are extensible to exploring different model properties, we provide a concrete instantiation that aims to mitigate the impact of spurious correlations by grounding explanations of model behavior in properties of programming languages. To demonstrate the practical benefit of $do_{code}$, we illustrate the insights that our framework can provide by performing a case study on two popular deep learning architectures and ten NCMs. The results of this case study illustrate that our studied NCMs are sensitive to changes in code syntax. All our NCMs, except for the BERT-like model, statistically learn to predict tokens related to blocks of code (\eg brackets, parenthesis, semicolon) with less confounding bias as compared to other programming language constructs. These insights demonstrate the potential of $do_{code}$ as a useful method to detect and facilitate the elimination of confounding bias in NCMs.


title: Layered State Discovery for Incremental Autonomous Exploration

abstract: We study the autonomous exploration (AX) problem proposed by Lim & Auer (2012). In this setting, the objective is to discover a set of $\epsilon$-optimal policies reaching a set $\mathcal{S}_L^{\rightarrow}$ of incrementally $L$-controllable states. We introduce a novel layered decomposition of the set of incrementally $L$-controllable states that is based on the iterative application of a state-expansion operator. We leverage these results to design Layered Autonomous Exploration (LAE), a novel algorithm for AX that attains a sample complexity of $\tilde{\mathcal{O}}(LS^{\rightarrow}_{L(1+\epsilon)}\Gamma_{L(1+\epsilon)} A \ln^{12}(S^{\rightarrow}_{L(1+\epsilon)})/\epsilon^2)$, where $S^{\rightarrow}_{L(1+\epsilon)}$ is the number of states that are incrementally $L(1+\epsilon)$-controllable, $A$ is the number of actions, and $\Gamma_{L(1+\epsilon)}$ is the branching factor of the transitions over such states. LAE improves over the algorithm of Tarbouriech et al. (2020a) by a factor of $L^2$ and it is the first algorithm for AX that works in a countably-infinite state space. Moreover, we show that, under a certain identifiability assumption, LAE achieves minimax-optimal sample complexity of $\tilde{\mathcal{O}}(LS^{\rightarrow}_{L}A\ln^{12}(S^{\rightarrow}_{L})/\epsilon^2)$, outperforming existing algorithms and matching for the first time the lower bound proved by Cai et al. (2022) up to logarithmic factors.


title: GraphGUIDE: interpretable and controllable conditional graph generation with discrete Bernoulli diffusion

abstract: Diffusion models achieve state-of-the-art performance in generating realistic objects and have been successfully applied to images, text, and videos. Recent work has shown that diffusion can also be defined on graphs, including graph representations of drug-like molecules. Unfortunately, it remains difficult to perform conditional generation on graphs in a way which is interpretable and controllable. In this work, we propose GraphGUIDE, a novel framework for graph generation using diffusion models, where edges in the graph are flipped or set at each discrete time step. We demonstrate GraphGUIDE on several graph datasets, and show that it enables full control over the conditional generation of arbitrary structural properties without relying on predefined labels. Our framework for graph diffusion can have a large impact on the interpretable conditional generation of graphs, including the generation of drug-like molecules with desired properties in a way which is informed by experimental evidence.


title: How to Trust Your Diffusion Model: A Convex Optimization Approach to Conformal Risk Control

abstract: Score-based generative modeling, informally referred to as diffusion models, continue to grow in popularity across several important domains and tasks. While they provide high-quality and diverse samples from empirical distributions, important questions remain on the reliability and trustworthiness of these sampling procedures for their responsible use in critical scenarios. Conformal prediction is a modern tool to construct finite-sample, distribution-free uncertainty guarantees for any black-box predictor. In this work, we focus on image-to-image regression tasks and we present a generalization of the Risk-Controlling Prediction Sets (RCPS) procedure, that we term $K$-RCPS, which allows to $(i)$ provide entrywise calibrated intervals for future samples of any diffusion model, and $(ii)$ control a certain notion of risk with respect to a ground truth image with minimal mean interval length. Differently from existing conformal risk control procedures, ours relies on a novel convex optimization approach that allows for multidimensional risk control while provably minimizing the mean interval length. We illustrate our approach on two real-world image denoising problems: on natural images of faces as well as on computed tomography (CT) scans of the abdomen, demonstrating state of the art performance.


title: Information-Theoretic Diffusion

abstract: Denoising diffusion models have spurred significant gains in density modeling and image generation, precipitating an industrial revolution in text-guided AI art generation. We introduce a new mathematical foundation for diffusion models inspired by classic results in information theory that connect Information with Minimum Mean Square Error regression, the so-called I-MMSE relations. We generalize the I-MMSE relations to exactly relate the data distribution to an optimal denoising regression problem, leading to an elegant refinement of existing diffusion bounds. This new insight leads to several improvements for probability distribution estimation, including theoretical justification for diffusion model ensembling. Remarkably, our framework shows how continuous and discrete probabilities can be learned with the same regression objective, avoiding domain-specific generative models used in variational methods. Code to reproduce experiments is provided at http://github.com/kxh001/ITdiffusion and simplified demonstration code is at http://github.com/gregversteeg/InfoDiffusionSimple.


title: Self-Supervised Unseen Object Instance Segmentation via Long-Term Robot Interaction

abstract: We introduce a novel robotic system for improving unseen object instance segmentation in the real world by leveraging long-term robot interaction with objects. Previous approaches either grasp or push an object and then obtain the segmentation mask of the grasped or pushed object after one action. Instead, our system defers the decision on segmenting objects after a sequence of robot pushing actions. By applying multi-object tracking and video object segmentation on the images collected via robot pushing, our system can generate segmentation masks of all the objects in these images in a self-supervised way. These include images where objects are very close to each other, and segmentation errors usually occur on these images for existing object segmentation networks. We demonstrate the usefulness of our system by fine-tuning segmentation networks trained on synthetic data with real-world data collected by our system. We show that, after fine-tuning, the segmentation accuracy of the networks is significantly improved both in the same domain and across different domains. In addition, we verify that the fine-tuned networks improve top-down robotic grasping of unseen objects in the real world.


title: Characterizing the Dark Count Rate of a Large-Format MKID Array

abstract: We present an empirical measurement of the dark count rate seen in a large-format MKID array identical to those currently in use at observatories such as Subaru on Maunakea. This work provides compelling evidence for their utility in future experiments that require low-count rate, quiet environments such as dark matter direct detection. Across the bandpass from 0.946-1.534 eV (1310-808 nm) an average count rate of $(1.847\pm0.003)\times10^{-3}$ photons/pixel/s is measured. Breaking this bandpass into 5 equal-energy bins based on the resolving power of the detectors we find the average dark count rate seen in an MKID is $(6.26\pm0.04)\times10^{-4}$ photons/pixel/s from 0.946-1.063 eV and $(2.73\pm0.02)\times10^{-4}$ photons/pixel/s at 1.416-1.534eV. Using lower-noise readout electronics to read out a single MKID pixel we demonstrate that the events measured while the detector is not illuminated largely appear to be a combination of real photons, possible fluorescence caused by cosmic rays, and phonon events in the array substrate. We also find that using lower-noise readout electronics on a single MKID pixel we measure a dark count rate of $(9.3\pm0.9)\times10^{-4}$ photons/pixel/s over the same bandpass (0.946-1.534 eV) With the single-pixel readout we also characterize the events when the detectors are not illuminated and show that these responses in the MKID are distinct from photons from known light sources such as a laser, likely coming from cosmic ray excitations.


title: A Bayesian Semi-Parametric Scalar-On-Function Quantile Regression with Measurement Error using the GAL

abstract: Quantile regression provides a consistent approach to investigating the association between covariates and various aspects of the distribution of the response beyond the mean. When the regression covariates are measured with errors, measurement error (ME) adjustment steps are needed for valid inference. This is true for both scalar and functional covariates. Here, we propose extending the Bayesian measurement error and Bayesian quantile regression literature to allow for available covariates prone to potential complex measurement errors. Our approach uses the Generalized Asymmetric Laplace (GAL) distribution as a working likelihood. The family of GAL distribution has recently emerged as a more flexible distribution family in the Bayesian quantile regression modeling compared to their Asymmetric Laplace (AL) counterpart. We then compared and contrasted two approaches in our ME-adjusted steps through a battery of simulation scenarios. Finally, we apply our approach to the analysis of an NHANES dataset 2013-2014 to model quantiles of Body mass index (BMI) as a function of minute-level device-based physical activity in a cohort of an adult 50 years and above.


title: Impurity-induced phonon thermal Hall effect in the antiferromagnetic phase of Sr2IrO4

abstract: A thermal Hall effect is observed in an increasing number of insulators often attributed to phonons, but the underlying mechanism is in most cases unknown. A coupling of phonons to spins has been invoked and scattering of phonons by impurities or defects has been proposed, but there is no systematic evidence to support either scenario. Here we present a study on the effect of adding Rh impurities to the antiferromagnetic insulator Sr2IrO4, substituting for the spin-carrying Ir atoms. We find that adding small concentrations of Rh impurities increases the thermal Hall conductivity dramatically, but adding enough Rh to suppress the magnetic order eventually decreases the thermal Hall conductivity until it nearly vanishes. We conclude that the thermal Hall effect in this material is caused by the scattering of phonons by impurities embedded within a magnetic environment.


title: Men Can't Always be Transformed into Mice: Decision Algorithms and Complexity for Sorting by Symmetric Reversals

abstract: Sorting a permutation by reversals is a famous problem in genome rearrangements. Since 1997, quite some biological evidence were found that in many genomes the reversed regions are usually flanked by a pair of inverted repeats. This type of reversals are called symmetric reversals, which, unfortunately, were largely ignored until recently. In this paper, we investigate the problem of sorting by symmetric reversals, which requires a series of symmetric reversals to transform one chromosome $A$ into the another chromosome $B$. The decision problem of sorting by symmetric reversals is referred to as {\em SSR} (when the input chromosomes $A$ and $B$ are given, we use {\em SSR(A,B)}) and the corresponding optimization version (i.e., when the answer for {\em SSR(A,B)} is yes, using the minimum number of symmetric reversals to convert $A$ to $B$), is referred to as {\em SMSR(A,B)}. The main results of this paper are summarized as follows, where the input is a pair of chromosomes $A$ and $B$ with $n$ repeats. (1) We present an $O(n^2)$ time algorithm to solve the decision problem {\em SSR(A,B)}, i.e., determine whether a chromosome $A$ can be transformed into $B$ by a series of symmetric reversals. (2) We design an $O(n^2)$ time algorithm for a special 2-balanced case of {\em SMSR(A,B)}, where chromosomes $A$ and $B$ both have duplication number 2 and every repeat appears twice in different orientations in $A$ and $B$. (3) We show that SMSR is NP-hard even if the duplication number of the input chromosomes are at most 2, hence showing that the above positive optimization result is the best possible. As a by-product, we show that the \emph{minimum Steiner tree} problem on \emph{circle graphs} is NP-hard, settling the complexity status of a 38-year old open problem.


title: Exponential mixing of frame flows for geometrically finite hyperbolic manifolds

abstract: As a final work to establish that frame flows for geometrically finite hyperbolic manifolds of arbitrary dimensions are exponentially mixing with respect to the Bowen-Margulis-Sullivan measure, this paper focuses on the case with cusps. To prove this, we utilize the countably infinite symbolic coding of the geodesic flow of Li-Pan and perform a frame flow version of Dolgopyat's method \`{a} la Sarkar-Winter and Tsujii-Zhang. This requires the local non-integrability condition and the non-concentration property but the challenge in the presence of cusps is that the latter holds only on a large proper subset of the limit set. To overcome this, we use a large deviation property for symbolic recurrence to the large subset. It is proved by studying the combinatorics of cusp excursions and using an effective renewal theorem as in the work of Li; the latter uses the exponential decay of the transfer operators for the geodesic flow of Li-Pan.


title: STARFIRE: An algorithm for estimating radio frequency interference in orbits around Earth

abstract: Ground-based 21-cm experiments targeting the global signal from the periods of Cosmic Dawn (CD) and Epoch of Reionization (EoR) are susceptible to adverse effects presented by i) the ionosphere ii) antenna chromaticity induced by objects in its vicinity iii) terrestrial radio frequency interference (RFI). Terrestrial RFI is particularly challenging as the FM radio band spanning over 88-108 MHz lies entirely within the frequency range of the CD/EoR experiments ($\sim 40-200$ MHz). Multiple space-based experiments have been proposed to operate in the radio-quiet zone on the lunar farside. An intermediate option in cost and complexity is an experiment operating in space in an orbit around Earth, which readily alleviates the first two challenges. However, the effect of RFI in Earth's orbit on the detection of global signal needs to be quantitatively evaluated. We present STARFIRE -- Simulation of TerrestriAl Radio Frequency Interference in oRbits around Earth -- an algorithm that provides an expectation of FM seeded RFI at different altitudes over Earth. Using a limited set of publicly available FM transmitter databases, which can be extended by the user community, we demonstrate the use of the STARFIRE framework to generate a three-dimensional spatio-spectral cube of RFI as would be measured in Earth orbit. Applications of STARFIRE include identifying minimum RFI orbits around Earth, producing RFI spectra over a particular location, and generating RFI heatmaps at specific frequencies for a range of altitudes. STARFIRE can be easily adapted for different frequencies, altitudes, antenna properties, RFI databases, and combined with astrophysical sky-models. This can be used to estimate the effect of RFI on the detection of global 21-cm signal from Earth-orbit, and hence for sensitivity estimates and experiment design of an Earth orbiting CD/EoR detection experiment.


title: MACOptions: Multi-Agent Learning with Centralized Controller and Options Framework

abstract: These days automation is being applied everywhere. In every environment, planning for the actions to be taken by the agents is an important aspect. In this paper, we plan to implement planning for multi-agents with a centralized controller. We compare three approaches: random policy, Q-learning, and Q-learning with Options Framework. We also show the effectiveness of planners by showing performance comparison between Q-Learning with Planner and without Planner.


title: $\ell^p$ metrics on cell complexes

abstract: Motivated by the observation that groups can be effectively studied using metric spaces modelled on $\ell^1$, $\ell^2$, and $\ell^\infty$ geometry, we consider cell complexes equipped with an $\ell^p$ metric for arbitrary $p$. Under weak conditions that can be checked locally, we establish nonpositive curvature properties of these complexes, such as Busemann-convexity and strong bolicity. We also provide detailed information on the geodesics of these metrics in the special case of CAT(0) cube complexes.


title: Standing Between Past and Future: Spatio-Temporal Modeling for Multi-Camera 3D Multi-Object Tracking

abstract: This work proposes an end-to-end multi-camera 3D multi-object tracking (MOT) framework. It emphasizes spatio-temporal continuity and integrates both past and future reasoning for tracked objects. Thus, we name it "Past-and-Future reasoning for Tracking" (PF-Track). Specifically, our method adapts the "tracking by attention" framework and represents tracked instances coherently over time with object queries. To explicitly use historical cues, our "Past Reasoning" module learns to refine the tracks and enhance the object features by cross-attending to queries from previous frames and other objects. The "Future Reasoning" module digests historical information and predicts robust future trajectories. In the case of long-term occlusions, our method maintains the object positions and enables re-association by integrating motion predictions. On the nuScenes dataset, our method improves AMOTA by a large margin and remarkably reduces ID-Switches by 90% compared to prior approaches, which is an order of magnitude less. The code and models are made available at https://github.com/TRI-ML/PF-Track.


title: A Weak (k,k)-Lefschetz Theorem for Projective Toric Orbifolds

abstract: Firstly we show a generalization of the (1,1)-Lefschetz theorem for projective toric orbifolds and secondly we prove that on 2k-dimensional quasi-smooth hypersurfaces coming from quasi-smooth intersection surfaces, under the Cayley trick, every rational (k,k)-cohomology class is algebraic, i.e., the Hodge conjecture holds on them.


title: Composition Comparison between ICMEs from Active Regions and Quiet-Sun Regions

abstract: The composition, including the ionic charge states and elemental abundances of heavy elements, within interplanetary coronal mass ejections (ICMEs) has tight correlations with their source regions and eruption processes. This can help analyze the eruption mechanisms and plasma origins of CMEs, and deepen our understanding of energetic solar activities. The active regions and quiet-Sun regions have different physical properties, thus from a statistical point of view, ICMEs originating from the two types of regions should exhibit different compositional characteristics. To demonstrate the differences comprehensively, we conduct survey studies on the ionic charge states of five elements (Mg, Fe, Si, C, and O) and the relative abundances of six elements (Mg/O, Fe/O, Si/O, C/O, Ne/O, and He/O) within ICMEs from 1998 February to 2011 August through the data of advanced composition explorer. The results show that ICMEs from active regions have higher ionic charge states and relative abundances than those from quiet-Sun regions. For the active-region ICMEs, we further analyze the relations between their composition and flare class, and find a positive relationship between them, i.e., the higher classes of the associated flares, the larger means of ionic charge states and relative abundances (except the C/O) within ICMEs. As more (less) fractions of ICMEs originate from active regions around solar maximum (minimum), and active-region ICMEs usually are associated with higher-class flares, our studies might answer why ICME composition measured near 1 au exhibits the solar cycle dependence.


title: Eliciting User Preferences for Personalized Multi-Objective Decision Making through Comparative Feedback

abstract: In classic reinforcement learning (RL) and decision making problems, policies are evaluated with respect to a scalar reward function, and all optimal policies are the same with regards to their expected return. However, many real-world problems involve balancing multiple, sometimes conflicting, objectives whose relative priority will vary according to the preferences of each user. Consequently, a policy that is optimal for one user might be sub-optimal for another. In this work, we propose a multi-objective decision making framework that accommodates different user preferences over objectives, where preferences are learned via policy comparisons. Our model consists of a Markov decision process with a vector-valued reward function, with each user having an unknown preference vector that expresses the relative importance of each objective. The goal is to efficiently compute a near-optimal policy for a given user. We consider two user feedback models. We first address the case where a user is provided with two policies and returns their preferred policy as feedback. We then move to a different user feedback model, where a user is instead provided with two small weighted sets of representative trajectories and selects the preferred one. In both cases, we suggest an algorithm that finds a nearly optimal policy for the user using a small number of comparison queries.


title: SLaM: Student-Label Mixing for Distillation with Unlabeled Examples

abstract: Knowledge distillation with unlabeled examples is a powerful training paradigm for generating compact and lightweight student models in applications where the amount of labeled data is limited but one has access to a large pool of unlabeled data. In this setting, a large teacher model generates ``soft'' pseudo-labels for the unlabeled dataset which are then used for training the student model. Despite its success in a wide variety of applications, a shortcoming of this approach is that the teacher's pseudo-labels are often noisy, leading to impaired student performance. In this paper, we present a principled method for knowledge distillation with unlabeled examples that we call Student-Label Mixing (SLaM) and we show that it consistently improves over prior approaches by evaluating it on several standard benchmarks. Finally, we show that SLaM comes with theoretical guarantees; along the way we give an algorithm improving the best-known sample complexity for learning halfspaces with margin under random classification noise, and provide the first convergence analysis for so-called ``forward loss-adjustment" methods.


title: A Prototype-Oriented Clustering for Domain Shift with Source Privacy

abstract: Unsupervised clustering under domain shift (UCDS) studies how to transfer the knowledge from abundant unlabeled data from multiple source domains to learn the representation of the unlabeled data in a target domain. In this paper, we introduce Prototype-oriented Clustering with Distillation (PCD) to not only improve the performance and applicability of existing methods for UCDS, but also address the concerns on protecting the privacy of both the data and model of the source domains. PCD first constructs a source clustering model by aligning the distributions of prototypes and data. It then distills the knowledge to the target model through cluster labels provided by the source model while simultaneously clustering the target data. Finally, it refines the target model on the target domain data without guidance from the source model. Experiments across multiple benchmarks show the effectiveness and generalizability of our source-private clustering method.


title: Microstructure-dependent magnetic properties of iron silicon single, bi- and oligo-crystals measured with a miniaturised Single-Sheet-Tester

abstract: Electrical iron silicon steel is the most commonly used soft magnetic material in electrical energy conversion and transmission, and its demand is expected to increase with the need for electrification of the transportation sector and the transition to renewable energy to combat climate change. Although iron silicon steel has been used for more than 100 years, some fundamental relationships between microstructure and magnetic performance remain vague, especially with regard to the role of crystal defects such as grain boundaries and dislocations that are induced during the final cutting step of the process chain. In this paper we present first results of a new approach to quantify the effects of orientation, grain boundaries and deformation on the magnetic properties of single, bi- and oligo-crystals using a miniaturised Single-Sheet-Tester. In this way, we were able to better resolve the orientation-dependent polarisation curves at low field strengths, revealing an additional intersection between the medium and hard axis. Furthermore, we were able to distinguish the effects of different deformation structures - from single dislocations to tangles to localised deformation and twins - on different magnetic properties such as on coercivity, remanence and susceptibility, and we found that our particular grain boundary strongly reduces the remanence.


title: Shur type comparison theorems for affine curves with application to lattice point estimates

abstract: If $c, \overline c\colon [a,b]\to \mathbb R^2$ are two convex planar curve parameterized by affine arc length and $A\colon [a,b]\to [0,\infty)$ is the area bounded by the restriction $c\big|_{[a,s]}$ and the segment between $c(a)$ and $c(s)$ with $\overline A$ the corresponding function for $\overline c$, and the affine curvature of $c$ pointwise less than the affine curvature of $\overline c$. Then $A(s)\ge \overline A(s)$. Also for any point of a convex curve we define \emph{adapted affine coordinates} centered at the point and give sharp estimates on the coordinates of the curve in terms of bounds on the curvature. Proving these bounds involves generalizing classical comparison theorems of Strum-Liouville type to higher order and nonhomogenous equations. These estimates allow us to give sharp bounds on the areas of inscribed triangles in terms of affine curvature and the affine distance between the vertices. These inequalities imply upper bounds of the number of lattice points on a convex curve in terms of its affine arc length.


title: Fairness in Matching under Uncertainty

abstract: The prevalence and importance of algorithmic two-sided marketplaces has drawn attention to the issue of fairness in such settings. Algorithmic decisions are used in assigning students to schools, users to advertisers, and applicants to job interviews. These decisions should heed the preferences of individuals, and simultaneously be fair with respect to their merits (synonymous with fit, future performance, or need). Merits conditioned on observable features are always \emph{uncertain}, a fact that is exacerbated by the widespread use of machine learning algorithms to infer merit from the observables. As our key contribution, we carefully axiomatize a notion of individual fairness in the two-sided marketplace setting which respects the uncertainty in the merits; indeed, it simultaneously recognizes uncertainty as the primary potential cause of unfairness and an approach to address it. We design a linear programming framework to find fair utility-maximizing distributions over allocations, and we show that the linear program is robust to perturbations in the estimated parameters of the uncertain merit distributions, a key property in combining the approach with machine learning techniques.


title: On the Convergence of Modified Policy Iteration in Risk Sensitive Exponential Cost Markov Decision Processes

abstract: Modified policy iteration (MPI) is a dynamic programming algorithm that combines elements of policy iteration and value iteration. The convergence of MPI has been well studied in the context of discounted and average-cost MDPs. In this work, we consider the exponential cost risk-sensitive MDP formulation, which is known to provide some robustness to model parameters. Although policy iteration and value iteration have been well studied in the context of risk sensitive MDPs, MPI is unexplored. We provide the first proof that MPI also converges for the risk-sensitive problem in the case of finite state and action spaces. Since the exponential cost formulation deals with the multiplicative Bellman equation, our main contribution is a convergence proof which is quite different than existing results for discounted and risk-neutral average-cost problems as well as risk sensitive value and policy iteration approaches. We conclude our analysis with simulation results, assessing MPI's performance relative to alternative dynamic programming methods like value iteration and policy iteration across diverse problem parameters. Our findings highlight risk-sensitive MPI's enhanced computational efficiency compared to both value and policy iteration techniques.


title: pyTDGL: Time-dependent Ginzburg-Landau in Python

abstract: Time-dependent Ginzburg-Landau (TDGL) theory is a phenomenological model for the dynamics of superconducting systems. Due to its simplicity in comparison to microscopic theories and its effectiveness in describing the observed properties of the superconducting state, TDGL is widely used to interpret or explain measurements of superconducting devices. Here, we introduce $\texttt{pyTDGL}$, a Python package that solves a generalized TDGL model for superconducting thin films of arbitrary geometry, enabling simulations of vortex and phase dynamics in mesoscopic superconducting devices. $\texttt{pyTDGL}$ can model the nonlinear magnetic response and dynamics of multiply connected films, films with multiple current bias terminals, and films with a spatially inhomogeneous critical temperature. We demonstrate these capabilities by modeling quasi-equilibrium vortex distributions in irregularly shaped films, and the dynamics and current-voltage-field characteristics of nanoscale superconducting quantum interference devices (nanoSQUIDs).


title: A Multimodal Sensing Ring for Quantification of Scratch Intensity

abstract: An objective measurement of chronic itch is necessary for improvements in patient care for numerous medical conditions. While wearables have shown promise for scratch detection, they are currently unable to estimate scratch intensity, preventing a comprehensive understanding of the effect of itch on an individual. In this work, we present a framework for the estimation of scratch intensity in addition to the detection of scratch. This is accomplished with a multimodal ring device, consisting of an accelerometer and a contact microphone, a pressure-sensitive tablet for capturing ground truth intensity values, and machine learning algorithms for regression of scratch intensity on a 0-600 milliwatts (mW) power scale that can be mapped to a 0-10 continuous scale. We evaluate the performance of our algorithms on 20 individuals using leave one subject out cross-validation and using data from 14 additional participants, we show that our algorithms achieve clinically-relevant discrimination of scratching intensity levels. By doing so, our device enables the quantification of the substantial variations in the interpretation of the 0-10 scale frequently utilized in patient self-reported clinical assessments. This work demonstrates that a finger-worn device can provide multidimensional, objective, real-time measures for the action of scratching.


title: Rotation curve of the Milky Way and the mass of Sagittarius A*

abstract: In the present work we derive an analytical expression for the mass density of an object with spherical symmetry, whose corresponding potential allows obtaining a circular velocity around it that is in agreement with the observed rotation curve of galaxies. The rotation curve of our galaxy is analyzed, determining the properties of the central object, its radius and mass whose value obtained is very close to that reported in the literature.


title: Long Text and Multi-Table Summarization: Dataset and Method

abstract: Automatic document summarization aims to produce a concise summary covering the input document's salient information. Within a report document, the salient information can be scattered in the textual and non-textual content. However, existing document summarization datasets and methods usually focus on the text and filter out the non-textual content. Missing tabular data can limit produced summaries' informativeness, especially when summaries require covering quantitative descriptions of critical metrics in tables. Existing datasets and methods cannot meet the requirements of summarizing long text and multiple tables in each report. To deal with the scarcity of available data, we propose FINDSum, the first large-scale dataset for long text and multi-table summarization. Built on 21,125 annual reports from 3,794 companies, it has two subsets for summarizing each company's results of operations and liquidity. To summarize the long text and dozens of tables in each report, we present three types of summarization methods. Besides, we propose a set of evaluation metrics to assess the usage of numerical information in produced summaries. Dataset analyses and experimental results indicate the importance of jointly considering input textual and tabular data when summarizing report documents.


title: Intend-Wait-Perceive-Cross: Exploring the Effects of Perceptual Limitations on Pedestrian Decision-Making

abstract: Current research on pedestrian behavior understanding focuses on the dynamics of pedestrians and makes strong assumptions about their perceptual abilities. For instance, it is often presumed that pedestrians have omnidirectional view of the scene around them. In practice, human visual system has a number of limitations, such as restricted field of view (FoV) and range of sensing, which consequently affect decision-making and overall behavior of the pedestrians. By including explicit modeling of pedestrian perception, we can better understand its effect on their decision-making. To this end, we propose an agent-based pedestrian behavior model Intend-Wait-Perceive-Cross with three novel elements: field of vision, working memory, and scanning strategy, all motivated by findings from behavioral literature. Through extensive experimentation we investigate the effects of perceptual limitations on safe crossing decisions and demonstrate how they contribute to detectable changes in pedestrian behaviors.


title: p-Adic Statistical Field Theory and Convolutional Deep Boltzmann Machines

abstract: Understanding how deep learning architectures work is a central scientific problem. Recently, a correspondence between neural networks (NNs) and Euclidean quantum field theories (QFTs) has been proposed. This work investigates this correspondence in the framework of p-adic statistical field theories (SFTs) and neural networks (NNs). In this case, the fields are real-valued functions defined on an infinite regular rooted tree with valence p, a fixed prime number. This infinite tree provides the topology for a continuous deep Boltzmann machine (DBM), which is identified with a statistical field theory (SFT) on this infinite tree. In the p-adic framework, there is a natural method to discretize SFTs. Each discrete SFT corresponds to a Boltzmann machine (BM) with a tree-like topology. This method allows us to recover the standard DBMs and gives new convolutional DBMs. The new networks use O(N) parameters while the classical ones use O(N^{2}) parameters.


title: Cluster Toroidal Multipoles Formed by Electric-Quadrupole and Magnetic-Octupole Trimers: A Possible Scenario for Hidden Orders in Ca$_5$Ir$_3$O$_{12}$

abstract: Cluster multipole orderings composed of atomic high-rank multipole moments are theoretically investigated with a 5$d$-electron compound Ca$_5$Ir$_3$O$_{12}$ in mind. Ca$_5$Ir$_3$O$_{12}$ exhibits two hidden orders: One is an intermediate-temperature phase with time-reversal symmetry and the other is a low-temperature phase without time-reversal symmetry. By performing the symmetry and augmented multipole analyses for a $d$-orbital model under the hexagonal point group $D_{\rm 3h}$, we find that the 120$^{\circ}$-type ordering of the electric quadrupole corresponds to cluster electric toroidal dipole ordering with the electric ferroaxial moment, which can become the microscopic origin of the intermediate-temperature phase in Ca$_5$Ir$_3$O$_{12}$. Furthermore, based on ${}^{193}$Ir synchrotron-radiation-based M\"{o}ssbauer spectroscopy, we propose that the low-temperature phase in Ca$_5$Ir$_3$O$_{12}$ is regarded as a coexisting state with cluster electric toroidal dipole and cluster magnetic toroidal quadrupole, the latter of which is formed by the 120$^{\circ}$-type ordering of the magnetic octupole and accompanies a small uniform magnetization as a secondary effect. Our results provide a clue to two hidden phases in Ca$_5$Ir$_3$O$_{12}$.


title: The XPRESS Challenge: Xray Projectomic Reconstruction -- Extracting Segmentation with Skeletons

abstract: The wiring and connectivity of neurons form a structural basis for the function of the nervous system. Advances in volume electron microscopy (EM) and image segmentation have enabled mapping of circuit diagrams (connectomics) within local regions of the mouse brain. However, applying volume EM over the whole brain is not currently feasible due to technological challenges. As a result, comprehensive maps of long-range connections between brain regions are lacking. Recently, we demonstrated that X-ray holographic nanotomography (XNH) can provide high-resolution images of brain tissue at a much larger scale than EM. In particular, XNH is wellsuited to resolve large, myelinated axon tracts (white matter) that make up the bulk of long-range connections (projections) and are critical for inter-region communication. Thus, XNH provides an imaging solution for brain-wide projectomics. However, because XNH data is typically collected at lower resolutions and larger fields-of-view than EM, accurate segmentation of XNH images remains an important challenge that we present here. In this task, we provide volumetric XNH images of cortical white matter axons from the mouse brain along with ground truth annotations for axon trajectories. Manual voxel-wise annotation of ground truth is a time-consuming bottleneck for training segmentation networks. On the other hand, skeleton-based ground truth is much faster to annotate, and sufficient to determine connectivity. Therefore, we encourage participants to develop methods to leverage skeleton-based training. To this end, we provide two types of ground-truth annotations: a small volume of voxel-wise annotations and a larger volume with skeleton-based annotations. Entries will be evaluated on how accurately the submitted segmentations agree with the ground-truth skeleton annotations.


title: A Unified Multi-view Multi-person Tracking Framework

abstract: Although there is a significant development in 3D Multi-view Multi-person Tracking (3D MM-Tracking), current 3D MM-Tracking frameworks are designed separately for footprint and pose tracking. Specifically, frameworks designed for footprint tracking cannot be utilized in 3D pose tracking, because they directly obtain 3D positions on the ground plane with a homography projection, which is inapplicable to 3D poses above the ground. In contrast, frameworks designed for pose tracking generally isolate multi-view and multi-frame associations and may not be robust to footprint tracking, since footprint tracking utilizes fewer key points than pose tracking, which weakens multi-view association cues in a single frame. This study presents a Unified Multi-view Multi-person Tracking framework to bridge the gap between footprint tracking and pose tracking. Without additional modifications, the framework can adopt monocular 2D bounding boxes and 2D poses as the input to produce robust 3D trajectories for multiple persons. Importantly, multi-frame and multi-view information are jointly employed to improve the performance of association and triangulation. The effectiveness of our framework is verified by accomplishing state-of-the-art performance on the Campus and Shelf datasets for 3D pose tracking, and by comparable results on the WILDTRACK and MMPTRACK datasets for 3D footprint tracking.


title: PASTA: Pessimistic Assortment Optimization

abstract: We consider a class of assortment optimization problems in an offline data-driven setting. A firm does not know the underlying customer choice model but has access to an offline dataset consisting of the historically offered assortment set, customer choice, and revenue. The objective is to use the offline dataset to find an optimal assortment. Due to the combinatorial nature of assortment optimization, the problem of insufficient data coverage is likely to occur in the offline dataset. Therefore, designing a provably efficient offline learning algorithm becomes a significant challenge. To this end, we propose an algorithm referred to as Pessimistic ASsortment opTimizAtion (PASTA for short) designed based on the principle of pessimism, that can correctly identify the optimal assortment by only requiring the offline data to cover the optimal assortment under general settings. In particular, we establish a regret bound for the offline assortment optimization problem under the celebrated multinomial logit model. We also propose an efficient computational procedure to solve our pessimistic assortment optimization problem. Numerical studies demonstrate the superiority of the proposed method over the existing baseline method.


title: Clinical BioBERT Hyperparameter Optimization using Genetic Algorithm

abstract: Clinical factors account only for a small portion, about 10-30%, of the controllable factors that affect an individual's health outcomes. The remaining factors include where a person was born and raised, where he/she pursued their education, what their work and family environment is like, etc. These factors are collectively referred to as Social Determinants of Health (SDoH). The majority of SDoH data is recorded in unstructured clinical notes by physicians and practitioners. Recording SDoH data in a structured manner (in an EHR) could greatly benefit from a dedicated ontology of SDoH terms. Our research focuses on extracting sentences from clinical notes, making use of such an SDoH ontology (called SOHO) to provide appropriate concepts. We utilize recent advancements in Deep Learning to optimize the hyperparameters of a Clinical BioBERT model for SDoH text. A genetic algorithm-based hyperparameter tuning regimen was implemented to identify optimal parameter settings. To implement a complete classifier, we pipelined Clinical BioBERT with two subsequent linear layers and two dropout layers. The output predicts whether a text fragment describes an SDoH issue of the patient. We compared the AdamW, Adafactor, and LAMB optimizers. In our experiments, AdamW outperformed the others in terms of accuracy.


title: A Disposable Soft Magnetic Ribbon Based Sensor for Corrosion Monitoring

abstract: We present a new approach for real-time monitoring of chemical corrosion based on the radio-frequency (RF) impedance technology and soft ferromagnetic ribbons. The impedance (Z) of a commercial magnetic ribbon was measured in real time for 5 mul of drop-casted HNO3 of various concentrations. Variations in the concentration of the drop-casted acid were assessed by considering the difference in Z with and without the acid treatment. We found a large and linear increase in deltaZ and a large linear decrease in measurement time with the acid concentration, which are ideal for developing disposable chemical sensors for strength estimation of corrosive chemicals and for monitoring of a time-dependent chemical corrosion process. Since the ribbon used is commercially available at low cost and the measurement system is quick and low power consuming, the proposed sensor can be used as an easy, quick, and low-cost chemical probe in industries and environmental hazard management purposes.


title: VIBFREQ1295: A New Database for Vibrational Frequency Calculations

abstract: High-throughput approaches for producing approximate vibrational spectral data for molecules of astrochemistry interest rely on scaled harmonic frequency calculations. However, level of theory and basis set pair recommendations for these calculations are not yet available and thus benchmarking against comprehensive benchmark databases is needed. Here, we present a new database for vibrational frequency calculations (VIBFREQ1295) storing 1,295 experimental fundamental frequencies and CCSD(T)(F12*)/cc-pVDZ-F12 ab initio harmonic frequencies from 141 molecules. VIBFREQ1295's experimental data was complied through a comprehensive review of contemporary experimental data while the ab initio data was computed here. The chemical space spanned by the molecules chosen is considered in depth and shown to have good representation of common organic functional groups and vibrational modes. Scaling factors are routinely used to approximate the effect of anharmonicity and convert computed harmonic frequencies to predicted fundamental frequencies. With our experimental and high-level ab initio data, we find that a global scaling factor of 0.9617 results in median errors of 15.9 cm-1. Far superior performance with a median error of 7.5 cm-1 can be obtained, however, by using separate scaling factors for three regions: frequencies less than 1000 cm-1 (0.987), between 1000 and 2000 cm-1 (0.9727) and above 2000 cm-1 (0.9564). This sets a lower bound for the performance of level of theory and basis set pairs in scaled harmonic frequency calculations. VIBFREQ1295's most important purpose is to provide a robust benchmarking database for vibrational frequency calculations. The database can be found as part of the supplemental material for this paper, or in the Harvard DataVerse at https://doi.org/10.7910/DVN/VLVNU7.


title: Decentralized Riemannian Algorithm for Nonconvex Minimax Problems

abstract: The minimax optimization over Riemannian manifolds (possibly nonconvex constraints) has been actively applied to solve many problems, such as robust dimensionality reduction and deep neural networks with orthogonal weights (Stiefel manifold). Although many optimization algorithms for minimax problems have been developed in the Euclidean setting, it is difficult to convert them into Riemannian cases, and algorithms for nonconvex minimax problems with nonconvex constraints are even rare. On the other hand, to address the big data challenges, decentralized (serverless) training techniques have recently been emerging since they can reduce communications overhead and avoid the bottleneck problem on the server node. Nonetheless, the algorithm for decentralized Riemannian minimax problems has not been studied. In this paper, we study the distributed nonconvex-strongly-concave minimax optimization problem over the Stiefel manifold and propose both deterministic and stochastic minimax methods. The Steifel manifold is a non-convex set. The global function is represented as the finite sum of local functions. For the deterministic setting, we propose DRGDA and prove that our deterministic method achieves a gradient complexity of $O( \epsilon^{-2})$ under mild conditions. For the stochastic setting, we propose DRSGDA and prove that our stochastic method achieves a gradient complexity of $O(\epsilon^{-4})$. The DRGDA and DRSGDA are the first algorithms for distributed minimax optimization with nonconvex constraints with exact convergence. Extensive experimental results on the Deep Neural Networks (DNNs) training over the Stiefel manifold demonstrate the efficiency of our algorithms.


title: Data-driven Protection of Transformers, Phase Angle Regulators, and Transmission Lines in Interconnected Power Systems

abstract: This dissertation highlights the growing interest in and adoption of machine learning (ML) approaches for fault detection in modern power grids. Once a fault has occurred, it must be identified quickly and preventative steps must be taken to remove or insulate it. As a result, detecting, locating, and classifying faults early and accurately can improve safety and dependability while reducing downtime and hardware damage. ML-based solutions and tools to carry out effective data processing and analysis to aid power system operations and decision-making are becoming preeminent with better system condition awareness and data availability. Power transformers, Phase Shift Transformers or Phase Angle Regulators, and transmission lines are critical components in power systems, and ensuring their safety is a primary issue. Differential relays are commonly employed to protect transformers, whereas distance relays are utilized to protect transmission lines. Magnetizing inrush, overexcitation, and current transformer saturation make transformer protection a challenge. Furthermore, non-standard phase shift, series core saturation, low turn-to-turn, and turn-to-ground fault currents are non-traditional problems associated with Phase Angle Regulators. Faults during symmetrical power swings and unstable power swings may cause mal-operation of distance relays and unintentional and uncontrolled islanding. The distance relays also mal-operate for transmission lines connected to type-3 wind farms. The conventional protection techniques would no longer be adequate to address the above challenges due to limitations in handling and analyzing massive amounts of data, limited generalizability, incapability to model non-linear systems, etc. These limitations of differential and distance protection methods bring forward the motivation of using ML in addressing various protection challenges.


title: Autonomous coherence protection of a two-level system in a fluctuating environment

abstract: We re-examine a scheme generalized by [R. Finkelstein et al, Phys. Rev. X 11, 011008 (2021)], whose original purpose was to remove the effects of static Doppler broadening from an ensemble of non-interacting two-level systems (qubits). This scheme involves the simultaneous application of red and blue detuned drives between a qubit level and an auxiliary level, and by carefully choosing the drive amplitudes and detunings, the drive-induced energy shifts can exactly compensate the inhomogeneous static Doppler-induced frequency shifts - effectively removing the inhomogeneous Doppler broadening. We demonstrate that this scheme is far more powerful and can also protect a single (or even an ensemble), qubit's energy levels from noise which depends on both time and space: the same scheme can greatly reduce the effects of dephasing noise induced by a time-fluctuating environment. As examples we study protection against two types of non-Markovian environments that appear in many physical systems: Gaussian noise and non-Gaussian noise - Random Telegraph Noise. Through numerical simulations we demonstrate the enhancement of the spin coherence time $T_2^*$, of a qubit in a fluctuating environment by three orders of magnitude as well as the refocusing of its initially drifting frequency. This same scheme, using only two drives, can operate on an collection of qubits, providing temporal and spatial stabilization simultaneously and in parallel yielding a collection of high quality near-identical qubits which can be useful for many quantum technologies such as quantum computing and sensing, with the potential to achieve fault tolerant quantum computation much sooner.


title: Medium-Assisted Enhancement of $X(3872)$ Production from Small to Large Colliding Systems

abstract: Studies of exotic hadrons such as the $\chi_{c1} (3872)$ state provide crucial insights into the fundamental force governing the strong interaction dynamics, with an emerging new frontier to investigate their production in high energy collisions where a partonic medium is present. Latest experimental measurements from the Large Hadron Collider show an intriguing evolution pattern of the $\chi_{c1} (3872)$-to-$\psi(2S)$ yield ratio from proton-proton collisions with increasing multiplicities toward proton-lead and lead-lead collisions. Here we propose a novel mechanism of medium-assisted enhancement for the $\chi_{c1} (3872)$ production, which competes with the more conventional absorption-induced suppression and results in a non-monotonic trend from small to large colliding systems. Realistic simulations from this model offer the first quantitative description of all available data. Predictions are made for the centrality dependence of this observable in PbPb collisions as well as for its system size dependence from OO and ArAr to XeXe and PbPb collisions. In both cases, a non-monotonic behavior emerges as the imprint of the competition between enhancement and suppression and can be readily tested by future data.


title: Limit on Supernova Emission in the Brightest Gamma-ray Burst, GRB 221009A

abstract: We present photometric and spectroscopic observations of the extraordinary gamma-ray burst (GRB) 221009A in search of an associated supernova. Some past GRBs have shown bumps in the optical light curve that coincide with the emergence of supernova spectral features, but we do not detect any significant light curve features in GRB~221009A, nor do we detect any clear sign of supernova spectral features. Using two well-studied GRB-associated supernovae (SN~2013dx, $M_{r,max} = -19.54$; SN~2016jca, $M_{r,max} = -19.04$) at a similar redshift as GRB~221009A ($z=0.151$), we modeled how the emergence of a supernova would affect the light curve. If we assume the GRB afterglow to decay at the same rate as the X-ray data, the combination of afterglow and a supernova component is fainter than the observed GRB brightness. For the case where we assume the best-fit power law to the optical data as the GRB afterglow component, a supernova contribution should have created a clear bump in the light curve, assuming only extinction from the Milky Way. If we assume a higher extinction of $E(B-V)$=$1.74$ mag (as has been suggested elsewhere), the supernova contribution would have been hard to detect, with a limit on the associated supernova of $M_{r,max} \approx-$19.54. We do not observe any clear supernova features in our spectra, which were taken around the time of expected maximum light. The lack of a bright supernova associated with GRB~221009A may indicate that the energy from the explosion is mostly concentrated in the jet, leaving a lower energy budget available for the supernova.


title: TetCNN: Convolutional Neural Networks on Tetrahedral Meshes

abstract: Convolutional neural networks (CNN) have been broadly studied on images, videos, graphs, and triangular meshes. However, it has seldom been studied on tetrahedral meshes. Given the merits of using volumetric meshes in applications like brain image analysis, we introduce a novel interpretable graph CNN framework for the tetrahedral mesh structure. Inspired by ChebyNet, our model exploits the volumetric Laplace-Beltrami Operator (LBO) to define filters over commonly used graph Laplacian which lacks the Riemannian metric information of 3D manifolds. For pooling adaptation, we introduce new objective functions for localized minimum cuts in the Graclus algorithm based on the LBO. We employ a piece-wise constant approximation scheme that uses the clustering assignment matrix to estimate the LBO on sampled meshes after each pooling. Finally, adapting the Gradient-weighted Class Activation Mapping algorithm for tetrahedral meshes, we use the obtained heatmaps to visualize discovered regions-of-interest as biomarkers. We demonstrate the effectiveness of our model on cortical tetrahedral meshes from patients with Alzheimer's disease, as there is scientific evidence showing the correlation of cortical thickness to neurodegenerative disease progression. Our results show the superiority of our LBO-based convolution layer and adapted pooling over the conventionally used unitary cortical thickness, graph Laplacian, and point cloud representation.


title: Estimating Longitudinal Causal Effects with Unobserved Noncompliance Using a Semi-Parametric G-computation Algorithm

abstract: Participant noncompliance, in which participants do not follow their assigned treatment protocol, often obscures the causal relationship between treatment and treatment effect in randomized trials. In the longitudinal setting, the G-computation algorithm can adjust for confounding to estimate causal effects. Typically, G-computation assumes that both 1) compliance is observed; and 2) the densities of the confounders can be correctly specified. We aim to develop a G-computation estimator in the setting where both assumptions are violated. For 1), in place of unobserved compliance, we substitute in probability weights derived from modeling a biomarker associated with compliance. For 2), we fit semiparametric models using predictive mean matching. Specifically, we parametrically specify only the conditional mean of the confounders, and then use predictive mean matching to randomly generate confounder data for G-computation. In both the simulation and application, we compare multiple causal estimators already established in the literature with those derived from our method. For the simulation, we generated data across different sample sizes and levels of confounding. For the application, we apply our method to a trial that sought to evaluate the effect of cigarettes with low nicotine on cigarette consumption (Center for the Evaluation of Nicotine in Cigarettes Project 2 - CENIC-P2).


title: Group LASSO Variable Selection Method for Treatment Effect Generalization

abstract: Often in public health, we are interested in the treatment effect of an intervention on a population that is systemically different from the experimental population the intervention was originally evaluated in. When treatment effect heterogeneity is present in a randomized controlled trial, generalizing the treatment effect from this experimental population to a target population of interest is a complex problem; it requires the characterization of both the treatment effect heterogeneity and the baseline covariate mismatch between the two populations. Despite the importance of this problem, the literature for variable selection in this context is limited. In this paper, we present a Group LASSO-based approach to variable selection in the context of treatment effect generalization, with an application to generalize the treatment effect of very low nicotine content cigarettes to the overall U.S. smoking population.


title: Phase transitions and spin dynamics of the quasi-one dimensional Ising-like antiferromagnet BaCo$_{2}$V$_{2}$O$_{8}$ in a longitudinal magnetic field

abstract: By combining inelastic neutron scattering and numerical simulations, we study the quasi-one dimensional Ising-like quantum antiferromagnet BaCo$_{2}$V$_{2}$O$_{8}$ in a longitudinal magnetic field applied along the magnetic anisotropy axis, which is also the chain direction. The external field closes the excitation gap due to the magnetic anisotropy, inducing a transition from the N\'eel ordered state to an incommensurate longitudinal spin density wave phase. If the field is increased further, another transition into a transverse antiferromagnetic phase takes place at 9 T due to the competition between longitudinal and transverse correlations. We numerically and experimentally show that the model of XXZ chains connected by a weak interchain interaction well reproduces this transition. We also calculate the dynamical susceptibility and demonstrate that it agrees quantitatively with inelastic neutron scattering measurements. In contrast to the abrupt change of magnetic ordering, the spectra do not change much at the transition at 9 T, and the spin dynamics can be described as a Tomonaga-Luttinger liquid. We also refine the modeling of BaCo$_{2}$V$_{2}$O$_{8}$ by including a four-site periodic term arising from the crystal structure which enables to account for an anomaly of the magnetic susceptibility appearing at 19 T as well as for the anticrossing observed in the inelastic neutron scattering spectra.


title: Simulation of Kitaev model using one-dimensional chain of superconducting qubits and environmental effect on topological states

abstract: Kitaev fermionic chain is one of the important physical models for studying topological physics and quantum computing. We here propose an approach to simulate the one-dimensional Kitaev model by a chain of superconducting qubit circuits. Furthermore, we study the environmental effect on topological quantum states of the Kitaev model. Besides the independent environment surrounding each qubit, we also consider the common environment shared by two nearest neighboring qubits. Such common environment can result in an effective non-Hermitian dissipative coupling between two qubits. Through theoretical analysis and numerical calculations, we show that the common environment can significantly change properties of topological states in contrast to the independent environment. In addition, we also find that dissipative couplings at the edges of the chain can be used to more easily tune the topological properties of the system than those at other positions. Our study may open a new way to explore topological quantum phase transition and various environmental effects on topological physics using superconducting qubit circuits.


title: Rademacher's Formula for the Partition Function

abstract: For a positive integer $n$, let $p(n)$ be the number of ways to express $n$ as a sum of positive integers. In this note, we revisit the derivation of the Rademacher's convergent series for $p(n)$ in a pedagogical way, with all the details given. We also derive the leading asymptotic behavior of $p(n)$ when $n$ approaches infinity. Some numerical results are tabled.


title: Topological Deep Learning: A Review of an Emerging Paradigm

abstract: Topological data analysis (TDA) provides insight into data shape. The summaries obtained by these methods are principled global descriptions of multi-dimensional data whilst exhibiting stable properties such as robustness to deformation and noise. Such properties are desirable in deep learning pipelines but they are typically obtained using non-TDA strategies. This is partly caused by the difficulty of combining TDA constructs (e.g. barcode and persistence diagrams) with current deep learning algorithms. Fortunately, we are now witnessing a growth of deep learning applications embracing topologically-guided components. In this survey, we review the nascent field of topological deep learning by first revisiting the core concepts of TDA. We then explore how the use of TDA techniques has evolved over time to support deep learning frameworks, and how they can be integrated into different aspects of deep learning. Furthermore, we touch on TDA usage for analyzing existing deep models; deep topological analytics. Finally, we discuss the challenges and future prospects of topological deep learning.


title: Robust Digital Watermarking Method Based on Adaptive Feature Area Extraction and Local Histogram Shifting

abstract: A new local watermarking method based on histogram shifting has been proposed in this paper to deal with various signal processing attacks (e.g. median filtering, JPEG compression and Gaussian noise addition) and geometric attacks (e.g. rotation, scaling and cropping). A feature detector is used to select local areas for embedding. Then stationary wavelet transform (SWT) is applied on each local area for denoising by setting the corresponding diagonal coefficients to zero. With the implementation of histogram shifting, the watermark is embedded into denoised local areas. Meanwhile, a secret key is used in the embedding process which ensures the security that the watermark cannot be easily hacked. After the embedding process, the SWT diagonal coefficients are used to reconstruct the watermarked image. With the proposed watermarking method, we can achieve higher image quality and less bit error rate (BER) in the decoding process even after some attacks. Compared with global watermarking methods, the proposed watermarking scheme based on local histogram shifting has the advantages of higher security and larger capacity. The experimental results show the better image quality as well as lower BER compared with the state-of-art watermarking methods.


title: Spatio-spectral metrics in electron energy loss spectroscopy as a tool to resolve nearly degenerate plasmon modes in dimer plasmonic antennas

abstract: Electron energy loss spectroscopy (EELS) is often utilized to characterize localized surface plasmon modes supported by plasmonic antennas. However, the spectral resolution of this technique is only mediocre, and it can be rather difficult to resolve modes close in the energy, such as coupled modes of dimer antennas. Here we address this issue for a case study of the dimer plasmonic antenna composed of two gold discs. We analyze four nearly degenerate coupled plasmon modes of the dimer: longitudinal and transverse bonding and antibonding dipole modes. With a traditional approach, which takes into account the spectral response of the antennas recorded at specific points, the modes cannot be experimentally identified with EELS. Therefore, we employ the spectral and spatial sensitivity of EELS simultaneously. We propose several metrics that can be utilized to resolve the modes. First, we utilize electrodynamic simulations to verify that the metrics indeed represent the spectral positions of the plasmon modes. Next, we apply the metrics to experimental data, demonstrating their ability to resolve three of the above-mentioned modes (with transverse bonding and antibonding modes still unresolved), identify them unequivocally, and determine their energies. In this respect, the spatio-spectral metrics increase the information extracted from electron energy loss spectroscopy applied to plasmonic antennas.


title: Futuristic Variations and Analysis in Fundus Images Corresponding to Biological Traits

abstract: Fundus image captures rear of an eye, and which has been studied for the diseases identification, classification, segmentation, generation, and biological traits association using handcrafted, conventional, and deep learning methods. In biological traits estimation, most of the studies have been carried out for the age prediction and gender classification with convincing results. However, the current study utilizes the cutting-edge deep learning (DL) algorithms to estimate biological traits in terms of age and gender together with associating traits to retinal visuals. For the traits association, our study embeds aging as the label information into the proposed DL model to learn knowledge about the effected regions with aging. Our proposed DL models, named FAG-Net and FGC-Net, correspondingly estimate biological traits (age and gender) and generates fundus images. FAG-Net can generate multiple variants of an input fundus image given a list of ages as conditions. Our study analyzes fundus images and their corresponding association with biological traits, and predicts of possible spreading of ocular disease on fundus images given age as condition to the generative model. Our proposed models outperform the randomly selected state of-the-art DL models.


title: MMPD: Multi-Domain Mobile Video Physiology Dataset

abstract: Remote photoplethysmography (rPPG) is an attractive method for noninvasive, convenient and concomitant measurement of physiological vital signals. Public benchmark datasets have served a valuable role in the development of this technology and improvements in accuracy over recent years.However, there remain gaps in the public datasets.First, despite the ubiquity of cameras on mobile devices, there are few datasets recorded specifically with mobile phone cameras. Second, most datasets are relatively small and therefore are limited in diversity, both in appearance (e.g., skin tone), behaviors (e.g., motion) and environment (e.g., lighting conditions). In an effort to help the field advance, we present the Multi-domain Mobile Video Physiology Dataset (MMPD), comprising 11 hours of recordings from mobile phones of 33 subjects. The dataset is designed to capture videos with greater representation across skin tone, body motion, and lighting conditions. MMPD is comprehensive with eight descriptive labels and can be used in conjunction with the rPPG-toolbox. The reliability of the dataset is verified by mainstream unsupervised methods and neural methods. The GitHub repository of our dataset: https://github.com/THU-CS-PI/MMPD_rPPG_dataset.


title: On boundedness of singularities and minimal log discrepancies of Koll\'ar components, II

abstract: We show that a set of K-semistable log Fano cone singularities is bounded if and only if their local volumes are bounded away from zero, and their minimal log discrepancies of Koll\'ar components are bounded from above. As corollaries, we confirm the boundedness conjecture for K-semistable log Fano cone singularities in dimension three, and show that local volumes of 3-dimensional klt singularities only accumulate at zero.


title: De-Higgsing In Eleven-Dimensional Supergravity On The Squashed $S^7$

abstract: In this paper we construct the subset of modes on $S^7$ that are relevant in the compactification of eleven-dimensional supergravity on a squashed $S^7$ when restricted to the sector that comprises singlets under the $Sp(1)\times Sp(2)$ isometry of the squashed sphere. Some of the properties of these modes, connected to the transition from the round $S^7$ to the squashed $S^7$, are analysed in detail. Special features of the Rarita-Schwinger operator, described in earlier work by Buchdahl, are explained and related to properties of the squashed $S^7$ operator spectrum obtained in previous work by the authors. We then discuss how the singlet modes give rise to supermultiplets in the left-squashed case, the phenomenon of de-Higgsing, and what happens to the AdS$_4$ fields in these supermultiplets under an orientation reversal (``skew-whiffing'') of the squashed $S^7$. Finally, we consider the possible choices of boundary conditions that appear for some of these fields in AdS$_4$ in the case of the right-squashed non-supersymmetric compactification, and how these choices may affect the stability of the gravity theory.


title: Data-Driven Prediction of Complex Crystal Structures of Dense Lithium

abstract: Lithium (Li) is a prototypical simple metal at ambient conditions, but exhibits remarkable changes in structural and electronic properties under compression. There has been intense debate about the structure of dense Li, and recent experiments offered fresh evidence for new yet undetermined crystalline phases near the enigmatic melting minimum region in the pressure-temperature phase diagram of Li. Here, we report on an extensive exploration of the energy landscape of Li using an advanced crystal structure search method combined with a machine learning approach, which greatly expands the scale of structure search, leading to the prediction of four complex Li crystal phases containing up to 192 atoms in the unit cell that are energetically competitive with known Li structures. These findings provide a viable solution to the newly observed yet unidentified crystalline phases of Li, and showcase the predictive power of the global structure search method for discovering complex crystal structures in conjunction with accurate machine-learning potentials.


title: Direct triple-$\alpha$ process in non-adiabatic approach

abstract: Triple-$\alpha$ reaction rates have been determined well with the sequential process via the narrow resonances. However, the direct triple-$\alpha$ process at off-resonant energies still remains in unsolved problems. In the present report, the direct triple-$\alpha$ contribution is estimated with a non-adiabatic method, and it is found to be 10$^{-15}$--10$^{-3}$ pb order in photodisintegration cross sections of $^{12}$C(2$^+_1 \rightarrow$ 0$^+$) for $0.15 < E < 0.35$ MeV. This is far below the values predicted by the recent adiabatic models. In spite of the large difference, the derived rates are found to be concordant with NACRE at the helium burning temperatures.


title: Two-step hyperparameter optimization method: Accelerating hyperparameter search by using a fraction of a training dataset

abstract: Hyperparameter optimization (HPO) is an important step in machine learning (ML) model development, but common practices are archaic -- primarily relying on manual or grid searches. This is partly because adopting advanced HPO algorithms introduces added complexity to the workflow, leading to longer computation times. This poses a notable challenge to ML applications, as suboptimal hyperparameter selections curtail the potential of ML model performance, ultimately obstructing the full exploitation of ML techniques. In this article, we present a two-step HPO method as a strategic solution to curbing computational demands and wait times, gleaned from practical experiences in applied ML parameterization work. The initial phase involves a preliminary evaluation of hyperparameters on a small subset of the training dataset, followed by a re-evaluation of the top-performing candidate models post-retraining with the entire training dataset. This two-step HPO method is universally applicable across HPO search algorithms, and we argue it has attractive efficiency gains. As a case study, we present our recent application of the two-step HPO method to the development of neural network emulators for aerosol activation. Although our primary use case is a data-rich limit with many millions of samples, we also find that using up to 0.0025% of the data (a few thousand samples) in the initial step is sufficient to find optimal hyperparameter configurations from much more extensive sampling, achieving up to 135-times speedup. The benefits of this method materialize through an assessment of hyperparameters and model performance, revealing the minimal model complexity required to achieve the best performance. The assortment of top-performing models harvested from the HPO process allows us to choose a high-performing model with a low inference cost for efficient use in global climate models (GCMs).


title: Search for stochastic gravitational-wave background from string cosmology with Advanced LIGO and Virgo's O1$\sim$O3 data

abstract: String cosmology models predict a relic background of gravitational-wave (GW) radiation in the early universe. The GW energy spectrum of radiated power increases rapidly with the frequency, and therefore it becomes a potential and meaningful observation object for high-frequency GW detector. We focus on the stochastic background generated by superinflation in string theory and search for such signal in the observing data of Advanced LIGO and Virgo O1$\sim$O3 runs in a Bayesian framework. We do not find the existence of the signal, and thus put constraints on the GW energy density. Our results indicate that at $f=100\,\text{Hz}$, the fractional energy density of GW background is less than $1.7\times10^{-8}$ and $2.1\times10^{-8}$ for dilaton-string and dilaton only cases respectively, and further rule out the parameter space restricted by the model itself due to the non-decreasing dilaton and stable cosmology background ($\beta$ bound).


title: Gauge theories with non-trivial boundary conditions: Black holes

abstract: We study the partition function and entropy of U(1) gauge theories with multiple boundaries on the black holes background. The nontrivial boundary conditions allow residual zero longitudinal momentum modes and Wilson lines stretched between boundaries. Topological modes of the Wilson lines and other modes are also analyzed in this paper. We study the behavior of the partition function of the theory in different temperature limits, and find the transitions of dominances of different modes as we vary the temperature. Moreover, we find two different area contributions plus logarithm corrections in the entropy. One being part of the bulk fluctuation modes can be seen for finite-temperature black holes, and the other coming from vacuum degeneracy can only be seen in the superlow temperature limit. We have confirmed the mechanism and entropy found in the superlow temperature limit also persist for extremal black holes. The gauge fluctuation on the black hole background might help us understand some fundamental aspects of quantum gravity related to gauge symmetries.


title: Controlling Personality Style in Dialogue with Zero-Shot Prompt-Based Learning

abstract: Prompt-based or in-context learning has achieved high zero-shot performance on many natural language generation (NLG) tasks. Here we explore the performance of prompt-based learning for simultaneously controlling the personality and the semantic accuracy of an NLG for task-oriented dialogue. We experiment with prompt-based learning on the PERSONAGE restaurant recommendation corpus to generate semantically and stylistically-controlled text for 5 different Big-5 personality types: agreeable, disagreeable, conscientious, unconscientious, and extravert. We test two different classes of discrete prompts to generate utterances for a particular personality style: (1) prompts that demonstrate generating directly from a meaning representation that includes a personality specification; and (2) prompts that rely on first converting the meaning representation to a textual pseudo-reference, and then using the pseudo-reference in a textual style transfer (TST) prompt. In each case, we show that we can vastly improve performance by over-generating outputs and ranking them, testing several ranking functions based on automatic metrics for semantic accuracy, personality-match, and fluency. We also test whether NLG personality demonstrations from the restaurant domain can be used with meaning representations for the video game domain to generate personality stylized utterances about video games. Our findings show that the TST prompts produces the highest semantic accuracy (78.46% for restaurants and 87.6% for video games) and personality accuracy (100% for restaurants and 97% for video games). Our results on transferring personality style to video game utterances are surprisingly good. To our knowledge, there is no previous work testing the application of prompt-based learning to simultaneously controlling both style and semantic accuracy in NLG.


title: Estimation of Gaussian Bi-Clusters with General Block-Diagonal Covariance Matrix and Applications

abstract: Bi-clustering is a technique that allows for the simultaneous clustering of observations and features in a dataset. This technique is often used in bioinformatics, text mining, and time series analysis. An important advantage of biclustering algorithm is the ability to uncover multiple ``views'' (i.e., through rows and column groupings) in the data. Several Gaussian mixture model based biclustering approach currently exist in the literature. However, they impose severe restrictions on the structure of the covariance matrix. Here, we propose a Gaussian mixture model-based bi-clustering approach that provides a more flexible block-diagonal covariance structure. We show that the clustering accuracy of the proposed model is comparable to other known techniques but our approach provides a more flexible covariance structure and has substantially lower computational time. We demonstrate the application of the proposed model in bioinformatics and topic modelling.


title: Tight Concentration Inequality for Sub-Weibull Random Variables with Generalized Bernstien Orlicz norm

abstract: Recent development in high-dimensional statistical inference has necessitated concentration inequalities for a broader range of random variables. We focus on sub-Weibull random variables, which extend sub-Gaussian or sub-exponential random variables to allow heavy-tailed distributions. This paper presents concentration inequalities for independent sub-Weibull random variables with finite Generalized Bernstein-Orlicz norms, providing generalized Bernstein's inequalities and Rosenthal-type moment bounds. The tightness of the proposed bounds is shown through lower bounds of the concentration inequalities obtained via the Paley-Zygmund inequality. The results are applied to a graphical model inference problem, improving previous sample complexity bounds.


title: ED-Batch: Efficient Automatic Batching of Dynamic Neural Networks via Learned Finite State Machines

abstract: Batching has a fundamental influence on the efficiency of deep neural network (DNN) execution. However, for dynamic DNNs, efficient batching is particularly challenging as the dataflow graph varies per input instance. As a result, state-of-the-art frameworks use heuristics that result in suboptimal batching decisions. Further, batching puts strict restrictions on memory adjacency and can lead to high data movement costs. In this paper, we provide an approach for batching dynamic DNNs based on finite state machines, which enables the automatic discovery of batching policies specialized for each DNN via reinforcement learning. Moreover, we find that memory planning that is aware of the batching policy can save significant data movement overheads, which is automated by a PQ tree-based algorithm we introduce. Experimental results show that our framework speeds up state-of-the-art frameworks by on average 1.15x, 1.39x, and 2.45x for chain-based, tree-based, and lattice-based DNNs across CPU and GPU.