title: Fast Flavor Transformations

abstract: The neutrino fast flavor instability (FFI) can change neutrino flavor on time scales of nanoseconds and length scales of centimeters. It is expected to be ubiquitous in core-collapse supernovae and neutron star mergers, potentially modifying the neutrino signal we see, how matter is ejected from these explosions, and the types of heavy elements that form in the ejecta and enrich the universe. There has been a great deal of recent interest in understanding the role the FFI plays in supernovae and mergers, but the short length and time scales and the strong nonlinearity have prevented the FFI from being included consistently in these models. We review the theoretical nature of the FFI starting with the quantum kinetic equations, where the instability exists in neutron star mergers and supernovae, and how the instability behaves after saturation in simplified simulations. We review the proposed methods to test for instability in moment-based calculations where the full distribution is not available and describe the numerical methods used to simulate the instability directly. Finally, we close by outlining the trajectory toward realistic, self-consistent models that will allow a more complete understanding of the impact of the FFI in supernovae and mergers.


title: Finite-rate sparse quantum codes aplenty

abstract: We introduce a methodology for generating random multi-qubit stabilizer codes based on solving a constraint satisfaction problem (CSP) on random bipartite graphs. This framework allows us to enforce stabilizer commutation, $X/Z$ balancing, finite rate, sparsity, and maximum-degree constraints simultaneously in a CSP that we can then solve numerically. Using a state-of-the-art CSP solver, we obtain convincing evidence for the existence of a satisfiability threshold. Furthermore, the extent of the satisfiable phase increases with the number of qubits. In that phase, finding sparse codes becomes an easy problem. Moreover, we observe that the sparse codes found in the satisfiable phase practically achieve the channel capacity for erasure noise. Our results show that intermediate-size finite-rate sparse quantum codes are easy to find, while also demonstrating a flexible methodology for generating good codes with custom properties. We therefore establish a complete and customizable pipeline for random quantum code discovery.


title: Principal Component Analysis of Azimuthal Flow in Intermediate-Energy Heavy-Ion Reactions

abstract: Principal Component Analysis (PCA) via Singular Value Decomposition (SVD) of large datasets is an adaptive exploratory method to uncover natural patterns underlying the data. Several recent applications of the PCA-SVD to event-by-event single-particle azimuthal angle distribution matrices in ultra-relativistic heavy-ion collisions at RHIC-LHC energies indicate that the sine and cosine functions chosen {\it a priori} in the traditional Fourier analysis are naturally the most optimal basis for azimuthal flow studies according to the data itself. We perform PCA-SVD analyses of mid-central Au+Au collisions at $E_{\rm beam}/A$=1.23 GeV simulated using an isospin-dependent Boltzmann-Uehling-Uhlenbeck (IBUU) transport model to address the following two questions: (1) if the principal components of the covariance matrix of nucleon azimuthal angle distributions in heavy-ion reactions around 1 GeV/nucleon are naturally sine and/or cosine functions and (2) what if any advantages the PCA-SVD may have over the traditional flow analysis using the Fourier expansion for studying the EOS of dense nuclear matter. We find that (1) in none of our analyses the principal components come out naturally as sine and/or cosine functions, (2) while both the eigenvectors and eigenvalues of the covariance matrix are appreciably EOS dependent, the PCA-SVD has no apparent advantage over the traditional Fourier analysis for studying the EOS of dense nuclear matter using the azimuthal collective flow in heavy-ion collisions.


title: Droop-e: Exponential Droop as a Function of Power Output for Grid-Forming Inverters with Autonomous Power Sharing

abstract: This paper presents the novel Droop-e grid-forming inverter control strategy, which establishes an active power-frequency relationship based on an exponential function of the inverter power dispatch. The advantages of this control strategy include an increased utilization of available headroom, mitigated system frequency dynamics, and a natural limiting behavior, all of which are directly compared to the hitherto standard static droop approach. First, the small signal stability of the Droop-e control is assessed on a 3-bus system and found stable across all possible inverter power dispatches. Then, time-domain simulations show improved frequency dynamics at lower power dispatches, and a limiting behavior at higher dispatches. Finally, a novel secondary control scheme is introduced that achieves power sharing following the primary Droop-e response to load perturbations, which is shown to be effective in time-domain simulations of the 3- and 9-bus systems; comparative simulations with a static 5% droop yields unacceptable frequency deviations, highlighting the superiority of the Droop-e control.


title: With a little help from my friends: essentiality vs opportunity in group criticality

abstract: We define a notion of the criticality of a player for simple monotone games based on cooperation with other players, either to form a winning coalition or to break a winning one, with an essential role for all the players involved. We compare it with the notion of differential criticality given by Beisbart that measures power as the opportunity left by other players. We prove that our proposal satisfies an extension of the strong monotonicity introduced by Young, assigns no power to null players and does not reward free riders, and can easily be computed from the minimal winning and blocking coalitions. An application to the Italian elections is presented. Our analysis shows that the measures of group criticality defined so far cannot weigh essential players while only remaining an opportunity measure. We propose a group opportunity test to reconcile the two views.


title: A Note on Stability of Event-Triggered Control Systems with Time Delays

abstract: This note studies stability of event-triggered control systems with the event-triggered control algorithm proposed in [1]. We construct a novel Halanay-type inequality, which is used to show that sufficient conditions of the main results in [1] ensure stability of the event-triggered control systems that was missing in [1]. It is also shown that a positive parameter in the proposed event-triggering condition in [1] can be freely selected to exclude Zeno behavior from the event-triggered control system. An illustrative example is investigated to demonstrate the theoretical results of this study with numerical simulations. [1] K. Zhang, B. Gharesifard, and E. Braverman, Event-triggered control for nonlinear time-delay systems, IEEE Transactions on Automatic Control, vol. 67, no. 2, pp. 1031-1037, 2022.


title: Towards Optimal Integrated Planning of Electricity and Hydrogen Infrastructure for Large-Scale Renewable Energy Transport

abstract: The imminent advent of large-scale green hydrogen (H2) production raises the central question of which of the two options, transporting "green" molecules, or transporting "green" electrons, is the most cost-effective one. This paper proposes a first-of-its-kind mathematical framework for the optimal integrated planning of electricity and H2 infrastructure for transporting large-scale variable renewable energy (VRE). In contrast to most existing works, this work incorporates essential nonlinearities such as voltage drops due to losses in high-voltage alternating current (HVAC) and high-voltage direct current (HVDC) transmission lines, losses in HVDC converter stations, reactive power flow, pressure drops in pipelines, and linepack, all of which play an important role in determining the optimal infrastructure investment decision. Capturing these nonlinearities requires casting the problem as a nonconvex mixed-integer nonlinear program (MINLP), whose complexity is further exacerbated by its large size due to the relatively high temporal resolution of RES forecasts. This work then leverages recent advancements in convex relaxations to instead solve a tractable alternative in the form of a mixed-integer quadratically constrained programming (MIQCP) problem. The impact of other fundamental factors such as transmission distance and RES capacity is also thoroughly analysed on a canonical two-node system. The integrated planning model is then demonstrated on a real-world case study involving renewable energy zones in Australia.


title: The use of deep learning enables high diagnostic accuracy in detecting syndesmotic instability on weight-bearing CT scanning

abstract: Delayed diagnosis of syndesmosis instability can lead to significant morbidity and accelerated arthritic change in the ankle joint. Weight-bearing computed tomography (WBCT) has shown promising potential for early and reliable detection of isolated syndesmotic instability using 3D volumetric measurements. While these measurements have been reported to be highly accurate, they are also experience-dependent, time-consuming, and need a particular 3D measurement software tool that leads the clinicians to still show more interest in the conventional diagnostic methods for syndesmotic instability. The purpose of this study was to increase accuracy, accelerate analysis time, and reduce inter-observer bias by automating 3D volume assessment of syndesmosis anatomy using WBCT scans. We conducted a retrospective study using previously collected WBCT scans of patients with unilateral syndesmotic instability. 144 bilateral ankle WBCT scans were evaluated (48 unstable, 96 control). We developed three deep learning (DL) models for analyzing WBCT scans to recognize syndesmosis instability. These three models included two state-of-the-art models (Model 1 - 3D convolutional neural network [CNN], and Model 2 - CNN with long short-term memory [LSTM]), and a new model (Model 3 - differential CNN LSTM) that we introduced in this study. Model 1 failed to analyze the WBCT scans (F1-score = 0). Model 2 only misclassified two cases (F1-score = 0.80). Model 3 outperformed Model 2 and achieved a nearly perfect performance, misclassifying only one case (F1-score = 0.91) in the control group as unstable while being faster than Model 2.


title: Enhanced brain structure-function tethering in transmodal cortex revealed by high-frequency eigenmodes

abstract: The brain's structural connectome supports signal propagation between neuronal elements, shaping diverse coactivation patterns that can be captured as functional connectivity. While the link between structure and function remains an ongoing challenge, the prevailing hypothesis is that the structure-function relationship may itself be gradually decoupled along a macroscale functional gradient spanning unimodal to transmodal regions. However, this hypothesis is strongly constrained by the underlying models which may neglect requisite signaling mechanisms. Here, we transform the structural connectome into a set of orthogonal eigenmodes governing frequency-specific diffusion patterns and show that regional structure-function relationships vary markedly under different signaling mechanisms. Specifically, low-frequency eigenmodes, which are considered sufficient to capture the essence of the functional network, contribute little to functional connectivity reconstruction in transmodal regions, resulting in structure-function decoupling along the unimodal-transmodal gradient. In contrast, high-frequency eigenmodes, which are usually on the periphery of attention due to their association with noisy and random dynamical patterns, contribute significantly to functional connectivity prediction in transmodal regions, inducing gradually convergent structure-function relationships from unimodal to transmodal regions. Although the information in high-frequency eigenmodes is weak and scattered, it effectively enhances the structure-function correspondence by 35% in unimodal regions and 56% in transmodal regions. Altogether, our findings suggest that the structure-function divergence in transmodal areas may not be an intrinsic property of brain organization, but can be narrowed through multiplexed and regionally specialized signaling mechanisms.


title: Ultralow voltage, High-speed, and Energy-efficient Cryogenic Electro-Optic Modulator

abstract: Photonic integrated circuits (PICs) at cryogenic temperatures enable a wide range of applications in scalable classical and quantum systems for computing and sensing. A promising application of cryogenic PICs is to provide optical interconnects by up-converting signals from electrical to optical domain, allowing massive data-transfer from 4 K superconducting (SC) electronics to room temperature environment. Such a solution is central to overcome the major bottleneck in the scalability of cryogenic systems, which currently rely on bulky copper cables that suffer from limited bandwidth, large heat load, and do not show any scalability path. A key element for realizing a cryogenic-to-room temperature optical interconnect is a high-speed electro-optic (EO) modulator operating at 4 K with operation voltage at mV scale, compatible with SC electronics. Although several cryogenic EO modulators have been demonstrated, their driving voltages are significantly large compared to the mV scale voltage required for SC circuits. Here, we demonstrate a cryogenic modulator with ~10 mV peak-to-peak driving voltage and gigabits/sec data rate, with ultra-low electric and optical energy consumptions of ~10.4 atto-joules/bit and ~213 femto-joules/bit, respectively. We achieve this record performance by designing a compact optical ring resonator modulator in a heterogeneous InP-on-Silicon platform, where we optimize a multi-quantum well layer of InAIGaAs to achieve a strong EO effect at 4 K. Unlike other semiconductors such as silicon, our platform benefits from the high-carrier mobility and minimal free carrier freezing of III-V compounds at low temperatures, with moderate doping level and low loss (intrinsic resonator Q~272,000). These modulators can pave the path for complex cryogenic photonic functionalities and massive data transmission between cryogenic and room-temperature electronics.


title: A Study on the Predictability of Sample Learning Consistency

abstract: Curriculum Learning is a powerful training method that allows for faster and better training in some settings. This method, however, requires having a notion of which examples are difficult and which are easy, which is not always trivial to provide. A recent metric called C-Score acts as a proxy for example difficulty by relating it to learning consistency. Unfortunately, this method is quite compute intensive which limits its applicability for alternative datasets. In this work, we train models through different methods to predict C-Score for CIFAR-100 and CIFAR-10. We find, however, that these models generalize poorly both within the same distribution as well as out of distribution. This suggests that C-Score is not defined by the individual characteristics of each sample but rather by other factors. We hypothesize that a sample's relation to its neighbours, in particular, how many of them share the same labels, can help in explaining C-Scores. We plan to explore this in future work.


title: The ACII 2022 Affective Vocal Bursts Workshop & Competition: Understanding a critically understudied modality of emotional expression

abstract: The ACII Affective Vocal Bursts Workshop & Competition is focused on understanding multiple affective dimensions of vocal bursts: laughs, gasps, cries, screams, and many other non-linguistic vocalizations central to the expression of emotion and to human communication more generally. This year's competition comprises four tracks using a large-scale and in-the-wild dataset of 59,299 vocalizations from 1,702 speakers. The first, the A-VB-High task, requires competition participants to perform a multi-label regression on a novel model for emotion, utilizing ten classes of richly annotated emotional expression intensities, including; Awe, Fear, and Surprise. The second, the A-VB-Two task, utilizes the more conventional 2-dimensional model for emotion, arousal, and valence. The third, the A-VB-Culture task, requires participants to explore the cultural aspects of the dataset, training native-country dependent models. Finally, for the fourth task, A-VB-Type, participants should recognize the type of vocal burst (e.g., laughter, cry, grunt) as an 8-class classification. This paper describes the four tracks and baseline systems, which use state-of-the-art machine learning methods. The baseline performance for each track is obtained by utilizing an end-to-end deep learning model and is as follows: for A-VB-High, a mean (over the 10-dimensions) Concordance Correlation Coefficient (CCC) of 0.5687 CCC is obtained; for A-VB-Two, a mean (over the 2-dimensions) CCC of 0.5084 is obtained; for A-VB-Culture, a mean CCC from the four cultures of 0.4401 is obtained; and for A-VB-Type, the baseline Unweighted Average Recall (UAR) from the 8-classes is 0.4172 UAR.


title: Local approximation for perfect discrimination of quantum states

abstract: Quantum state discrimination involves identifying a given state out of a set of possible states. When the states are mutually orthogonal, perfect state discrimination is always possible using a global measurement. In the case of multipartite systems when the parties are constrained to use multiple rounds of local operations and classical communication (LOCC), perfect state discrimination is often impossible even with the use of \emph{asymptotic LOCC}, wherein an error is allowed but must vanish in the limit of an infinite number of rounds. Utilizing our recent results on asymptotic LOCC, we derive a lower bound on the error probability for LOCC discrimination of any given set of mutually orthogonal pure states. Informed by the insights gained from this lower bound, we are able to prove necessary conditions for perfect state discrimination by asymptotic LOCC. We then illustrate by example the power of these necessary conditions in significantly simplifying the determination of whether perfect discrimination of a given set of states can be accomplished arbitrarily closely using LOCC. The latter examples include a proof that perfect discrimination by asymptotic LOCC is impossible for a certain subset of \emph{minimal} unextendible product bases (UPB), where minimal means that for the given multipartite system, no UPB with a smaller number of states can exist. We also give a simple proof that what has been called \emph{strong nonlocality without entanglement} is considerably stronger than had previously been demonstrated.


title: Demystifying the Adversarial Robustness of Random Transformation Defenses

abstract: Neural networks' lack of robustness against attacks raises concerns in security-sensitive settings such as autonomous vehicles. While many countermeasures may look promising, only a few withstand rigorous evaluation. Defenses using random transformations (RT) have shown impressive results, particularly BaRT (Raff et al., 2019) on ImageNet. However, this type of defense has not been rigorously evaluated, leaving its robustness properties poorly understood. Their stochastic properties make evaluation more challenging and render many proposed attacks on deterministic models inapplicable. First, we show that the BPDA attack (Athalye et al., 2018a) used in BaRT's evaluation is ineffective and likely overestimates its robustness. We then attempt to construct the strongest possible RT defense through the informed selection of transformations and Bayesian optimization for tuning their parameters. Furthermore, we create the strongest possible attack to evaluate our RT defense. Our new attack vastly outperforms the baseline, reducing the accuracy by 83% compared to the 19% reduction by the commonly used EoT attack ($4.3\times$ improvement). Our result indicates that the RT defense on the Imagenette dataset (a ten-class subset of ImageNet) is not robust against adversarial examples. Extending the study further, we use our new attack to adversarially train RT defense (called AdvRT), resulting in a large robustness gain. Code is available at https://github.com/wagner-group/demystify-random-transform.


title: Online Trajectory Prediction for Metropolitan Scale Mobility Digital Twin

abstract: Knowing "what is happening" and "what will happen" of the mobility in a city is the building block of a data-driven smart city system. In recent years, mobility digital twin that makes a virtual replication of human mobility and predicting or simulating the fine-grained movements of the subjects in a virtual space at a metropolitan scale in near real-time has shown its great potential in modern urban intelligent systems. However, few studies have provided practical solutions. The main difficulties are four-folds. 1) The daily variation of human mobility is hard to model and predict; 2) the transportation network enforces a complex constraints on human mobility; 3) generating a rational fine-grained human trajectory is challenging for existing machine learning models; and 4) making a fine-grained prediction incurs high computational costs, which is challenging for an online system. Bearing these difficulties in mind, in this paper we propose a two-stage human mobility predictor that stratifies the coarse and fine-grained level predictions. In the first stage, to encode the daily variation of human mobility at a metropolitan level, we automatically extract citywide mobility trends as crowd contexts and predict long-term and long-distance movements at a coarse level. In the second stage, the coarse predictions are resolved to a fine-grained level via a probabilistic trajectory retrieval method, which offloads most of the heavy computations to the offline phase. We tested our method using a real-world mobile phone GPS dataset in the Kanto area in Japan, and achieved good prediction accuracy and a time efficiency of about 2 min in predicting future 1h movements of about 220K mobile phone users on a single machine to support more higher-level analysis of mobility prediction.


title: Robustness Evaluation of Deep Unsupervised Learning Algorithms for Intrusion Detection Systems

abstract: Recently, advances in deep learning have been observed in various fields, including computer vision, natural language processing, and cybersecurity. Machine learning (ML) has demonstrated its ability as a potential tool for anomaly detection-based intrusion detection systems to build secure computer networks. Increasingly, ML approaches are widely adopted than heuristic approaches for cybersecurity because they learn directly from data. Data is critical for the development of ML systems, and becomes potential targets for attackers. Basically, data poisoning or contamination is one of the most common techniques used to fool ML models through data. This paper evaluates the robustness of six recent deep learning algorithms for intrusion detection on contaminated data. Our experiments suggest that the state-of-the-art algorithms used in this study are sensitive to data contamination and reveal the importance of self-defense against data perturbation when developing novel models, especially for intrusion detection systems.


title: Automatic Synthesis of Neurons for Recurrent Neural Nets

abstract: We present a new class of neurons, ARNs, which give a cross entropy on test data that is up to three times lower than the one achieved by carefully optimized LSTM neurons. The explanations for the huge improvements that often are achieved are elaborate skip connections through time, up to four internal memory states per neuron and a number of novel activation functions including small quadratic forms. The new neurons were generated using automatic programming and are formulated as pure functional programs that easily can be transformed. We present experimental results for eight datasets and found excellent improvements for seven of them, but LSTM remained the best for one dataset. The results are so promising that automatic programming to generate new neurons should become part of the standard operating procedure for any machine learning practitioner who works on time series data such as sensor signals.


title: Code Translation with Compiler Representations

abstract: In this paper, we leverage low-level compiler intermediate representations (IR) to improve code translation. Traditional transpilers rely on syntactic information and handcrafted rules, which limits their applicability and produces unnatural-looking code. Applying neural machine translation (NMT) approaches to code has successfully broadened the set of programs on which one can get a natural-looking translation. However, they treat the code as sequences of text tokens, and still do not differentiate well enough between similar pieces of code which have different semantics in different languages. The consequence is low quality translation, reducing the practicality of NMT, and stressing the need for an approach significantly increasing its accuracy. Here we propose to augment code translation with IRs, specifically LLVM IR, with results on the C++, Java, Rust, and Go languages. Our method improves upon the state of the art for unsupervised code translation, increasing the number of correct translations by 11% on average, and up to 79% for the Java -> Rust pair with greedy decoding. We extend previous test sets for code translation, by adding hundreds of Go and Rust functions. Additionally, we train models with high performance on the problem of IR decompilation, generating programming source code from IR, and study using IRs as intermediary pivot for translation.


title: DGraph: A Large-Scale Financial Dataset for Graph Anomaly Detection

abstract: Graph Anomaly Detection (GAD) has recently become a hot research spot due to its practicability and theoretical value. Since GAD emphasizes the application and the rarity of anomalous samples, enriching the varieties of its datasets is fundamental work. Thus, this paper present DGraph, a real-world dynamic graph in the finance domain. DGraph overcomes many limitations of current GAD datasets. It contains about 3M nodes, 4M dynamic edges, and 1M ground-truth nodes. We provide a comprehensive observation of DGraph, revealing that anomalous nodes and normal nodes generally have different structures, neighbor distribution, and temporal dynamics. Moreover, it suggests that unlabeled nodes are also essential for detecting fraudsters. Furthermore, we conduct extensive experiments on DGraph. Observation and experiments demonstrate that DGraph is propulsive to advance GAD research and enable in-depth exploration of anomalous nodes.


title: Dynamic Community Detection via Adversarial Temporal Graph Representation Learning

abstract: Dynamic community detection has been prospered as a powerful tool for quantifying changes in dynamic brain network connectivity patterns by identifying strongly connected sets of nodes. However, as the network science problems and network data to be processed become gradually more sophisticated, it awaits a better method to efficiently learn low dimensional representation from dynamic network data and reveal its latent function that changes over time in the brain network. In this work, an adversarial temporal graph representation learning (ATGRL) framework is proposed to detect dynamic communities from a small sample of brain network data. It adopts a novel temporal graph attention network as an encoder to capture more efficient spatio-temporal features by attention mechanism in both spatial and temporal dimensions. In addition, the framework employs adversarial training to guide the learning of temporal graph representation and optimize the measurable modularity loss to maximize the modularity of community. Experiments on the real-world brain networks datasets are demonstrated to show the effectiveness of this new method.


title: Gradients of O-information: low-order descriptors of high-order dependencies

abstract: O-information is an information-theoretic metric that captures the overall balance between redundant and synergistic information shared by groups of three or more variables. To complement the global assessment provided by this metric, here we propose the gradients of the O-information as low-order descriptors that can characterise how high-order effects are localised across a system of interest. We illustrate the capabilities of the proposed framework by revealing the role of specific spins in Ising models with frustration, and on practical data analysis on US macroeconomic data. Our theoretical and empirical analyses demonstrate the potential of these gradients to highlight the contribution of variables in forming high-order informational circuits


title: X-haul Outage Compensation in 5G/6G Using Reconfigurable Intelligent Surfaces

abstract: 5G network operators consider the dense deployment of small base-stations (SBSs) to increase network coverage and capacity. Hence, operators face the challenge of X-hauling, i.e., backhauling or fronthauling, their traffic to the core network. Also, SBSs densification will increase the possibility of failure of these X-haul links. To cope with this problem, an X-haul outage compensation scheme with the assistance of Reconfigurable Intelligent Surfaces (RIS) is proposed to mitigate or at least alleviate the effect of X-haul failure. The RIS is a newly adopted technology that is able to improve the performance of wireless networks. In this paper, we present and evaluate an X-haul outage compensation scheme based on placing a number of RIS panels in pre-planned locations to mitigate the effect of X-haul failure. This evaluation is done using frequencies below and beyond 6 GHz. Based on our analytical results, the proposed RIS scheme shows that placing a sufficient number of RIS elements in proximity to the failed SBS under certain conditions can help acquire the same X-haul rate before the occurrence of the failure. Also, we show that for high X-haul spectral density, the RIS-assisted transmission with a certain number of elements can be more energy-efficient than line-of-sight and non-line-of-sight transmissions. Finally, the system's energy efficiency is addressed with and without RIS, and the optimal number of RIS reflecting elements is derived.


title: Design Challenges in High-Current Pulsed Striplines

abstract: The Long Baseline Neutrino Facility (LBNF) will produce the worlds most intense neutrino beam. Three series connected magnetic horns will require 5 kV, 300 kA, 800 $\mu$s pulses at a rate of 1.4 Hz to focus the beam. Connecting a single power supply to these focusing horns will require a low impedance connection measuring over 60 m in length. To meet the challenging requirements of connecting the horns to the power supply, this connection is engineered as a nine-conductor, high-current pulsed stripline. It must pass through a harsh radiation environment, be passively cooled, and have an operational lifetime of at least 30 years. This paper discusses mechanical and electrical considerations such as high-voltage holdoff, clamped joint performance, and Lorentz force mitigations in order to meet the specified requirements. The results of tests and experiments on several prototypes of key design features will be presented and discussed.


title: Generalization Guarantee of Training Graph Convolutional Networks with Graph Topology Sampling

abstract: Graph convolutional networks (GCNs) have recently achieved great empirical success in learning graph-structured data. To address its scalability issue due to the recursive embedding of neighboring features, graph topology sampling has been proposed to reduce the memory and computational cost of training GCNs, and it has achieved comparable test performance to those without topology sampling in many empirical studies. To the best of our knowledge, this paper provides the first theoretical justification of graph topology sampling in training (up to) three-layer GCNs for semi-supervised node classification. We formally characterize some sufficient conditions on graph topology sampling such that GCN training leads to a diminishing generalization error. Moreover, our method tackles the nonconvex interaction of weights across layers, which is under-explored in the existing theoretical analyses of GCNs. This paper characterizes the impact of graph structures and topology sampling on the generalization performance and sample complexity explicitly, and the theoretical findings are also justified through numerical experiments.


title: Eureka!: An End-to-End Pipeline for JWST Time-Series Observations

abstract: $\texttt{Eureka!}$ is a data reduction and analysis pipeline for exoplanet time-series observations, with a particular focus on JWST data. Over the next 1-2 decades, JWST will pursue four main science themes: Early Universe, Galaxies Over Time, Star Lifecycle, and Other Worlds. Our focus is on providing the astronomy community with an open source tool for the reduction and analysis of time-series observations of exoplanets in pursuit of the fourth of these themes, Other Worlds. The goal of $\texttt{Eureka!}$ is to provide an end-to-end pipeline that starts with uncalibrated FITS files and ultimately yields precise exoplanet spectra. The pipeline has a modular structure with six stages, and each stage uses a "Eureka! Control File" (ECF) to allow for easy control of the pipeline's behavior. Stage 5 also uses a "Eureka! Parameter File" (EPF) to control the fitted parameters. We provide template ECFs for the MIRI, NIRCam, NIRISS, and NIRSpec instruments on JWST and the WFC3 instrument on the Hubble Space Telescope (HST). These templates give users a good starting point for their analyses, but $\texttt{Eureka!}$ is not intended to be used as a black box tool, and users should expect to fine-tune some settings for each observation in order to achieve optimal results. At each stage, the pipeline creates intermediate figures and outputs that allow users to compare $\texttt{Eureka!}$'s performance using different parameter settings or to compare $\texttt{Eureka!}$ with an independent pipeline. The ECF used to run each stage is also copied into the output folder from each stage to enhance reproducibility. Finally, while $\texttt{Eureka!}$ has been optimized for exoplanet observations (especially the latter stages of the code), much of the core functionality could also be repurposed for JWST time-series observations in other research domains thanks to $\texttt{Eureka!}$'s modularity.


title: CausalAgents: A Robustness Benchmark for Motion Forecasting using Causal Relationships

abstract: As machine learning models become increasingly prevalent in motion forecasting for autonomous vehicles (AVs), it is critical to ensure that model predictions are safe and reliable. However, exhaustively collecting and labeling the data necessary to fully test the long tail of rare and challenging scenarios is difficult and expensive. In this work, we construct a new benchmark for evaluating and improving model robustness by applying perturbations to existing data. Specifically, we conduct an extensive labeling effort to identify causal agents, or agents whose presence influences human drivers' behavior in any format, in the Waymo Open Motion Dataset (WOMD), and we use these labels to perturb the data by deleting non-causal agents from the scene. We evaluate a diverse set of state-of-the-art deep-learning model architectures on our proposed benchmark and find that all models exhibit large shifts under even non-causal perturbation: we observe a 25-38% relative change in minADE as compared to the original. We also investigate techniques to improve model robustness, including increasing the training dataset size and using targeted data augmentations that randomly drop non-causal agents throughout training. Finally, we release the causal agent labels (at https://github.com/google-research/causal-agents) as an additional attribute to WOMD and the robustness benchmarks to aid the community in building more reliable and safe deep-learning models for motion forecasting.


title: Accurate Hellmann-Feynman forces from density functional calculations with augmented Gaussian basis sets

abstract: The Hellmann-Feynman (HF) theorem provides a way to compute forces directly from the electron density, enabling efficient force calculations for large systems through machine learning (ML) models for the electron density. The main issue holding back the general acceptance of the HF approach for atom-centered basis sets is the well-known Pulay force which, if naively discarded, typically constitutes an error upwards of 10 eV/Ang in forces. In this work, we demonstrate that if a suitably augmented Gaussian basis set is used for density functional calculations, the Pulay force can be suppressed and HF forces can be computed as accurately as analytical forces with state-of-the-art basis sets, allowing geometry optimization and molecular dynamics to be reliably performed with HF forces. Our results pave a clear path forwards for the accurate and efficient simulation of large systems using ML densities and the HF theorem.


title: On the Metric Properties of IR Evaluation Measures Based on Ranking Axioms

abstract: The axiomatic analysis of IR evaluation metrics has contributed to a better understanding of their properties. Some works have modelled the effectiveness of retrieval measures with axioms that capture desirable properties on the set of ranked lists of documents. Recently, it has been shown that three of these axioms lead to some orderings. This work formally explores the metric properties of the set of rankings, endowed with these orderings. Based on lattice theory, the possible metrics and pseudo-metrics, defined on these structures, are determined. It is found that, when the relevant documents are prioritized, precision, recall, RBP and DCG are metrics on the set of rankings, however they are pseudo-metrics when the swapping of documents is considered.


title: Lifestyle Pattern Analysis Unveils Recovery Trajectories of Communities Impacted by Disasters

abstract: The return of normalcy to the population's lifestyle is a critical recovery milestone in the aftermath of disasters, and delayed lifestyle recovery could lead to significant well-being impacts. Lifestyle recovery captures the collective effects of population activities and the restoration of infrastructure and business services. This study uses a novel approach to leverage privacy-enhanced location intelligence data to characterize distinctive lifestyle patterns and to unveil recovery trajectories after a disaster in the context of 2017 Hurricane Harvey in Harris County, Texas. The analysis integrates multiple data sources to record the number of visits from home census block groups (CBGs) to different points of interest during the baseline period and disruptive period. First, primary clustering using k-means characterized four distinct essential and non-essential lifestyle patterns. Then, secondary clustering characterized the impact of the hurricane into three recovery trajectories based on the severity of maximum disruption and duration of recovery. The results reveal multiple recovery trajectories and durations within each lifestyle cluster, which imply differential recovery rates among similar lifestyle and demographic groups. The findings offer a twofold theoretical significance: (1) lifestyle recovery is a critical milestone that needs to be examined, quantified, and monitored in the aftermath of disasters; (2) the spatial structures of cities formed by human mobility and distribution of facilities and extends the spatial reach of flood impacts on population lifestyles. The analysis and findings also provide novel data-driven insights for public official and emergency managers to examine, measure, and monitor a critical milestone in community recovery trajectory based on the return of lifestyles to normalcy.


title: The contact mapping class group and rational unknots in lens spaces

abstract: We determine the contact mapping class group of the standard contact structures on lens spaces. To prove the main result, we use the one-parametric convex surface theory to classify Legendrian and transverse rational unknots in any tight contact structure on lens spaces up to Legendrian and transverse isotopy.


title: Exact Parallel Waves in General Relativity

abstract: We conduct a review of the basic definitions and the principal results in the study of wavelike spacetimes, that is spacetimes whose metric models massless radiation moving at the speed of light, focusing in particular on those geometries with parallel rays. In particular, we motivate and connect their various definitions, outline their coordinate descriptions and present some classical results in their study in a language more accessible to modern readers, including the existence of "null coordinates" and the construction of Penrose limits. We also present a thorough summary of recent work on causality in pp-waves, and describe progress in addressing an open question in the field - the Ehlers-Kundt conjecture.


title: Quote Erat Demonstrandum: A Web Interface for Exploring the Quotebank Corpus

abstract: The use of attributed quotes is the most direct and least filtered pathway of information propagation in news. Consequently, quotes play a central role in the conception, reception, and analysis of news stories. Since quotes provide a more direct window into a speaker's mind than regular reporting, they are a valuable resource for journalists and researchers alike. While substantial research efforts have been devoted to methods for the automated extraction of quotes from news and their attribution to speakers, few comprehensive corpora of attributed quotes from contemporary sources are available to the public. Here, we present an adaptive web interface for searching Quotebank, a massive collection of quotes from the news, which we make available at https://quotebank.dlab.tools.


title: Hyper-Universal Policy Approximation: Learning to Generate Actions from a Single Image using Hypernets

abstract: Inspired by Gibson's notion of object affordances in human vision, we ask the question: how can an agent learn to predict an entire action policy for a novel object or environment given only a single glimpse? To tackle this problem, we introduce the concept of Universal Policy Functions (UPFs) which are state-to-action mappings that generalize not only to new goals but most importantly to novel, unseen environments. Specifically, we consider the problem of efficiently learning such policies for agents with limited computational and communication capacity, constraints that are frequently encountered in edge devices. We propose the Hyper-Universal Policy Approximator (HUPA), a hypernetwork-based model to generate small task- and environment-conditional policy networks from a single image, with good generalization properties. Our results show that HUPAs significantly outperform an embedding-based alternative for generated policies that are size-constrained. Although this work is restricted to a simple map-based navigation task, future work includes applying the principles behind HUPAs to learning more general affordances for objects and environments.


title: Counting rotational subsets of the circle $\mathbb{R}/\mathbb{Z}$ under the angle multiplying map $t\mapsto dt$

abstract: A rotational set is a finite subset $A$ of the unit circle $\mathbb{T}=\mathbb{R}/ \mathbb{Z}$ such that the angle-multiplying map $\sigma_{d}:t\mapsto dt$ maps $A$ onto itself by a cyclic permutation of its elements. Each rotational set has a geometric rotation number $p/q$. These sets were introduced by Lisa Goldberg to study the dynamics of complex polynomial maps. In this paper we provide a necessary and sufficient condition for a set to be $\sigma_{d}$-rotational with rotation number $p/q$. As applications of our condition, we recover two classical results and enumerate $\sigma_d$-rotational sets with rotation number $p/q$ that consist of a given number of orbits.


title: On the asymmetric additive energy of polynomials

abstract: We prove a general result concerning the paucity of integer points on a certain family of 4-dimensional affine hypersurfaces. As a consequence, we deduce that integer-valued polynomials have small asymmetric additive energy.


title: Verification of a real-time ensemble-based method for updating earth model based on GAN

abstract: The complexity of geomodelling workflows is a limiting factor for quantifying and updating uncertainty in real-time during drilling. We propose Generative Adversarial Networks (GANs) for parametrization and generation of geomodels, combined with Ensemble Randomized Maximum Likelihood (EnRML) for rapid updating of subsurface uncertainty. This real-time ensemble method combined with a highly non-linear model arising from neural-network modeling sequences might produce inaccurate and/or biased posterior solutions. This paper illustrates the predictive ability of EnRML on several examples where we assimilate local extra-deep electromagnetic logs. Statistical verification with MCMC confirms that the proposed workflow can produce reliable results required for geosteering wells.


title: Nonparametric Estimation of the Potential Impact Fraction and Population Attributable Fraction with Individual-Level and Aggregated Data

abstract: The estimation of the potential impact fraction (including the population attributable fraction) with continuous exposure data frequently relies on strong distributional assumptions. However, these assumptions are often violated if the underlying exposure distribution is unknown or if the same distribution is assumed across time or space. Nonparametric methods to estimate the potential impact fraction are available for cohort data, but no alternatives exist for cross-sectional data. In this article, we discuss the impact of distributional assumptions in the estimation of the population impact fraction, showing that under an infinite set of possibilities, distributional violations lead to biased estimates. We propose nonparametric methods to estimate the potential impact fraction for aggregated (mean and standard deviation) or individual data (e.g. observations from a cross-sectional population survey), and develop simulation scenarios to compare their performance against standard parametric procedures. We illustrate our methodology on an application of sugar-sweetened beverage consumption on incidence of type 2 diabetes. We also present an R package pifpaf to implement these methods.


title: Assessing theoretical uncertainties for cosmological constraints from weak lensing surveys

abstract: $ $Weak gravitational lensing is a powerful probe which is used to constrain the standard cosmological model and its extensions. With the enhanced statistical precision of current and upcoming surveys, high accuracy predictions for weak lensing statistics are needed to limit the impact of theoretical uncertainties on cosmological parameter constraints. For this purpose, we present a comparison of the theoretical predictions for the nonlinear matter and weak lensing power spectra, based on the widely used fitting functions ($\texttt{mead}$ and $\texttt{rev-halofit}$), emulators ($\texttt{EuclidEmulator}$, $\texttt{EuclidEmulator2}$, $\texttt{BaccoEmulator}$ and $\texttt{CosmicEmulator}$) and N-body simulations ($\texttt{Pkdgrav3}$). We consider the forecasted constraints on the $\Lambda \texttt{CDM}$ and $\texttt{wCDM}$ models from weak lensing for stage III and stage IV surveys. We study the relative bias on the constraints and their dependence on the assumed prescriptions. Assuming a $\Lambda \texttt{CDM}$ cosmology, we find that the relative agreement on the $S_8$ parameter is between $0.2-0.3\sigma$ for a stage III-like survey between the above predictors. For a stage IV-like survey the agreement becomes $1.4-3.0\sigma$. In the $\texttt{wCDM}$ scenario, we find broader $S_8$ constraints, and agreements of $0.18-0.26\sigma$ and $0.7-1.7\sigma$ for stage III and stage IV surveys, respectively. The accuracies of the above predictors therefore appear adequate for stage III surveys, while the fitting functions would need improvements for future stage IV weak lensing surveys. Furthermore, we find that, of the fitting functions, $\texttt{mead}$ provides the best agreement with the emulators. We discuss the implication of these findings for the preparation of the future weak lensing surveys.


title: Quantum chemical roots of machine-learning molecular similarity descriptors

abstract: In this work, we explore the quantum chemical foundations of descriptors for molecular similarity. Such descriptors are key for traversing chemical compound space with machine learning. Our focus is on the Coulomb matrix and on the smooth overlap of atomic positions (SOAP). We adopt a basic framework that allows us to connect both descriptors to electronic structure theory. This framework enables us then to define two new descriptors that are more closely related to electronic structure theory, which we call Coulomb lists and smooth overlap of electron densities (SOED). By investigating their usefulness as molecular similarity descriptors, we gain new insights in how and why Coulomb matrix and SOAP work. Moreover, Coulomb lists avoid the somewhat mysterious diagonalization step of the Coulomb matrix and might provide a direct means to extract subsystem information that can be compared across Born-Oppenheimer surfaces of varying dimension. For the electron density we derive the necessary formalism to create the SOED measure in close analogy to SOAP. Since this formalism is more involved than that of SOAP, we review the essential theory, but also introduce a set of approximations that eventually allow us to work with SOED in terms of the same implementation available for the evaluation of SOAP. We focus our analysis on elementary reaction steps, where transition state structures are more similar to either reactant or product structures than the latter two are with respect to one another. The prediction of electronic energies of transition state structures can, however, be more difficult than that of stable intermediates due to multi-configurational effects. The question arises to what extent molecular similarity descriptors rooted in electronic structure theory can resolve these intricate effects.


title: Individual Preference Stability for Clustering

abstract: In this paper, we propose a natural notion of individual preference (IP) stability for clustering, which asks that every data point, on average, is closer to the points in its own cluster than to the points in any other cluster. Our notion can be motivated from several perspectives, including game theory and algorithmic fairness. We study several questions related to our proposed notion. We first show that deciding whether a given data set allows for an IP-stable clustering in general is NP-hard. As a result, we explore the design of efficient algorithms for finding IP-stable clusterings in some restricted metric spaces. We present a polytime algorithm to find a clustering satisfying exact IP-stability on the real line, and an efficient algorithm to find an IP-stable 2-clustering for a tree metric. We also consider relaxing the stability constraint, i.e., every data point should not be too far from its own cluster compared to any other cluster. For this case, we provide polytime algorithms with different guarantees. We evaluate some of our algorithms and several standard clustering approaches on real data sets.


title: Investigations on the multi-sector hard X-Band Structures

abstract: The development of high gradient accelerating structures is one of the leading activities of the accelerator community. In the technological research of new construction methods for these devices, high-power testing is a critical step for the verification of their viability. Recent experiments showed that accelerating cavities made from hard copper alloys, can achieve better performance as compared with soft copper ones. The results of experiments showed that welded, hard copper cavities have shown breakdown rate of $10^{-3}$/pulse/meter at a gradient of about 150 MV/m, in the X-band, a using a shaped pulse with a 150 ns flat part. We continue the design, construction, and higher power experimental tests of three cells standing wave (SW) 11.424 GHz accelerating cavities fabricated with hard CuAg alloy to study the RF breakdown physics. Our aim is to fabricate the accelerating structures with innovative technologies easier to handle and cheaper; easier for surfaces inspection; easier for data elaboration and validation of joining techniques. The choice of these new technological approaches and design methods provides also the possibility of allocating the parasitic Higher Order Mode dampers. This paper describes the design of an optimized cavity made with sectors which provides a high longitudinal shunt impedance $R_{sh}$ of the operating mode. The cavity will be fabricated by using the Tungsten Inert Gas process to realize a hard CuAg structure. Two three-cells SW X-band accelerating cavities, to be operated in the $\pi$-mode and made out of hard CuAg alloy, were already fabricated at INFN-LNF by means of clamping and welding by using the TIG approach. Finally, we also report the RF characterization and low-power RF tests of a two-halves split hard CuAg structure that will be consequently TIG welded and employed for high-gradient tests and for the study of the RF breakdown physics.


title: Rhythm and form in music: a complex systems approach

abstract: There has been an everlasting discussion around the concept of form in music. This work is motivated by such debate by using a complex systems framework in which we study the form as an emergent property of rhythm. Such a framework corresponds with the traditional notion of musical form and allows us to generalize this concept to more general shapes and structures in music. We develop the three following metrics of the rhythmic complexity of a musical piece and its parts: 1) the rhythmic heterogeneity, based on the permutation entropy, where high values indicate a wide variety of rhythmic patterns; 2) the syncopation, based on the distribution of on-beat onsets, where high values indicate a high proportion of off-the-beat notes; and 3) the component extractor, based on the communities of a visibility graph of the rhythmic figures over time, where we identify structural components that constitute the piece at a (to be explained) perceptual level. With the same parameters, our metrics are comparable within a piece or between pieces.


title: Anthropomorphic Twisted String-Actuated Soft Robotic Gripper with Tendon-Based Stiffening

abstract: Realizing high-performance soft robotic grippers is challenging because of the inherent limitations of the soft actuators and artificial muscles that drive them, including low force output, small actuation range, and poor compactness. Despite advances in this area, realizing compact soft grippers with high dexterity and force output is still challenging. This paper explores twisted string actuators (TSAs) to drive a soft robotic gripper. TSAs have been used in numerous robotic applications, but their inclusion in soft robots has been limited. The proposed design of the gripper was inspired by the human hand. Tunable stiffness was implemented in the fingers with antagonistic TSAs. The fingers' bending angles, actuation speed, blocked force output, and stiffness tuning were experimentally characterized. The gripper achieved a score of 6 on the Kapandji test and recreated 31 of the 33 grasps of the Feix GRASP taxonomy. It exhibited a maximum grasping force of 72 N, which was almost 13 times its own weight. A comparison study revealed that the proposed gripper exhibited equivalent or superior performance compared to other similar soft grippers.


title: Remarks on Hyperspaces for Priestley Spaces

abstract: The Vietoris space of a Stone space plays an important role in the coalgebraic approach to modal logic. When generalizing this to positive modal logic, there is a variety of relevant hyperspace constructions based on various topologies on a Priestley space and mechanisms to topologize the hyperspace of closed sets. A number of authors considered hyperspaces of Priestley spaces and their application to the coalgebraic approach to positive modal logic. A mixture of techniques from category theory, pointfree topology, and Priestley duality have been employed. Our aim is to provide a unifying approach to this area of research relying only on a basic familiarity with Priestley duality and related free constructions of distributive lattices.


title: Learning-based Autonomous Channel Access in the Presence of Hidden Terminals

abstract: We consider the problem of autonomous channel access (AutoCA), where a group of terminals tries to discover a communication strategy with an access point (AP) via a common wireless channel in a distributed fashion. Due to the irregular topology and the limited communication range of terminals, a practical challenge for AutoCA is the hidden terminal problem, which is notorious in wireless networks for deteriorating the throughput and delay performances. To meet the challenge, this paper presents a new multi-agent deep reinforcement learning paradigm, dubbed MADRL-HT, tailored for AutoCA in the presence of hidden terminals. MADRL-HT exploits topological insights and transforms the observation space of each terminal into a scalable form independent of the number of terminals. To compensate for the partial observability, we put forth a look-back mechanism such that the terminals can infer behaviors of their hidden terminals from the carrier sensed channel states as well as feedback from the AP. A window-based global reward function is proposed, whereby the terminals are instructed to maximize the system throughput while balancing the terminals' transmission opportunities over the course of learning. Extensive numerical experiments verified the superior performance of our solution benchmarked against the legacy carrier-sense multiple access with collision avoidance (CSMA/CA) protocol.


title: One-Loop Corrections to Dihadron Production in DIS at Small $x$

abstract: We calculate the one-loop corrections to dihadron production in Deep Inelastic Scattering (DIS) at small x using the Color Glass Condensate formalism. We show that all UV and soft singularities cancel while the collinear divergences are absorbed into quark and anti quark-hadron fragmentation functions. Rapidity divergences lead to JIMWLK evolution of dipoles and quadrupoles describing multiple-scatterings of the quark anti-quark dipole on the target proton/nucleus. The resulting cross section is finite and can be used for phenomenological studies of dihadron angular correlations at small x in a future Electron-Ion Collider (EIC).


title: Absolute Flux Calibrations for the Nancy Grace Roman Space Telescope Coronagraph Instrument

abstract: The Nancy Grace Roman Space Telescope's (Roman) Coronagraph Instrument is a technology demonstration equipped to achieve flux contrast levels of up to 10$^{-9}$. This precision depends upon the quality of observations and their resultant on-sky corrections via an absolute flux calibration (AFC). Our plan utilizes 10 dim and 4 bright standard photometric calibrator stars from Hubble Space Telescope's (HST) CALSPEC catalog to yield a final AFC error of 1.94\% and total observation time of $\sim$22 minutes. Percent error accounts for systematic uncertainties (filters, upstream optics, quantum efficiency) in Roman component instrumentation along with shot noise for a signal to noise ratio (SNR) of 500.


title: GaitTAKE: Gait Recognition by Temporal Attention and Keypoint-guided Embedding

abstract: Gait recognition, which refers to the recognition or identification of a person based on their body shape and walking styles, derived from video data captured from a distance, is widely used in crime prevention, forensic identification, and social security. However, to the best of our knowledge, most of the existing methods use appearance, posture and temporal feautures without considering a learned temporal attention mechanism for global and local information fusion. In this paper, we propose a novel gait recognition framework, called Temporal Attention and Keypoint-guided Embedding (GaitTAKE), which effectively fuses temporal-attention-based global and local appearance feature and temporal aggregated human pose feature. Experimental results show that our proposed method achieves a new SOTA in gait recognition with rank-1 accuracy of 98.0% (normal), 97.5% (bag) and 92.2% (coat) on the CASIA-B gait dataset; 90.4% accuracy on the OU-MVLP gait dataset.


title: One for All: Simultaneous Metric and Preference Learning over Multiple Users

abstract: This paper investigates simultaneous preference and metric learning from a crowd of respondents. A set of items represented by $d$-dimensional feature vectors and paired comparisons of the form ``item $i$ is preferable to item $j$'' made by each user is given. Our model jointly learns a distance metric that characterizes the crowd's general measure of item similarities along with a latent ideal point for each user reflecting their individual preferences. This model has the flexibility to capture individual preferences, while enjoying a metric learning sample cost that is amortized over the crowd. We first study this problem in a noiseless, continuous response setting (i.e., responses equal to differences of item distances) to understand the fundamental limits of learning. Next, we establish prediction error guarantees for noisy, binary measurements such as may be collected from human respondents, and show how the sample complexity improves when the underlying metric is low-rank. Finally, we establish recovery guarantees under assumptions on the response distribution. We demonstrate the performance of our model on both simulated data and on a dataset of color preference judgements across a large number of users.


title: Optimal stopping of the stable process with state-dependent killing

abstract: We describe the solution of an optimal stopping problem for a stable L\'evy process killed at state-dependent rate, which can be seen as a model for bankruptcy. The killing rate is chosen in such a way that the killed process remains self-similar, and the solution to the optimal stopping problem is obtained by characterising a self-similar Markov process associated with the stable process. The optimal stopping strategy is to stop upon first passage into an interval, found explicitly in terms of the parameters of the model.


title: Production Assessment using a Knowledge Transfer Framework and Evidence Theory

abstract: Operational knowledge is one of the most valuable assets in a company, as it provides a strategic advantage over competitors and ensures steady and optimal operation in machines. An (interactive) assessment system on the shop floor can optimize the process and reduce stopovers because it can provide constant valuable information regarding the machine condition to the operators. However, formalizing operational (tacit) knowledge to explicit knowledge is not an easy task. This transformation considers modeling expert knowledge, quantification of knowledge uncertainty, and validation of the acquired knowledge. This study proposes a novel approach for production assessment using a knowledge transfer framework and evidence theory to address the aforementioned challenges. The main contribution of this paper is a methodology for the formalization of tacit knowledge based on an extended failure mode and effect analysis for knowledge extraction, as well as the use of evidence theory for the uncertainty definition of knowledge. Moreover, this approach uses primitive recursive functions for knowledge modeling and proposes a validation strategy of the knowledge using machine data. These elements are integrated into an interactive recommendation system hosted on a backend that uses HoloLens as a visual interface. We demonstrate this approach using an industrial setup: a laboratory bulk good system. The results yield interesting insights, including the knowledge validation, uncertainty behavior of knowledge, and interactive troubleshooting for the machine operator.


title: Trajectory Class Fluctuation Theorem

abstract: The Trajectory Class Fluctuation Theorem (TCFT) substantially strengthens the Second Law of Thermodynamics -- that, in point of fact, can be a rather weak bound on resource fluxes. Practically, it improves empirical estimates of free energies, a task known to be statistically challenging, and has diagnosed successful and failed information processing in experimentally-implemented Josephson-junction information engines. The development here justifies that empirical analysis, explicating its mathematical foundations. The TCFT reveals the thermodynamics induced by macroscopic system transformations for each measurable subset of system trajectories. In this, it directly combats the statistical challenge of extremely rare events that dominate thermodynamic calculations. And, it reveals new forms of free energy -- forms that can be solved for analytically and practically estimated. Conceptually, the TCFT unifies a host of previously-established fluctuation theorems, interpolating from Crooks' Detailed Fluctuation Theorem (single trajectories) to Jarzynski's Equality (trajectory ensembles).


title: On the growth of the Floer barcode

abstract: This paper is a follow up to the authors' recent work on barcode entropy. We study the growth of the barcode of the Floer complex for the iterates of a compactly supported Hamiltonian diffeomorphism. In particular, we introduce sequential barcode entropy which has properties similar to barcode entropy, bounds it from above and is more sensitive to the barcode growth. We prove that in dimension two the sequential barcode entropy equals the topological entropy and hence equals the ordinary barcode entropy. We also study the behavior of the $\gamma$-norm under iterations. We show that the $\gamma$-norm of the iterates is separated from zero when the map has sufficiently many hyperbolic periodic points and, as a consequence, it is separated from zero $C^\infty$-generically in dimension two. We also touch upon properties of the barcode entropy of pseudo-rotations and, more generally, $\gamma$-almost periodic maps.


title: Approximate Carath\'eodory bounds via Discrepancy Theory

abstract: The approximate Carath\'eodory problem in general form is as follows: Given two symmetric convex bodies $P,Q \subseteq \mathbb{R}^m$, a parameter $k \in \mathbb{N}$ and $\mathbf{z} \in \textrm{conv}(X)$ with $X \subseteq P$, find $\mathbf{v}_1,\ldots,\mathbf{v}_k \in X$ so that $\|\mathbf{z} - \frac{1}{k}\sum_{i=1}^k \mathbf{v}_i\|_Q$ is minimized. Maurey showed that if both $P$ and $Q$ coincide with the $\| \cdot \|_p$-ball, then an error of $O(\sqrt{p/k})$ is possible. We prove a reduction to the vector balancing constant from discrepancy theory which for most cases can provide tight bounds for general $P$ and $Q$. For the case where $P$ and $Q$ are both $\| \cdot \|_p$-balls we prove an upper bound of $\sqrt{ \frac{\min\{ p, \log (\frac{2m}{k}) \}}{k}}$. Interestingly, this bound cannot be obtained taking independent random samples; instead we use the Lovett-Meka random walk. We also prove an extension to the more general case where $P$ and $Q$ are $\|\cdot \|_p$ and $\| \cdot \|_q$-balls with $2 \leq p \leq q \leq \infty$.


title: Learning and generalization of one-hidden-layer neural networks, going beyond standard Gaussian data

abstract: This paper analyzes the convergence and generalization of training a one-hidden-layer neural network when the input features follow the Gaussian mixture model consisting of a finite number of Gaussian distributions. Assuming the labels are generated from a teacher model with an unknown ground truth weight, the learning problem is to estimate the underlying teacher model by minimizing a non-convex risk function over a student neural network. With a finite number of training samples, referred to the sample complexity, the iterations are proved to converge linearly to a critical point with guaranteed generalization error. In addition, for the first time, this paper characterizes the impact of the input distributions on the sample complexity and the learning rate.


title: ScrollyVis: Interactive visual authoring of guided dynamic narratives for scientific scrollytelling

abstract: Visual stories are an effective and powerful tool to convey specific information to a diverse public. Scrollytelling is a recent visual storytelling technique extensively used on the web, where content appears or changes as users scroll up or down a page. By employing the familiar gesture of scrolling as its primary interaction mechanism, it provides users with a sense of control, exploration and discoverability while still offering a simple and intuitive interface. In this paper, we present a novel approach for authoring, editing, and presenting data-driven scientific narratives using scrollytelling. Our method flexibly integrates common sources such as images, text, and video, but also supports more specialized visualization techniques such as interactive maps as well as scalar field and mesh data visualizations. We show that scrolling navigation can be used to traverse dynamic narratives and demonstrate how it can be combined with interactive parameter exploration. The resulting system consists of an extensible web-based authoring tool capable of exporting stand-alone stories that can be hosted on any web server. We demonstrate the power and utility of our approach with case studies from several of diverse scientific fields and with a user study including 12 participants of diverse professional backgrounds. Furthermore, an expert in creating interactive articles assessed the usefulness of our approach and the quality of the created stories.


title: Transferability of Zr-Zr interatomic potentials

abstract: Tens of Zr inter-atomic potentials (force fields) have been developed to enable atomic-scale simulations of Zr alloys. These can provide critical insight in the in-reactor behaviour of nuclear fuel cladding and structural components exposed, but the results are strongly sensitive to the choice of potential. We provide a comprehensive comparison of 13 popular Zr potentials, and assess their ability to reproduce key physical, mechanical, structural and thermodynamic properties of Zr. We assess the lattice parameters, thermal expansion, melting point, volume-energy response, allotropic phase stability, elastic properties, and point defect energies, and compare them to experimental and ab-initio values. No potential was found to outperform all others on all aspects, but for every metric considered here, at least one potential was found to provide reliable results. Older embedded-atom method (EAM) potentials tend to excel in 2-3 metrics each, but at the cost of poorer transferability. The two highest-performing potentials overall, with complementary strengths and weaknesses, were the 2021 angular-dependent potential of Smirnova and Starikov (Comp. Mater. Sci. 197, 110581) and the 2019 embedded-atom method potential of Wimmer et al (J. Nucl. Mater. 532, 152055). All potentials trained through machine learning algorithms proved to have lower overall accuracy, and less transferability, than simpler and computationally faster potentials available. Point defect structures and energies is where the greatest divergence and least accuracy is observed. We created maps that will help modellers select the most suitable potential for a specific application, and which may help identify areas of improvement in future potentials.


title: PoseGU: 3D Human Pose Estimation with Novel Human Pose Generator and Unbiased Learning

abstract: 3D pose estimation has recently gained substantial interests in computer vision domain. Existing 3D pose estimation methods have a strong reliance on large size well-annotated 3D pose datasets, and they suffer poor model generalization on unseen poses due to limited diversity of 3D poses in training sets. In this work, we propose PoseGU, a novel human pose generator that generates diverse poses with access only to a small size of seed samples, while equipping the Counterfactual Risk Minimization to pursue an unbiased evaluation objective. Extensive experiments demonstrate PoseGU outforms almost all the state-of-the-art 3D human pose methods under consideration over three popular benchmark datasets. Empirical analysis also proves PoseGU generates 3D poses with improved data diversity and better generalization ability.


title: Constructions and restrictions for balanced splittable Hadamard matrices

abstract: A Hadamard matrix is balanced splittable if some subset of its rows has the property that the dot product of every two distinct columns takes at most two values. This definition was introduced by Kharaghani and Suda in 2019, although equivalent formulations have been previously studied using different terminology. We collate previous results phrased in terms of balanced splittable Hadamard matrices, real flat equiangular tight frames, spherical two-distance sets, and two-distance tight frames. We use combinatorial analysis to restrict the parameters of a balanced splittable Hadamard matrix to lie in one of several classes, and obtain strong new constraints on their mutual relationships. An important consideration in determining these classes is whether the strongly regular graph associated with the balanced splittable Hadamard matrix is primitive or imprimitive. We construct new infinite families of balanced splittable Hadamard matrices in both the primitive and imprimitive cases. A rich source of examples is provided by packings of partial difference sets in elementary abelian 2-groups, from which we construct Hadamard matrices admitting a row decomposition so that the balanced splittable property holds simultaneously with respect to every union of the submatrices of the decomposition.


title: More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsity

abstract: Transformers have quickly shined in the computer vision world since the emergence of Vision Transformers (ViTs). The dominant role of convolutional neural networks (CNNs) seems to be challenged by increasingly effective transformer-based models. Very recently, a couple of advanced convolutional models strike back with large kernels motivated by the local-window attention mechanism, showing appealing performance and efficiency. While one of them, i.e. RepLKNet, impressively manages to scale the kernel size to 31x31 with improved performance, the performance starts to saturate as the kernel size continues growing, compared to the scaling trend of advanced ViTs such as Swin Transformer. In this paper, we explore the possibility of training extreme convolutions larger than 31x31 and test whether the performance gap can be eliminated by strategically enlarging convolutions. This study ends up with a recipe for applying extremely large kernels from the perspective of sparsity, which can smoothly scale up kernels to 61x61 with better performance. Built on this recipe, we propose Sparse Large Kernel Network (SLaK), a pure CNN architecture equipped with sparse factorized 51x51 kernels that can perform on par with or better than state-of-the-art hierarchical Transformers and modern ConvNet architectures like ConvNeXt and RepLKNet, on ImageNet classification as well as a wide range of downstream tasks including semantic segmentation on ADE20K, object detection on PASCAL VOC 2007, and object detection/segmentation on MS COCO.


title: CALET Search for electromagnetic counterparts of gravitational waves during the LIGO/Virgo O3 run

abstract: The CALorimetric Electron Telescope (CALET) on the International Space Station (ISS) consists of a high-energy cosmic ray CALorimeter (CAL) and a lower-energy CALET Gamma ray Burst Monitor (CGBM). CAL is sensitive to electrons up to 20 TeV, cosmic ray nuclei from Z = 1 through Z $\sim$ 40, and gamma rays over the range 1 GeV - 10 TeV. CGBM observes gamma rays from 7 keV to 20 MeV. The combined CAL-CGBM instrument has conducted a search for gamma ray bursts (GRBs) since Oct. 2015. We report here on the results of a search for X-ray/gamma ray counterparts to gravitational wave events reported during the LIGO/Virgo observing run O3. No events have been detected that pass all acceptance criteria. We describe the components, performance, and triggering algorithms of the CGBM - the two Hard X-ray Monitors (HXM) consisting of LaBr$_{3}$(Ce) scintillators sensitive to 7 keV to 1 MeV gamma rays and a Soft Gamma ray Monitor (SGM) BGO scintillator sensitive to 40 keV to 20 MeV - and the high-energy CAL consisting of a CHarge-Detection module (CHD), IMaging Calorimeter (IMC), and fully active Total Absorption Calorimeter (TASC). The analysis procedure is described and upper limits to the time-averaged fluxes are presented.


title: Mobile-IRS Assisted Next Generation UAV Communication Networks

abstract: Prior research on intelligent reflection surface (IRS)-assisted unmanned aerial vehicle (UAV) communications has focused on a fixed location for the IRS or mounted on a UAV. The assumption that the IRS is located at a fixed position will prohibit mobile users from maximizing many wireless network benefits, such as data rate and coverage. Furthermore, assuming that the IRS is placed on a UAV is impractical for various reasons, including the IRS's weight and size and the speed of wind in severe weather. Unlike previous studies, this study assumes a single UAV and an IRS mounted on a mobile ground vehicle (M-IRS) to be deployed in an Internet-of-Things (IoT) 6G wireless network to maximize the average data rate. Such a methodology for providing wireless coverage using an M-IRS assisted UAV system is expected in smart cities. In this paper, we formulate an optimization problem to find an efficient trajectory for the UAV, an efficient path for the M-IRS, and users' power allocation coefficients that maximize the average data rate for mobile ground users. Due to its intractability, we propose efficient techniques that can help in finding the solution to the optimization problem. First, we show that our dynamic power allocation technique outperforms the fixed power allocation technique in terms of network average sum rate. Then we employ the individual movement model (Random Waypoint Model) in order to represent the users' movements inside the coverage area. Finally, we propose an efficient approach using a Genetic Algorithm (GA) for finding an efficient trajectory for the UAV, and an efficient path for the M-IRS to provide wireless connectivity for mobile users during their movement. We demonstrate through simulations that our methodology can enhance the average data rate by 15\% on average compared with the static IRS and by 25\% on average compared without the IRS system.


title: Euler dynamic H-trails in edge-colored graphs

abstract: Alternating Euler trails has been extensively studied for its diverse applications, for example, in genetic and molecular biology, social science and channel assignment in wireless networks, as well as for theoretical reasons. We will consider the following edge-coloring. Let $H$ be a graph possibly with loops and $G$ a graph without loops. An $H$-coloring of $G$ is a function $c: E(G) \rightarrow V(H)$. We will say that $G$ is an $H$-colored graph whenever we are taking a fixed $H$-coloring of $G$. A sequence $W=(v_0,e_0^1, \ldots, e_0^{k_0},v_1,e_1^1,\ldots,e_{n-1}^{k_{n-1}},v_n)$ in $G$, where for each $i \in \{0,\ldots, n-1\}$, $k_i \geq 1$ and $e_i^j = v_iv_{i+1}$ is an edge in $G$, for every $j \in \{1,\ldots, k_i \}$, is a dynamic $H$-trail if $W$ does not repeat edges and $c(e_i^{k_i})c(e_{i+1}^1)$ is an edge in $H$, for each $i \in \{0,\ldots,n-2\}$. In particular a dynamic $H$-trail is an alternating Euler trail when $H$ is a complete graph without loops and $k_i=1$, for every $i \in \{1,\ldots,n-1\}$. In this paper, we introduce the concept of dynamic $H$-trail, which arises in a natural way in the modeling of many practical problems, in particular, in theoretical computer science. We provide necessary and sufficient conditions for the existence of closed Euler dynamic $H$-trail in $H$-colored multigraphs. Also we provide polynomial time algorithms that allows us to convert a cycle in an auxiliary graph, $L_2^H(G)$, in a closed dynamic H-trail in $G$, and vice versa, where $L_2^H(G)$ is a non-colored simple graph obtained from $G$ in a polynomial time.


title: Quantum Entanglement in String Theory

abstract: We define entanglement entropy in string perturbation theory using the orbifold method -- a stringy analog of the replica method in field theory. To this end, we use the Newton series to analytically continue in $N$ the partition functions for string orbifolds on $\mathbb{C}/\mathbb{Z}_N$ conical spaces, known for all odd integer $N$. In the concrete example of ten-dimensional Type-IIB strings, the one-loop partition function can be computed explicitly and the one-loop entropy can be expressed as a manifestly modular invariant series in terms of the Weierstrass $\wp$ function. The convergence of the series is not evident but, from physical arguments based on holography, it is expected to yield a finite answer together with the tree level contribution. This method has a natural generalization to other string compactifications and to higher genus Riemann surfaces; it can provide a modular invariant definition of generalized entropy in a given string vacuum to all orders, of potential interest for the generalized second law of thermodynamics.


title: Coarse particulate matter air quality in East Asia: implications for fine particulate nitrate

abstract: Coarse particulate matter (PM) is a serious air pollution problem in East Asia. Analysis of air quality network observations in the North China Plain and the Seoul Metropolitan Area shows that it is mainly anthropogenic and has decreased by 21% over 2015-2019. This anthropogenic coarse PM is generally not included in air quality models but scavenges nitric acid to suppress the formation of fine particulate (PM2.5) nitrate, a major contributor to PM2.5 pollution. Including it in the GEOS-Chem model decreases simulated PM2.5 nitrate to improve agreement with observations. Decreasing anthropogenic coarse PM over 2015-2019 directly increases PM2.5 nitrate in summer, offsetting the effect of other emission controls, while in winter it increases the sensitivity of PM2.5 nitrate to ammonia and sulfur dioxide emissions. Our work implies the need for stronger ammonia and nitrogen oxides emission controls to improve PM2.5 air quality as coarse PM continues to decrease.


title: On strong solutions of time inhomogeneous It\^o's equations with "supercritical" diffusion and drift

abstract: We prove strong existence and uniqueness of solutions of It\^o's stochastic time dependent equations with irregular diffusion and drift terms of Morrey class type. In a sense we are treating a "supercritical" case.


title: Expansion of random $0/1$ polytopes

abstract: A conjecture of Mihail and Vazirani states that the edge expansion of the graph of every $0/1$ polytope is at least one. Any lower bound on the edge expansion gives an upper bound for the mixing time of a random walk on the graph of the polytope. Such random walks are important because they can be used to generate an element from a set of combinatorial objects uniformly at random. A weaker form of the conjecture of Mihail and Vazirani says that the edge expansion of the graph of a $0/1$ polytope in $\mathbb{R}^d$ is greater than 1 over some polynomial function of $d$. This weaker version of the conjecture would suffice for all applications. Our main result is that the edge expansion of the graph of a $\textit{random}$ $0/1$ polytope in $\mathbb{R}^d$ is at least $\frac{1}{12d}$ with high probability.


title: An AGN with an ionized gas outflow in a massive quiescent galaxy in a protocluster at $\bf z=3.09$

abstract: We report the detection of an ionized gas outflow from an $X$-ray active galactic nucleus (AGN) hosted in a massive quiescent galaxy in a protocluster at $z=3.09$ (J221737.29+001823.4). It is a type-2 QSO with broad ($W_{80}>1000$ km s$^{-1}$) and strong ($\log (L_{\rm [OIII]}$ / erg s$^{-1})\approx43.4$) [O {\footnotesize III}]$\lambda\lambda$4959,5007 emission lines detected by slit spectroscopy in three-position angles using Multi-Object Infra-Red Camera and Spectrograph (MOIRCS) on the Subaru telescope and the Multi-Object Spectrometer For Infra-Red Exploration (MOSFIRE) on the Keck-I telescope. In the all slit directions, [O {\footnotesize III}] emission is extended to $\sim15$ physical kpc and indicates a powerful outflow spreading over the host galaxy. The inferred ionized gas mass outflow rate is $\rm 22\pm3~M_{\odot}~yr^{-1}$. Although it is a radio source, according to the line diagnostics using H$\beta$, [O {\footnotesize II}], and [O {\footnotesize III}], photoionization by the central QSO is likely the dominant ionization mechanism rather than shocks caused by radio jets. On the other hand, the spectral energy distribution of the host galaxy is well characterized as a quiescent galaxy that has shut down star formation by several hundred Myr ago. Our results suggest a scenario that QSOs are powered after the shut-down of the star formation and help to complete the quenching of massive quiescent galaxies at high redshift.


title: Chain recurrence rates and topological entropy for free semigroup actions

abstract: Misiurewicz[19]introducedtheconceptofpseudo-entropyandproved this quantity coincides with topological entropy. Richeson et al. [21] obtained the lower bounded of topological entropy by means of the definition of pseudo-entropy. This paper aims to generalize the main results obtained by Misiurewicz and Rich-eson et al. to free semigroup actions. Firstly, the pseudo-entropy is introduced for free semigroup actions, and it is shown that the pseudo-entropy coincides with the topological entropy defined by Bufetov [9]. Secondly, these concepts of the chain recurrence, the chain mixing, the chain recurrence time, and the chain mixing time for free semigroup actions are introduced, and the upper bounds of these recurrence times are given. Furthermore, a lower bound of topological entropy is given by the lower box dimension and the chain mixing time using the definition of pseudo-entropy for free semigroup actions. Thirdly, the structure of chain transitive systems for free semigroup actions is discussed.


title: Efficiency of non-truthful auctions under auto-bidding

abstract: Auto-bidding is now widely adopted as an interface between advertisers and internet advertising as it allows advertisers to specify high-level goals, such as maximizing value subject to a value-per-spend constraint. Prior research has mostly focused on auctions which are truthful (such as SPA) since uniform bidding is optimal in such auctions, which makes it manageable to reason about equilibria. A tantalizing question is whether one can obtain more efficient outcomes by leaving the realm of truthful auctions. This is the first paper to study non-truthful auctions in the prior-free auto-bidding setting. Our first result is that non-truthfulness provides no benefit when one considers deterministic auctions. Any deterministic mechanism has a price of anarchy (PoA) of at least $2$, even for $2$ bidders; this matches what can be achieved by deterministic truthful mechanisms. In particular, we prove that the first price auction has PoA of exactly $2$. For our second result, we construct a randomized non-truthful auction that achieves a PoA of $1.8$ for $2$ bidders. This is the best-known PoA for this problem. The previously best-known PoA for this problem was $1.9$ and was achieved with a truthful mechanism. Moreover, we demonstrate the benefit of non-truthfulness in this setting by showing that the truthful version of this randomized auction also has a PoA of $1.9$. Finally, we show that no auction (even randomized, non-truthful) can improve upon a PoA bound of $2$ as the number of advertisers grow to infinity.


title: 3-manifolds without any embedding in symplectic 4-manifolds

abstract: We show that there exist infinitely many closed 3-manifolds that do not embed in closed symplectic 4-manifolds, disproving a conjecture of Etnyre-Min-Mukherjee. To do this, we construct L-spaces that cannot bound positive or negative definite manifolds. The arguments use Heegaard Floer correction terms and instanton moduli spaces.


title: Mixing is hard for triangle-free reflexive graphs

abstract: In the problem ${\rm Mix}(H)$ one is given a graph $G$ and must decide if the Hom-graph ${\rm {\bf Hom}}(G,H)$ is connected. We show that if $H$ is a triangle-free reflexive graph with at least one cycle, ${\rm Mix}(H)$ is ${\rm coNP}$-complete. The main part of this is a reduction to the problem ${\rm NonFlat}({\rm{\bf H}})$ for a simplicial complex ${\rm{\bf H}}$, in which one is given a simplicial complex ${\rm{\bf G}}$ and must decide if there are any simplicial maps $\phi$ from ${\rm{\bf G}}$ to ${\rm{\bf H}}$ under which some $1$-cycles of ${\rm{\bf G}}$ maps to homologically non-trivial cycle of ${\rm{\bf H}}$. We show that for any reflexive graph $H$, if the clique complex ${\rm{\bf H}}$ of $H$ has a free, non-trivial homology group $H_1({\rm{\bf H}})$, then ${\rm NonFlat}({\rm{\bf H}})$ is ${\rm NP}$-complete.


title: Diamagnetic mechanism of critical current non-reciprocity in multilayered superconductors

abstract: Recent excitement in observation of non-reciprocal critical current (NRC) is motivated by a suggestion that "superconducting diode effect" may be an intrinsic property of non-centrosymmetric superconductors with strong spin-orbit interactions[1]. Theoretically it has been understood that linear in the Cooper pair momentum terms, caused by the Rashba spin-orbit and Zeeman interactions or, more generally, any symmetry-allowed Lifshitz invariants[2] in uniform singlet superconductors, do not contribute to the supercurrent, although the role of higher-order terms remains unclear[3, 4]. In this work we show that critical current non-reciprocity is a generic property of multilayered superconductor structures in the presence of magnetic field-generated diamagnetic currents. In the regime of an intermediate coupling between the layers, the Josephson vortices are predicted to form at high fields and currents. We report the observation of NRC in nanowires fabricated from InAs/Al heterostructures. The effect is independent of the crystallographic orientation of the wire, ruling out an intrinsic origin of NRC. Non-monotonic NRC evolution with magnetic field is consistent with the generation of diamagnetic currents and formation of the Josephson vortices. This extrinsic NRC mechanism can be used to design novel devices for superconducting circuits.


title: Integrating Sensing, Computing, and Communication in 6G Wireless Networks: Design and Optimization

abstract: The roll-out of various emerging wireless services has triggered the need for the sixth-generation (6G) wireless networks to provide functions of target sensing, intelligent computing and information communication over the same radio spectrum. In this paper, we provide a unified framework integrating sensing, computing, and communication to optimize limited system resource for 6G wireless networks. In particular, two typical joint beamforming design algorithms are derived based on multi-objective optimization problems (MOOP) with the goals of the weighted overall performance maximization and the total transmit power minimization, respectively. Extensive simulation results validate the effectiveness of the proposed algorithms. Moreover, the impacts of key system parameters are revealed to provide useful insights for the design of integrated sensing, computing, and communication (ISCC).


title: Information-Gathering in Latent Bandits

abstract: In the latent bandit problem, the learner has access to reward distributions and -- for the non-stationary variant -- transition models of the environment. The reward distributions are conditioned on the arm and unknown latent states. The goal is to use the reward history to identify the latent state, allowing for the optimal choice of arms in the future. The latent bandit setting lends itself to many practical applications, such as recommender and decision support systems, where rich data allows the offline estimation of environment models with online learning remaining a critical component. Previous solutions in this setting always choose the highest reward arm according to the agent's beliefs about the state, not explicitly considering the value of information-gathering arms. Such information-gathering arms do not necessarily provide the highest reward, thus may never be chosen by an agent that chooses the highest reward arms at all times. In this paper, we present a method for information-gathering in latent bandits. Given particular reward structures and transition matrices, we show that choosing the best arm given the agent's beliefs about the states incurs higher regret. Furthermore, we show that by choosing arms carefully, we obtain an improved estimation of the state distribution, and thus lower the cumulative regret through better arm choices in the future. We evaluate our method on both synthetic and real-world data sets, showing significant improvement in regret over state-of-the-art methods.


title: Cubical models of higher categories without connections

abstract: We prove that each of the model structures for ($n$-trivial, saturated) comical sets on the category of marked cubical sets having only faces and degeneracies (without connections) is Quillen equivalent to the corresponding model structure for ($n$-trivial, saturated) complicial sets on the category of marked simplicial sets, as well as to the corresponding comical model structures on cubical sets with connections. As a consequence, we show that the cubical Joyal model structure on cubical sets without connections is equivalent to its analogues on cubical sets with connections and to the Joyal model structure on simplicial sets. We also show that any comical set without connections may be equipped with connections via lifting, and that this can be done compatibly on the domain and codomain of any fibration or cofibration of comical sets.


title: OmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering

abstract: The information in tables can be an important complement to text, making table-based question answering (QA) systems of great value. The intrinsic complexity of handling tables often adds an extra burden to both model design and data annotation. In this paper, we aim to develop a simple table-based QA model with minimal annotation effort. Motivated by the fact that table-based QA requires both alignment between questions and tables and the ability to perform complicated reasoning over multiple table elements, we propose an omnivorous pretraining approach that consumes both natural and synthetic data to endow models with these respective abilities. Specifically, given freely available tables, we leverage retrieval to pair them with relevant natural sentences for mask-based pretraining, and synthesize NL questions by converting SQL sampled from tables for pretraining with a QA loss. We perform extensive experiments in both few-shot and full settings, and the results clearly demonstrate the superiority of our model OmniTab, with the best multitasking approach achieving an absolute gain of 16.2% and 2.7% in 128-shot and full settings respectively, also establishing a new state-of-the-art on WikiTableQuestions. Detailed ablations and analyses reveal different characteristics of natural and synthetic data, shedding light on future directions in omnivorous pretraining. Code, pretraining data, and pretrained models are available at https://github.com/jzbjyb/OmniTab.


title: A Support Vector Model of Pruning Trees Evaluation Based on OTSU Algorithm

abstract: The tree pruning process is the key to promoting fruits' growth and improving their productions due to effects on the photosynthesis efficiency of fruits and nutrition transportation in branches. Currently, pruning is still highly dependent on human labor. The workers' experience will strongly affect the robustness of the performance of the tree pruning. Thus, it is a challenge for workers and farmers to evaluate the pruning performance. Intended for a better solution to the problem, this paper presents a novel pruning classification strategy model called "OTSU-SVM" to evaluate the pruning performance based on the shadows of branches and leaves. This model considers not only the available illuminated area of the tree but also the uniformity of the illuminated area of the tree. More importantly, our group implements OTSU algorithm into the model, which highly reinforces robustness of the evaluation of this model. In addition, the data from the pear trees in the Yuhang District, Hangzhou is also used in the experiment. In this experiment, we prove that the OTSU-SVM has good accuracy with 80% and high performance in the evaluation of the pruning for the pear trees. It can provide more successful pruning if applied into the orchard. A successful pruning can broaden the illuminated area of individual fruit, and increase nutrition transportation from the target branch, dramatically elevating the weights and production of the fruits.