title: Vote'n'Rank: Revision of Benchmarking with Social Choice Theory

abstract: The development of state-of-the-art systems in different applied areas of machine learning (ML) is driven by benchmarks, which have shaped the paradigm of evaluating generalisation capabilities from multiple perspectives. Although the paradigm is shifting towards more fine-grained evaluation across diverse tasks, the delicate question of how to aggregate the performances has received particular interest in the community. In general, benchmarks follow the unspoken utilitarian principles, where the systems are ranked based on their mean average score over task-specific metrics. Such aggregation procedure has been viewed as a sub-optimal evaluation protocol, which may have created the illusion of progress. This paper proposes Vote'n'Rank, a framework for ranking systems in multi-task benchmarks under the principles of the social choice theory. We demonstrate that our approach can be efficiently utilised to draw new insights on benchmarking in several ML sub-fields and identify the best-performing systems in research and development case studies. The Vote'n'Rank's procedures are more robust than the mean average while being able to handle missing performance scores and determine conditions under which the system becomes the winner.


title: Deep Active Ensemble Sampling For Image Classification

abstract: Conventional active learning (AL) frameworks aim to reduce the cost of data annotation by actively requesting the labeling for the most informative data points. However, introducing AL to data hungry deep learning algorithms has been a challenge. Some proposed approaches include uncertainty-based techniques, geometric methods, implicit combination of uncertainty-based and geometric approaches, and more recently, frameworks based on semi/self supervised techniques. In this paper, we address two specific problems in this area. The first is the need for efficient exploitation/exploration trade-off in sample selection in AL. For this, we present an innovative integration of recent progress in both uncertainty-based and geometric frameworks to enable an efficient exploration/exploitation trade-off in sample selection strategy. To this end, we build on a computationally efficient approximate of Thompson sampling with key changes as a posterior estimator for uncertainty representation. Our framework provides two advantages: (1) accurate posterior estimation, and (2) tune-able trade-off between computational overhead and higher accuracy. The second problem is the need for improved training protocols in deep AL. For this, we use ideas from semi/self supervised learning to propose a general approach that is independent of the specific AL technique being used. Taken these together, our framework shows a significant improvement over the state-of-the-art, with results that are comparable to the performance of supervised-learning under the same setting. We show empirical results of our framework, and comparative performance with the state-of-the-art on four datasets, namely, MNIST, CIFAR10, CIFAR100 and ImageNet to establish a new baseline in two different settings.


title: CNOT-Efficient Circuits for Arbitrary Rank Many-Body Fermionic and Qubit Excitations

abstract: Efficient quantum circuits are necessary for realizing quantum algorithms on noisy intermediate-scale quantum devices. Fermionic excitations entering unitary coupled-cluster (UCC) ans\"atze give rise to quantum circuits containing CNOT "staircases" whose number scales exponentially with the excitation rank. Recently, Yordanov et al. [Phys. Rev. A 102, 062612 (2020); Commun. Phys. 4, 228 (2021)] constructed CNOT-efficient quantum circuits for both fermionic- (FEB) and qubit-excitation-based (QEB) singles and doubles and illustrated their usefulness in adaptive derivative-assembled pseudo-Trotterized variational quantum eigensolver (ADAPT-VQE) simulations. In this work, we extend these CNOT-efficient quantum circuits to arbitrary excitation ranks. To illustrate the benefits of these compact FEB and QEB quantum circuits, we perform numerical simulations using the recently developed selected projective quantum eigensolver (SPQE) approach, which relies on an adaptive UCC ansatz built from arbitrary-order particle-hole excitation operators. We show that both FEB- and QEB-SPQE decrease the number of CNOT gates compared to traditional SPQE by factors as large as 15. At the same time, QEB-SPQE requires, in general, more ansatz parameters than FEB-SPQE, in particular those corresponding to higher-than-double excitations, resulting in quantum circuits with larger CNOT counts. Although ADAPT-VQE generates quantum circuits with fewer CNOTs than SPQE, SPQE requires orders of magnitude less residual element evaluations than gradient element evaluations in ADAPT-VQE.


title: Applying FrameNet to Chinese(Poetry)

abstract: FrameNet( Fillmore and Baker [2009] ) is well-known for its wide use for knowledge representation in the form of inheritance-based ontologies and lexica( Trott et al. [2020] ). Although FrameNet is usually applied to languages like English, Spanish and Italian, there are still plenty of FrameNet data sets available for other languages like Chinese, which differs significantly from those languages based on Latin alphabets. In this paper, the translation from ancient Chinese Poetry to modern Chinese will be first conducted to further apply the Chinese FrameNet(CFN, provided by Shanxi University). Afterwards, the translation from modern Chinese will be conducted as well for the comparison between the applications of CFN and English FrameNet. Finally, the overall comparison will be draw between CFN to modern Chinese and English FrameNet.


title: Bil-DOS: A Bi-lingual Dialogue Ordering System (for Subway)

abstract: Due to the unfamiliarity to particular words(or proper nouns) for ingredients, non-native English speakers can be extremely confused about the ordering process in restaurants like Subway. Thus, We developed a dialogue system, which supports Chinese(Mandarin)1 and English2 at the same time. In other words, users can switch arbitrarily between Chinese(Mandarin) and English as the conversation is being conducted. This system is specifically designed for Subway ordering3. In BilDOS, we designed a Discriminator module to tell the language is being used in inputted user utterance, a Translator module to translate used language into English if it is not English, and a Dialogue Manager module to detect the intention within inputted user utterances, handle outlier inputs by throwing clarification requests, map detected Intention and detailed Keyword4 into a particular intention class, locate the current ordering process, continue to give queries to finish the order, conclude the order details once the order is completed, activate the evaluation process when the conversation is done.


title: Magnetohydrodynamic stability of magnetars in the ultrastrong field regime II: The crust

abstract: We study the stability of Hall MHD with strong magnetic fields in which Landau quantization of electrons is important. We find that the strong-field Hall modes can be destabilized by the dependence of the differential magnetic susceptibility on magnetic field strength. This instability is studied using linear perturbation theory, and is found to have typical growth time of order $\lesssim 10^3$ yrs, with the growth time decreasing as a function of wavelength of the perturbation. The instability is self-limiting, turning off following a period of local field growth by a few percent of the initial value. Finite temperature is also shown to limit the instability, with sufficiently high temperatures eliminating it altogether. Alfv\'{e}n waves can show similar unstable behaviour on shorter timescales. We find that Ohmic heating due to the large fields developed via the instability and magnetic domain formation is not large enough to account for observed magnetar surface temperatures. However, Ohmic heating is enhanced by the oscillatory differential magnetic susceptibility of Landau-quantized electrons, which could be important to magneto-thermal simulations of neutron star crusts.


title: C-Mixup: Improving Generalization in Regression

abstract: Improving the generalization of deep networks is an important open challenge, particularly in domains without plentiful data. The mixup algorithm improves generalization by linearly interpolating a pair of examples and their corresponding labels. These interpolated examples augment the original training set. Mixup has shown promising results in various classification tasks, but systematic analysis of mixup in regression remains underexplored. Using mixup directly on regression labels can result in arbitrarily incorrect labels. In this paper, we propose a simple yet powerful algorithm, C-Mixup, to improve generalization on regression tasks. In contrast with vanilla mixup, which picks training examples for mixing with uniform probability, C-Mixup adjusts the sampling probability based on the similarity of the labels. Our theoretical analysis confirms that C-Mixup with label similarity obtains a smaller mean square error in supervised regression and meta-regression than vanilla mixup and using feature similarity. Another benefit of C-Mixup is that it can improve out-of-distribution robustness, where the test distribution is different from the training distribution. By selectively interpolating examples with similar labels, it mitigates the effects of domain-associated information and yields domain-invariant representations. We evaluate C-Mixup on eleven datasets, ranging from tabular to video data. Compared to the best prior approach, C-Mixup achieves 6.56%, 4.76%, 5.82% improvements in in-distribution generalization, task generalization, and out-of-distribution robustness, respectively. Code is released at https://github.com/huaxiuyao/C-Mixup.


title: Frequency combs with multiple offsets in THz-rate microresonators

abstract: Octave-wide frequency combs in microresonators are essential for self-referencing. However, it is difficult for the small-size and high-repetition-rate microresonators to achieve perfect soliton modelocking over the broad frequency range due to the detrimental impact of dispersion. Here we examine the stability of the soliton states consisting of one hundred modes in silicon-nitride microresonators with the one-THz free spectral range. We report the coexistence of fast and slow solitons in a narrow detuning range, which is surrounded on either side by the breather states. We decompose the breather combs into a sequence of subcombs with different carrier envelope offset frequencies. The large detuning breathers have a high frequency of oscillations associated with the perturbation extending across the whole microresonator. The small detuning breathers create oscillations localised on the soliton core and can undergo the period-doubling bifurcation, which triggers a sequence of intense sub-combs.


title: Gas accretion and Ram Pressure Stripping of Haloes in Void Walls

abstract: We conduct hydrodynamical cosmological zoom simulations of fourteen voids to study the ability of haloes to accrete gas at different locations throughout the voids at z = 0. Measuring the relative velocity of haloes with respect to their ambient gas, we find that a tenth of the haloes are expected to be unable to accrete external gas due to its fast flow passed them (so called 'fast flow haloes'). These are typically located near void walls. We determine that these haloes have recently crossed the void wall and are still moving away from it. their motion counter to that of ambient gas falling towards the void wall results in fast flows that make external gas accretion very challenging, and often cause partial gas loss via the resultant ram pressures. Using an analytical approach, we model the impact of such ram pressures on the gas inside haloes of different masses. A halo's external gas accretion is typically cut off, with partial stripping of halo gas. For masses below a few times 10$^{9}$ M$_{\odot}$, their halo gas is heavily truncated but not completely stripped. We identify numerous examples of haloes with a clear jelly-fish like gas morphology, indicating their surrounding gas is being swept away, cutting them off from further external accretion. These results highlight how, even in the relatively low densities of void walls, a fraction of galaxies can interact with large-scale flows in a manner that has consequences for their gas content and ability to accrete gas.


title: Oxygen and iron in interstellar dust: an X-ray investigation

abstract: Understanding the chemistry of the interstellar medium (ISM) is fundamental for the comprehension of the Galactic and stellar evolution. X-rays provide an excellent way to study the dust chemical composition and crystallinity along different sight-lines in the Galaxy. In this work we study the dust grain chemistry in the diffuse regions of the interstellar medium in the soft X-ray band (<1 keV). We use newly calculated X-ray dust extinction cross sections, obtained from laboratory data, in order to investigate the oxygen K and iron L shell absorption. We explore the XMM-Newton and Chandra spectra of 5 low-mass X-ray binaries located in the Galactic plane, and we model the gas and dust features of oxygen and iron simultaneously. The dust samples used for this study include silicates with different Mg:Fe ratios, sulfides, iron oxides and metallic iron. Most dust samples are in both amorphous and crystalline lattice configuration. The extinction cross sections have been computed using Mie scattering approximation and assuming a power law dust size distribution. We find that the Mg-rich amorphous pyroxene (Mg0.75Fe0.25SiO3) represents the largest fraction of dust towards most of the X-ray sources, about 70% on average. Additionally, we find that ~15% of the dust column density in our lines of sight is in Fe metallic. We do not find strong evidence for ferromagnetic compounds, such as Fe3O4 or iron sulfides (FeS, FeS2). Our study confirms that the iron is heavily depleted from the gas phase into solids; more than 90% of iron is in dust. The depletion of neutral oxygen is mild, between 10-20% depending on the line of sight.


title: Evaluation of Delay Uncertainty in PCB Interconnects Due to Fiber Weave Effect

abstract: Delay Deviation Exceedance (DDE) and Differential Skew Exceedance (DSE) measures are proposed to quantify delay uncertainty in single-ended and differential PCB interconnects arising from Fiber Weave Effect (FWE). DDE and DSE are constructed with 3D EM analysis of traces over inhomogeneous dielectric with glass fiber bundles in resin. Measurements or 3D EM models for FWE are usually used for observations of delay or impedance dependency on position of traces over fiber bundles with the purpose to find the worst case scenario. This paper turns the results of 3D EM analysis into probabilistic measures of possible delay or skew uncertainty - probability to have delay deviation in single-ended interconnects over allowed limit (DDE measure) or to have skew over allowed limit in differential interconnects (DSE measure). The introduced measures allow formalizing the laminate selection process for parallel as well as for serial PCB interconnects.


title: Cross-Lingual Speaker Identification Using Distant Supervision

abstract: Speaker identification, determining which character said each utterance in literary text, benefits many downstream tasks. Most existing approaches use expert-defined rules or rule-based features to directly approach this task, but these approaches come with significant drawbacks, such as lack of contextual reasoning and poor cross-lingual generalization. In this work, we propose a speaker identification framework that addresses these issues. We first extract large-scale distant supervision signals in English via general-purpose tools and heuristics, and then apply these weakly-labeled instances with a focus on encouraging contextual reasoning to train a cross-lingual language model. We show that the resulting model outperforms previous state-of-the-art methods on two English speaker identification benchmarks by up to 9% in accuracy and 5% with only distant supervision, as well as two Chinese speaker identification datasets by up to 4.7%.


title: Transforming RDF-star to Property Graphs: A Preliminary Analysis of Transformation Approaches -- extended version

abstract: RDF and property graph models have many similarities, such as using basic graph concepts like nodes and edges. However, such models differ in their modeling approach, expressivity, serialization, and the nature of applications. RDF is the de-facto standard model for knowledge graphs on the Semantic Web and supported by a rich ecosystem for inference and processing. The property graph model, in contrast, provides advantages in scalable graph analytical tasks, such as graph matching, path analysis, and graph traversal. RDF-star extends RDF and allows capturing metadata as a first-class citizen. To tap on the advantages of alternative models, the literature proposes different ways of transforming knowledge graphs between property graphs and RDF. However, most of these approaches cannot provide complete transformations for RDF-star graphs. Hence, this paper provides a step towards transforming RDF-star graphs into property graphs. In particular, we identify different cases to evaluate transformation approaches from RDF-star to property graphs. Specifically, we categorize two classes of transformation approaches and analyze them based on the test cases. The obtained insights will form the foundation for building complete transformation approaches in the future.


title: Gradient-Guided Importance Sampling for Learning Binary Energy-Based Models

abstract: Learning energy-based models (EBMs) is known to be difficult especially on discrete data where gradient-based learning strategies cannot be applied directly. Although ratio matching is a sound method to learn discrete EBMs, it suffers from expensive computation and excessive memory requirements, thereby resulting in difficulties in learning EBMs on high-dimensional data. Motivated by these limitations, in this study, we propose ratio matching with gradient-guided importance sampling (RMwGGIS). Particularly, we use the gradient of the energy function w.r.t. the discrete data space to approximately construct the provably optimal proposal distribution, which is subsequently used by importance sampling to efficiently estimate the original ratio matching objective. We perform experiments on density modeling over synthetic discrete data, graph generation, and training Ising models to evaluate our proposed method. The experimental results demonstrate that our method can significantly alleviate the limitations of ratio matching, perform more effectively in practice, and scale to high-dimensional problems. Our implementation is available at https://github.com/divelab/RMwGGIS.


title: Towards Discriminative and Transferable One-Stage Few-Shot Object Detectors

abstract: Recent object detection models require large amounts of annotated data for training a new classes of objects. Few-shot object detection (FSOD) aims to address this problem by learning novel classes given only a few samples. While competitive results have been achieved using two-stage FSOD detectors, typically one-stage FSODs underperform compared to them. We make the observation that the large gap in performance between two-stage and one-stage FSODs are mainly due to their weak discriminability, which is explained by a small post-fusion receptive field and a small number of foreground samples in the loss function. To address these limitations, we propose the Few-shot RetinaNet (FSRN) that consists of: a multi-way support training strategy to augment the number of foreground samples for dense meta-detectors, an early multi-level feature fusion providing a wide receptive field that covers the whole anchor area and two augmentation techniques on query and source images to enhance transferability. Extensive experiments show that the proposed approach addresses the limitations and boosts both discriminability and transferability. FSRN is almost two times faster than two-stage FSODs while remaining competitive in accuracy, and it outperforms the state-of-the-art of one-stage meta-detectors and also some two-stage FSODs on the MS-COCO and PASCAL VOC benchmarks.


title: REMS: Middleware for Robotics Education and Development

abstract: This paper introduces REMS, a robotics middleware and control framework that is designed to introduce the Zen of Python to robotics and to improve robotics education and development flow. Although existing middleware can serve hardware abstraction and modularity, setting up environments and learning middleware-specific syntax and procedures are less viable in education. They can curb opportunities to understand robotics concepts, theories, and algorithms. Robotics is a field of integration; students and developers from various backgrounds will be involved in programming. Establishing Pythonic and object-oriented robotic framework in a natural way can enhance modular and abstracted programming for better readability, reusability, and simplicity, but also supports useful and practical skills generally in coding. REMS is to be a valuable robot educational medium not just as a tool and to be a platform from one robot to multi-agent across hardware, simulation, and analytical model implementations.


title: Scaling Up Deliberation for Multilingual ASR

abstract: Multilingual end-to-end automatic speech recognition models are attractive due to its simplicity in training and deployment. Recent work on large-scale training of such models has shown promising results compared to monolingual models. However, the work often focuses on multilingual models themselves in a single-pass setup. In this work, we investigate second-pass deliberation for multilingual speech recognition. Our proposed deliberation is multilingual, i.e., the text encoder encodes hypothesis text from multiple languages, and the decoder attends to multilingual text and audio. We investigate scaling the deliberation text encoder and decoder, and compare scaling the deliberation decoder and the first-pass cascaded encoder. We show that deliberation improves the average WER on 9 languages by 4% relative compared to the single-pass model. By increasing the size of the deliberation up to 1B parameters, the average WER improvement increases to 9%, with up to 14% for certain languages. Our deliberation rescorer is based on transformer layers and can be parallelized during rescoring.


title: Necessary cancellation conditions for the boundedness of operators on local Hardy spaces

abstract: In this work we present necessary cancellation conditions for the continuity of linear operators in $h^p(\mathbb{R}^n)$, $0<p\leq 1$, that map atoms into pseudo-molecules. Our necessary condition, expressed in terms of the $T^{\ast}$ condition, is the same as the one recently proved sufficient in [3], thus providing a necessary and sufficient cancellation condition for the boundedness of inhomogeneous Calder\'on--Zygmund type operators


title: Hypercontractivity Meets Random Convex Hulls: Analysis of Randomized Multivariate Cubatures

abstract: Given a probability measure $\mu$ on a set $\mathcal{X}$ and a vector-valued function $\varphi$, a common problem is to construct a discrete probability measure on $\mathcal{X}$ such that the push-forward of these two probability measures under $\varphi$ is the same. This construction is at the heart of numerical integration methods that run under various names such as quadrature, cubature, or recombination. A natural approach is to sample points from $\mu$ until their convex hull of their image under $\varphi$ includes the mean of $\varphi$. Here we analyze the computational complexity of this approach when $\varphi$ exhibits a graded structure by using so-called hypercontractivity. The resulting theorem not only covers the classical cubature case of multivariate polynomials, but also integration on pathspace, as well as kernel quadrature for product measures.


title: A Note on Reachability and Distance Oracles for Transmission Graphs

abstract: Let $P$ be a set of $n$ points in the plane, where each point $p\in P$ has a transmission radius $r(p)>0$. The transmission graph defined by $P$ and the given radii, denoted by $\mathcal{G}_{\mathrm{tr}}(P)$, is the directed graph whose nodes are the points in $P$ and that contains the arcs $(p,q)$ such that $|pq|\leq r(p)$. An and Oh [Algorithmica 2022] presented a reachability oracle for transmission graphs. Their oracle uses $O(n^{5/3})$ storage and, given two query points $s,t\in P$, can decide in $O(n^{2/3})$ time if there is a path from $s$ to $t$ in $\mathcal{G}_{\mathrm{tr}}(P)$. We show that the clique-based separators introduced by De Berg \emph{et al.} [SICOMP 2020] can be used to improve the storage of the oracle to $O(n\sqrt{n})$ and the query time to $O(\sqrt{n})$. Our oracle can be extended to approximate distance queries: we can construct, for a given parameter $\varepsilon>0$, an oracle that uses $O((n/\varepsilon)\sqrt{n}\log n)$ storage and that can report in $O((\sqrt{n}/\varepsilon)\log n)$ time a value $d_{\mathrm{hop}}^*(s,t)$ satisfying $d_{\mathrm{hop}}(s,t) \leq d_{\mathrm{hop}}^*(s,t) < (1+\varepsilon)\cdot d_{\mathrm{hop}}(s,t) + 1$, where $d_{\mathrm{hop}}(s,t)$ is the hop-distance from $s$ to $t$. We also show how to extend the oracle to so-called continuous queries, where the target point $t$ can be any point in the plane. To obtain an efficient preprocessing algorithm, we show that a clique-based separator of a set~$F$ of convex fat objects in $\Bbb{R}^d$ can be constructed in $O(n\log n)$ time.


title: Trading Off Resource Budgets for Improved Regret Bounds

abstract: In this work we consider a variant of adversarial online learning where in each round one picks $B$ out of $N$ arms and incurs cost equal to the $\textit{minimum}$ of the costs of each arm chosen. We propose an algorithm called Follow the Perturbed Multiple Leaders (FPML) for this problem, which we show (by adapting the techniques of Kalai and Vempala [2005]) achieves expected regret $\mathcal{O}(T^{\frac{1}{B+1}}\ln(N)^{\frac{B}{B+1}})$ over time horizon $T$ relative to the $\textit{single}$ best arm in hindsight. This introduces a trade-off between the budget $B$ and the single-best-arm regret, and we proceed to investigate several applications of this trade-off. First, we observe that algorithms which use standard regret minimizers as subroutines can sometimes be adapted by replacing these subroutines with FPML, and we use this to generalize existing algorithms for Online Submodular Function Maximization [Streeter and Golovin, 2008] in both the full feedback and semi-bandit feedback settings. Next, we empirically evaluate our new algorithms on an online black-box hyperparameter optimization problem. Finally, we show how FPML can lead to new algorithms for Linear Programming which require stronger oracles at the benefit of fewer oracle calls.


title: Transfer Learning with Joint Fine-Tuning for Multimodal Sentiment Analysis

abstract: Most existing methods focus on sentiment analysis of textual data. However, recently there has been a massive use of images and videos on social platforms, motivating sentiment analysis from other modalities. Current studies show that exploring other modalities (e.g., images) increases sentiment analysis performance. State-of-the-art multimodal models, such as CLIP and VisualBERT, are pre-trained on datasets with the text paired with images. Although the results obtained by these models are promising, pre-training and sentiment analysis fine-tuning tasks of these models are computationally expensive. This paper introduces a transfer learning approach using joint fine-tuning for sentiment analysis. Our proposal achieved competitive results using a more straightforward alternative fine-tuning strategy that leverages different pre-trained unimodal models and efficiently combines them in a multimodal space. Moreover, our proposal allows flexibility when incorporating any pre-trained model for texts and images during the joint fine-tuning stage, being especially interesting for sentiment classification in low-resource scenarios.


title: Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction

abstract: Understanding the landscape of potential harms from algorithmic systems enables practitioners to better anticipate consequences of the systems they build. It also supports the prospect of incorporating controls to help minimize harms that emerge from the interplay of technologies and social and cultural dynamics. A growing body of scholarship has identified a wide range of harms across different algorithmic technologies. However, computing research and practitioners lack a high level and synthesized overview of harms from algorithmic systems. Based on a scoping review of computing research $(n=172)$, we present an applied taxonomy of sociotechnical harms to support a more systematic surfacing of potential harms in algorithmic systems. The final taxonomy builds on and refers to existing taxonomies, classifications, and terminologies. Five major themes related to sociotechnical harms - representational, allocative, quality-of-service, interpersonal harms, and social system/societal harms - and sub-themes are presented along with a description of these categories. We conclude with a discussion of challenges and opportunities for future research.


title: Flexible Modeling of Nonstationary Extremal Dependence using Spatially-Fused LASSO and Ridge Penalties

abstract: Statistical modeling of a nonstationary spatial extremal dependence structure is challenging. Max-stable processes are common choices for modeling spatially-indexed block maxima, where an assumption of stationarity is usual to make inference feasible. However, this assumption is often unrealistic for data observed over a large or complex domain. We propose a computationally-efficient method for estimating extremal dependence using a globally nonstationary, but locally-stationary, max-stable process by exploiting nonstationary kernel convolutions. We divide the spatial domain into a fine grid of subregions, assign each of them its own dependence parameters, and use LASSO ($L_1$) or ridge ($L_2$) penalties to obtain spatially-smooth parameter estimates. We then develop a novel data-driven algorithm to merge homogeneous neighboring subregions. The algorithm facilitates model parsimony and interpretability. To make our model suitable for high-dimensional data, we exploit a pairwise likelihood to draw inferences and discuss computational and statistical efficiency. An extensive simulation study demonstrates the superior performance of our proposed model and the subregion-merging algorithm over the approaches that either do not model nonstationarity or do not update the domain partition. We apply our proposed method to model monthly maximum temperatures at over 1400 sites in Nepal and the surrounding Himalayan and sub-Himalayan regions; we again observe significant improvements in model fit compared to a stationary process and a nonstationary process without subregion-merging. Furthermore, we demonstrate that the estimated merged partition is interpretable from a geographic perspective and leads to better model diagnostics by adequately reducing the number of subregion-specific parameters.


title: Comparison of Soft and Hard Target RNN-T Distillation for Large-scale ASR

abstract: Knowledge distillation is an effective machine learning technique to transfer knowledge from a teacher model to a smaller student model, especially with unlabeled data. In this paper, we focus on knowledge distillation for the RNN-T model, which is widely used in state-of-the-art (SoTA) automatic speech recognition (ASR). Specifically, we compared using soft and hard target distillation to train large-scaleRNN-T models on the LibriSpeech/LibriLight public dataset (60k hours) and our in-house data (600k hours). We found that hard tar-gets are more effective when the teacher and student have different architecture, such as large teacher and small streaming student. On the other hand, soft target distillation works better in self-training scenario like iterative large teacher training. For a large model with0.6B weights, we achieve a new SoTA word error rate (WER) on LibriSpeech (8% relative improvement on dev-other) using Noisy Student Training with soft target distillation. It also allows our production teacher to adapt new data domain continuously.


title: Designing Robust Transformers using Robust Kernel Density Estimation

abstract: Recent advances in Transformer architectures have empowered their empirical success in a variety of tasks across different domains. However, existing works mainly focus on predictive accuracy and computational cost, without considering other practical issues, such as robustness to contaminated samples. Recent work by Nguyen et al., (2022) has shown that the self-attention mechanism, which is the center of the Transformer architecture, can be viewed as a non-parametric estimator based on kernel density estimation (KDE). This motivates us to leverage a set of robust kernel density estimation methods for alleviating the issue of data contamination. Specifically, we introduce a series of self-attention mechanisms that can be incorporated into different Transformer architectures and discuss the special properties of each method. We then perform extensive empirical studies on language modeling and image classification tasks. Our methods demonstrate robust performance in multiple scenarios while maintaining competitive results on clean datasets.


title: Online Team Formation under Different Synergies

abstract: Team formation is ubiquitous in many sectors: education, labor markets, sports, etc. A team's success depends on its members' latent types, which are not directly observable but can be (partially) inferred from past performances. From the viewpoint of a principal trying to select teams, this leads to a natural exploration-exploitation trade-off: retain successful teams that are discovered early, or reassign agents to learn more about their types? We study a natural model for online team formation, where a principal repeatedly partitions a group of agents into teams. Agents have binary latent types, each team comprises two members, and a team's performance is a symmetric function of its members' types. Over multiple rounds, the principal selects matchings over agents and incurs regret equal to the deficit in the number of successful teams versus the optimal matching for the given function. Our work provides a complete characterization of the regret landscape for all symmetric functions of two binary inputs. In particular, we develop team-selection policies that, despite being agnostic of model parameters, achieve optimal or near-optimal regret against an adaptive adversary.


title: Accurate computations up to break-down of quasi-periodic attractors in the dissipative spin-orbit problem

abstract: We consider a Celestial Mechanics model: the spin-orbit problem with a dissipative tidal torque, which is a singular perturbation of a conservative system. The goal of this paper is to show that it is possible to compute quasi-periodic attractors accurately and reliably for parameter values extremely close to the breakdown. Therefore, it is possible to obtain information on mathematical phenomena at breakdown. The method we use incorporates the same time numerical and rigorous improvements. Among them (i) the formalism is based on studying the time-one map of the spin-orbit problem (which reduces the dimensionality of the problem) and has mathematical advantages; (ii) very accurate integration of the ODE (high order Taylor methods implemented with extended precision) for the map at its jets; (iii) a very efficient KAM method for maps which computes the attractor and its tangent spaces ( quadratically convergent step with low storage requirements, and low operation count); (iv) the algorithms are backed by a rigorous a-posteriori KAM Theorem, which establishes that if the algorithm, produces a very approximate solution of functional equation with reasonable condition numbers. then there is a true solution nearby; and (v) the continuation algorithm is guaranteed to reach arbitrarily close to the border of existence if it is given enough computer resources. As a byproduct of the accuracy that we maintain till breakdown, we study several scale invariant observables of the tori used in the renormalization group of infinite dimensional spaces. In contrast with previously studied simple models, the behavior at breakdown of the spin-orbit problem does not satisfy standard scaling relations which implies that the spin-orbit problem is not described by a hyperbolic fixed point of a renormalization operator.


title: Joint Modeling for Geometry and Functionality of Cerebral Cortical Surface Images

abstract: We propose a framework for jointly modeling the geometry and functionality in high dimensional functional surfaces. The proposed mixed effects model characterizes effects of subject-specific covariates and exogenous stimuli on functional surfaces while accounting for potential mutual-influence of their geometry and functionality. This is achieved through a computationally efficient estimation method that incorporates regularized estimation of the precision matrix of the random effects. We perform a thorough analysis of cerebral cortical surface structural MRI and task fMRI data from the Human Connectome Project and discover relationships between the geometric shapes of cortical surface and neuronal activation responding to task stimuli. Our findings highlight new modes of correspondence between cortical surface shape and functional activation relevant to emotion processing.


title: MATLAB Scripts for RF Commissioning at the LANSCE LINAC

abstract: The linear accelerator (LINAC) at the Los Alamos Neu-tron Science Center (LANSCE) consists of Pre-buncher, Main-Buncher, low-energy beam transport (LEBT), four 201.25-MHz Drift Tube Linacs (DTLs) and forty-four 805-MHz Coupled Cavity Linacs (CCLs). As a part of the upcoming LANSCE Modernization project, low-level RF (LLRF) systems of four 201-MHz DTLs and twenty-six 805-MHz SCLs have been digitized. Hence the net-work-based control of the cavity field and RF commis-sioning are possible. Each LLRF and high-power RF (HPRF) systems have many process variables (PVs) lo-cated on different computer control screens provided by the Extensible Display Manager (EDM). Several MATLAB m-scripts have been developed to efficiently process the necessary PVs while auto-start, ampli-tude/phase calibration, gain tuning of the cavity field feedback controllers, gain and phase tuning of the beam feedforward controllers, and high power RF trip recovery, processes are configured and validated. This paper ad-dresses the sequence of RF commissioning of the LANSCE LINAC from the time of RF-turn-on to beam feedforward control and its relevant EDMs and MATLAB m-scripts.


title: Moment-Based Approach to the Flux-Tube linear Gyrokinetic Model

abstract: This work reports on the development and numerical implementation of the linear electromagnetic gyrokinetic (GK) model in a tokamak flux-tube geometry using a moment approach based on the expansion of the perturbed distribution function on a velocity-space Hermite-Laguerre polynomials basis. A hierarchy of equations of the expansion coefficients, referred to as the gyro-moments (GM), is derived. We verify the numerical implementation of the GM hierarchy in the collisionless limit by performing a comparison with the continuum GK code GENE, recovering the linear properties of the ion-temperature gradient, trapped electron, kinetic ballooning, and microtearing modes, as well as the collisionless damping of zonal flows. The present investigation reveals the ability of the GM approach to describe fine velocity-space scale structures appearing near the trapped and passing boundary and kinetic effects associated with parallel and perpendicular particle drifts. In addition, the effects of collisions are studied using advanced collision operators, including the GK Coulomb collision operator. The main findings are that the number of GMs necessary for convergence decreases with plasma collisionality and is lower for pressure gradient-driven modes, such as in H-mode pedestal regions, compared to instabilities driven by trapped particles and magnetic gradient drifts often found in the core. The accuracy of approximations often used to model collisions (relative to the GK Coulomb operator) is studied, showing differences between collision operator models that increase with collisionality and electron temperature gradient in the case of TEM. The present linear analysis demonstrates that the GM approach efficiently describes the plasma dynamics for typical parameters of the tokamak boundary, ranging from the low-collisionality banana H-mode to the high-collisionality Pfirsch-Schl\"uter conditions.


title: Finite-time singularity formations for the Landau-Lifshitz-Gilbert equation in dimension two

abstract: We construct finite time blow-up solutions to the Landau-Lifshitz-Gilbert equation (LLG) from ${\mathbb R}^2$ into $S^2$ \begin{equation*} \begin{cases} u_t= a(\Delta u+|\nabla u|^2u) -b u\wedge \Delta u &\ \mbox{ in }\ {\mathbb R}^2\times(0,T), u(\cdot,0) = u_0\in S^2 &\ \mbox{ in }\ {\mathbb R}^2, \end{cases} \end{equation*} where $a^2+b^2=1,~a > 0,~ b\in {\mathbb R}$. Given any prescribed $N$ points in $\mathbb{R}^2$ and small $T>0$, we prove that there exists regular initial data such that the solution blows up precisely at these points at finite time $t=T$, taking around each point the profile of sharply scaled degree 1 harmonic map with the type II blow-up speed \begin{equation*} \| \nabla u\|_{L^\infty } \sim \frac{|\ln(T-t)|^2}{ T-t } \ \mbox{ as } \ t\to T. \end{equation*} The proof is based on the {\em parabolic inner-outer gluing method}, developed in \cite{17HMF} for Harmonic Map Flow (HMF). However, a direct consequence of the presence of dispersion is the {\em lack of maximum principle} for suitable quantities, which makes the analysis more delicate even at the linearized level. To overcome this difficulty, we make use of two key technical ingredients: first, for the inner problem we employ the tool of {\em distorted Fourier transform}, as developed by Krieger, Miao, Schlag and Tataru \cite{Krieger09Duke,KMS20WM}. Second, the linear theory for the outer problem is achieved by means of the sub-Gaussian estimate for the fundamental solution of parabolic system in non-divergence form with coefficients of Dini mean oscillation in space ($\mathsf{DMO_x}$), which was proved by Dong, Kim and Lee \cite{dong22-non-divergence} recently.


title: Linkless Link Prediction via Relational Distillation

abstract: Graph Neural Networks (GNNs) have shown exceptional performance in the task of link prediction. Despite their effectiveness, the high latency brought by non-trivial neighborhood data dependency limits GNNs in practical deployments. Conversely, the known efficient MLPs are much less effective than GNNs due to the lack of relational knowledge. In this work, to combine the advantages of GNNs and MLPs, we start with exploring direct knowledge distillation (KD) methods for link prediction, i.e., predicted logit-based matching and node representation-based matching. Upon observing direct KD analogs do not perform well for link prediction, we propose a relational KD framework, Linkless Link Prediction (LLP), to distill knowledge for link prediction with MLPs. Unlike simple KD methods that match independent link logits or node representations, LLP distills relational knowledge that is centered around each (anchor) node to the student MLP. Specifically, we propose rank-based matching and distribution-based matching strategies that complement each other. Extensive experiments demonstrate that LLP boosts the link prediction performance of MLPs with significant margins, and even outperforms the teacher GNNs on 7 out of 8 benchmarks. LLP also achieves a 70.68x speedup in link prediction inference compared to GNNs on the large-scale OGB dataset.


title: A Cross-Validated Targeted Maximum Likelihood Estimator for Data-Adaptive Experiment Selection Applied to the Augmentation of RCT Control Arms with External Data

abstract: Augmenting the control arm of a randomized controlled trial (RCT) with external data may increase power at the risk of introducing bias. Existing data fusion estimators generally rely on stringent assumptions or may have decreased coverage or power in the presence of bias. Framing the problem as one of data-adaptive experiment selection, potential experiments include the RCT only or the RCT combined with different candidate real-world datasets. To select and analyze the experiment with the optimal bias-variance tradeoff, we develop a novel experiment-selector cross-validated targeted maximum likelihood estimator (ES-CVTMLE). The ES-CVTMLE uses two bias estimates: 1) a function of the difference in conditional mean outcome under control between the RCT and combined experiments and 2) an estimate of the average treatment effect on a negative control outcome (NCO). We define the asymptotic distribution of the ES-CVTMLE under varying magnitudes of bias and construct confidence intervals by Monte Carlo simulation. In simulations involving violations of identification assumptions, the ES-CVTMLE had better coverage than test-then-pool approaches and an NCO-based bias adjustment approach and higher power than one implementation of a Bayesian dynamic borrowing approach. We further demonstrate the ability of the ES-CVTMLE to distinguish biased from unbiased external controls through a re-analysis of the effect of liraglutide on glycemic control from the LEADER trial. The ES-CVTMLE has the potential to improve power while providing relatively robust inference for future hybrid RCT-RWD studies.


title: Disturbance Observer Application for the Compensation of the Phase Drift of the LANSCE DTL LINAC Solid State Power Amplifier

abstract: The front end of Los Alamos Neutron Science Center (LANSCE) linear accelerator uses four 201.25-MHz Drift-Tube Linacs (DTLs) to accelerate the H+ and H- beams to 100 MeV. Three of the 201.25-MHz DTLs are powered by diacrodes and the first DTL is powered by a tetrode. A 20-kW solid-state power amplifier (SSPA) is used to provide ~15 kW drive power to the tetrode. The SSPA is water-cooled and consists of 24 push-pull LDMOS transistors operating at 45% of their power saturation capability, providing ample power headroom and excellent linearity. However, the phase of the SSPA is perturbed at +/-20 degrees over a few ten minutes partially caused by the temperature dependent phase variation of the air-cooled SSPA driver circulator. This phase variation consumes most of the phase control margin of the cavity field feedback controller. In order to mitigate the effect of the SSPA phase variation on the cavity field, a disturbance observer controller (DOBC) has been designed and implemented on the cavity field control FPGA, which functions in parallel with the cavity field feedback controller. In this paper, the DOBC design and its function as well as its short- and long-term performance are addressed.


title: MRI-based Material Mass Density and Relative Stopping Power Estimation via Deep Learning for Proton Therapy

abstract: Magnetic Resonance Imaging (MRI) is increasingly incorporated into treatment planning, because of its superior soft tissue contrast used for tumor and soft tissue delineation versus computed tomography (CT). However, MRI cannot directly provide mass density or relative stopping power (RSP) maps required for proton radiotherapy dose calculation. To demonstrate the feasibility of MRI-only based mass density and RSP estimation using deep learning (DL) for proton radiotherapy. A DL-based framework was developed to discover underlying voxel-wise correlation between MR images and mass density and RSP. Five tissue substitute phantoms including skin, muscle, adipose, 45% hydroxyapatite (HA), and spongiosa bone were customized for MRI scanning based on material composition information from ICRP reports. Two animal tissue phantoms made of pig brain and liver were prepared for DL training. In the phantom study, two DL models were trained: one containing clinical T1 and T2 MRIs and another incorporating zero echo time (ZTE) MRIs as input. In the patient application study, two DL models were trained: one including T1 and T2 MRIs as input, and one incorporating synthetic dual-energy computed tomography (sDECT) images to provide bone tissue information. In the phantom study, DL model based on T1 and T2 MRI demonstrated higher accuracy mass density and RSP estimation in skin, muscle, adipose, brain, and liver with mean absolute percentage errors (MAPE) of 0.42%, 0.14%, 0.19%, 0.78% and 0.26% for mass density and 0.30%, 0.11%, 0.16%, 0.61% and 0.23% for RSP, respectively. DL model incorporating ZTE MRI improved the accuracy of mass density and RSP estimation in 45% HA and spongiosa bone with MAPE at 0.23% and 0.09% for mass density and 0.19% and 0.07% for RSP, respectively. Results show feasibility of MRI-only based mass density and RSP estimation for proton therapy treatment planning using DL method.


abstract: In recent years, a number of reinforcement learning (RL) methods have been proposed to explore complex environments which differ across episodes. In this work, we show that the effectiveness of these methods critically relies on a count-based episodic term in their exploration bonus. As a result, despite their success in relatively simple, noise-free settings, these methods fall short in more realistic scenarios where the state space is vast and prone to noise. To address this limitation, we introduce Exploration via Elliptical Episodic Bonuses (E3B), a new method which extends count-based episodic bonuses to continuous state spaces and encourages an agent to explore states that are diverse under a learned embedding within each episode. The embedding is learned using an inverse dynamics model in order to capture controllable aspects of the environment. Our method sets a new state-of-the-art across 16 challenging tasks from the MiniHack suite, without requiring task-specific inductive biases. E3B also matches existing methods on sparse reward, pixel-based VizDoom environments, and outperforms existing methods in reward-free exploration on Habitat, demonstrating that it can scale to high-dimensional pixel-based observations and realistic environments.


title: Little or no equalization is needed in energy-efficient sub-THz mobile access

abstract: By trading coverage and hardware complexity for abundance of spectrum, sub-THz mobile access networks are expected to operate under highly directive and relatively spectrally inefficient transmission regimes, while still offering enormous capacity gains over current sub-6GHz alternatives. Building on this assumption, and supported by extensive indoor directional channel measurements at 160 GHz, this study advocates the use of very simple modulation and equalization techniques for sub-THz mobile access. Specifically, we demonstrate that, under the aforementioned transmission regimes, little or no equalization is needed for scoring significant capacity gain targets. In particular, we show that single-carrier or low-number-of-subcarriers modulations are very attractive competitors to the dramatically more complex and energy inefficient traditional multi-carrier designs.


title: Solving Convex Smooth Function Constrained Optimization Is Almost As Easy As Unconstrained Optimization

abstract: Consider applying first-order methods to solve the smooth convex constrained optimization problem of the form $\min_{x \in X} F(x).$ For a simple closed convex set $X$ which is easy to project onto, Nesterov proposed the Accelerated Gradient Descent (AGD) method to solve the constrained problem as efficiently as an unconstrained problem in terms of the number of gradient computations of $F$ (i.e., oracle complexity). For a more complicated $\mathcal{X}$ described by function constraints, i.e., $\mathcal{X} = \{x \in X: g(x) \leq 0\}$, where the projection onto $\mathcal{X}$ is not possible, it is an open question whether the function constrained problem can be solved as efficiently as an unconstrained problem in terms of the number of gradient computations for $F$ and $g$. In this paper, we provide an affirmative answer to the question by proposing a single-loop Accelerated Constrained Gradient Descent (ACGD) method. The ACGD method modifies the AGD method by changing the descent step to a constrained descent step, which adds only a few linear constraints to the prox mapping. It enjoys almost the same oracle complexity as the optimal one for minimizing the optimal Lagrangian function, i.e., the Lagrangian multiplier $\lambda$ being fixed to the optimal multiplier $\lambda^*$. These upper oracle complexity bounds are shown to be unimprovable under a certain optimality regime with new lower oracle complexity bounds. To enhance its efficiency for large-scale problems with many function constraints, we introduce an ACGD with Sliding (ACGD-S) method which replaces the possibly computationally demanding constrained descent step with a sequence of basic matrix-vector multiplications. The ACGD-S method shares the same oracle complexity as the ACGD method, and its computation complexity, measured by the number of matrix-vector multiplications, is also unimprovable.


title: The Colibri Telescope Array for KBO Detection through Serendipitous Stellar Occultations: a Technical Description

abstract: We present the technical design, construction and testing of the Colibri telescope array at Elginfield Observatory near London, Ontario, Canada. Three 50-cm telescopes are arranged in a triangular array and are separated by 110-160 metres. During operation, they will monitor field stars at the intersections of the ecliptic and galactic plane for serendipitous stellar occultations (SSOs) by trans-Neptunian objects (TNOs). At a frame rate of 40 frames per second (fps), Fresnel diffraction in the occultation light curve can be resolved and, with coincident detections, be used to estimate basic properties of the occulting object. Using off-the-shelf components, the Colibri system streams imagery to disk at a rate of 1.5 GB/s for next-day processing by a custom occultation detection pipeline. The imaging system has been tested and is found to perform well, given the moderate site conditions. Limiting magnitudes at 40 fps are found to be about 12.1 (temporal SNR=5, visible light Gaia G band) with time-series standard deviations ranging from about 0.035 mag to >0.2 mag. SNR is observed to decrease linearly with magnitude for stars fainter than about G = 9.5 mag. Brighter than this limit, SNR is constant, suggesting that atmospheric scintillation is the dominant noise source. Astrometric solutions show errors typically less than approximately 0.3 pixels (0.8 arc seconds) without a need for high-order corrections.


title: Constraining Neutrinoless Double-Beta Decay Matrix Elements from Ab Initio Nuclear Theory

abstract: As experimental searches for neutrinoless double-beta ($0\nu\beta\beta$) decay are entering a new generation, with hopes to completely probe the inverted mass hierarchy, the need for reliable nuclear matrix elements, which govern the rate of this decay, is stronger than ever. Since a large discrepancy in results is typically found with nuclear modela, a large unknown still exists on the sensitivity of these experiments to the effective neutrino mass. We consider this problem from a first-principles perspective, using the ab initio valence-space in medium similarity renormalization group. In particular, we study correlations of the $0\nu\beta\beta$-decay matrix elements in $^{76}$Ge with other observables, such as the double Gamow-Teller giant resonance, from 34 input chiral interactions in an attempt to constrain our uncertainties and investigate the interaction dependence of the nuclear matrix element.


title: A unified model for continuous conditional video prediction

abstract: Different conditional video prediction tasks, like video future frame prediction and video frame interpolation, are normally solved by task-related models even though they share many common underlying characteristics. Furthermore, almost all conditional video prediction models can only achieve discrete prediction. In this paper, we propose a unified model that addresses these two issues at the same time. We show that conditional video prediction can be formulated as a neural process, which maps input spatio-temporal coordinates to target pixel values given context spatio-temporal coordinates and context pixel values. Specifically, we feed the implicit neural representation of coordinates and context pixel features into a Transformer-based non-autoregressive conditional video prediction model. Our task-specific models outperform previous work for video future frame prediction and video interpolation on multiple datasets. Importantly, the model is able to interpolate or predict with an arbitrary high frame rate, i.e., continuous prediction. Our source code is available at \url{https://npvp.github.io}.


title: Deep Counterfactual Estimation with Categorical Background Variables

abstract: Referred to as the third rung of the causal inference ladder, counterfactual queries typically ask the "What if ?" question retrospectively. The standard approach to estimate counterfactuals resides in using a structural equation model that accurately reflects the underlying data generating process. However, such models are seldom available in practice and one usually wishes to infer them from observational data alone. Unfortunately, the correct structural equation model is in general not identifiable from the observed factual distribution. Nevertheless, in this work, we show that under the assumption that the main latent contributors to the treatment responses are categorical, the counterfactuals can be still reliably predicted. Building upon this assumption, we introduce CounterFactual Query Prediction (CFQP), a novel method to infer counterfactuals from continuous observations when the background variables are categorical. We show that our method significantly outperforms previously available deep-learning-based counterfactual methods, both theoretically and empirically on time series and image data. Our code is available at https://github.com/edebrouwer/cfqp.


title: Cramer-Rao Lower Bound Optimization for Hidden Moving Target Sensing via Multi-IRS-Aided Radar

abstract: Intelligent reflecting surface (IRS) is a rapidly emerging paradigm to enable non-line-of-sight (NLoS) wireless transmission. In this paper, we focus on IRS-aided radar estimation performance of a moving hidden or NLoS target. Unlike prior works that employ a single IRS, we investigate this problem using multiple IRS platforms and assess the estimation performance by deriving the associated Cramer-Rao lower bound (CRLB). We then design Doppler-aware IRS phase shifts by minimizing the scalar A-optimality measure of the joint parameter CRLB matrix. The resulting optimization problem is non-convex, and is thus tackled via an alternating optimization framework. Numerical results demonstrate that the deployment of multiple IRS platforms with our proposed optimized phase shifts leads to a higher estimation accuracy compared to non-IRS and single-IRS alternatives.


title: Software Supply Chain Attribute Integrity (SCAI)

abstract: The Software Supply Chain Attribute Integrity, or SCAI (pronounced "sky"), specification proposes a data format for capturing functional attribute and integrity information about software artifacts and their supply chain. SCAI data can be associated with executable binaries, statically- or dynamically-linked libraries, software packages, container images, software toolchains, and compute environments. As such, SCAI is intended to be implemented as part of an existing software supply chain attestation framework by software development tools or services (e.g., builders, CI/CD pipelines, software analysis tools) seeking to capture more granular information about the attributes and behavior of the software artifacts they produce. That is, SCAI assumes that implementers will have appropriate processes and tooling in place for capturing other types of software supply chain metadata, which can be extended to add support for SCAI.


title: Data-driven construction of stochastic reduced dynamics encoded with non-Markovian features

abstract: One important problem in constructing the reduced dynamics of molecular systems is the accurate modeling of the non-Markovian behavior arising from the dynamics of unresolved variables. The main complication emerges from the lack of scale separations, where the reduced dynamics generally exhibits pronounced memory and non-white noise terms. We propose a data-driven approach to learn the reduced model of multi-dimensional resolved variables that faithfully retains the non-Markovian dynamics. Different from the common approaches based on the direct construction of the memory function, the present approach seeks a set of non-Markovian features that encode the history of the resolved variables, and establishes a joint learning of the extended Markovian dynamics in terms of both the resolved variables and these features. The training is based on matching the evolution of the correlation functions of the extended variables that can be directly obtained from the ones of the resolved variables. The constructed model essentially approximates the multi-dimensional generalized Langevin equation and ensures numerical stability without empirical treatment. We demonstrate the effectiveness of the method by constructing the reduced models of molecular systems in terms of both one-dimensional and four-dimensional resolved variables.


title: Underspecification in Scene Description-to-Depiction Tasks

abstract: Questions regarding implicitness, ambiguity and underspecification are crucial for understanding the task validity and ethical concerns of multimodal image+text systems, yet have received little attention to date. This position paper maps out a conceptual framework to address this gap, focusing on systems which generate images depicting scenes from scene descriptions. In doing so, we account for how texts and images convey meaning differently. We outline a set of core challenges concerning textual and visual ambiguity, as well as risks that may be amplified by ambiguous and underspecified elements. We propose and discuss strategies for addressing these challenges, including generating visually ambiguous images, and generating a set of diverse images.


title: Finding and Listing Front-door Adjustment Sets

abstract: Identifying the effects of new interventions from data is a significant challenge found across a wide range of the empirical sciences. A well-known strategy for identifying such effects is Pearl's front-door (FD) criterion (Pearl, 1995). The definition of the FD criterion is declarative, only allowing one to decide whether a specific set satisfies the criterion. In this paper, we present algorithms for finding and enumerating possible sets satisfying the FD criterion in a given causal diagram. These results are useful in facilitating the practical applications of the FD criterion for causal effects estimation and helping scientists to select estimands with desired properties, e.g., based on cost, feasibility of measurement, or statistical power.


title: Large deviations principle for sub-Riemannian random walks

abstract: We study large deviations for random walks on stratified (Carnot) Lie groups. For such groups, there is a natural collection of vectors which generates their Lie algebra, and we consider random walks with increments in only these directions. Under certain constraints on the distribution of the increments, we prove a large deviation principle for these random walks with a natural rate function adapted to the sub-Riemannian geometry of these spaces.


title: On bounded degree graphs with large size-Ramsey numbers

abstract: The size-Ramsey number $\hat r(G')$ of a graph $G'$ is defined as the smallest integer $m$ so that there exists a graph $G$ with $m$ edges such that every $2$-coloring of the edges of $G$ contains a monochromatic copy of $G'$. Answering a question of Beck, Rodl and Szemeredi showed that for every $n\geq 1$ there exists a graph $G'$ on $n$ vertices each of degree at most three, with the size-Ramsey number at least $cn\log^{\frac{1}{60}}n$ for a universal constant $c>0$. In this note we show that a modification of Rodl and Szemeredi's construction leads to a bound $\hat r(G')\geq cn\,\exp(c\sqrt{\log n})$.


title: Seed bank Cannings Graphs: How dormancy smoothes random genetic drift

abstract: In this article, we introduce a random (directed) graph model for the simultaneous forwards and backwards description of a rather broad class of Cannings models with a seed bank mechanism. This provides a simple tool to establish a sampling duality in the finite population size, and obtain a path-wise embedding of the forward frequency process and the backward ancestral process. Further, it allows the derivation of limit theorems that generalize celebrated results by M\"ohle to models with seed banks, and where it can be seen how the effect of seed banks affects the genealogies. The explicit graphical construction is a new tool to understand the subtle interplay of seed banks, reproduction and genetic drift in population genetics.


title: EFT for de Sitter Space

abstract: The physics of de Sitter space is essential to our understanding of our cosmological past, present, and future. It forms the foundation for the statistical predictions of inflation in terms of quantum vacuum fluctuations that are being tested with cosmic surveys. In addition, the current expansion of the universe is dominated by an apparently constant vacuum energy and we again find our universe described by a de Sitter epoch. Despite the success of our predictions for cosmological observables, conceptual questions of the nature of de Sitter abound and are exacerbated by technical challenges in quantum field theory and perturbative quantum gravity in curved backgrounds. In recent years, significant process has been made using effective field theory techniques to tame these breakdowns of perturbation theory. We will discuss how to understand the long-wavelength fluctuations produced by accelerating cosmological backgrounds and how to resolve both the UV and IR obstacles that arise. Divergences at long wavelengths are resummed by renormalization group (RG) flow in the EFT. For light scalar fields, the RG flow manifests itself as the stochastic inflation formalism. In single-field inflation, long-wavelength metric fluctuations are conserved outside the horizon to all-loop order, which can be understood easily in EFT terms from power counting and symmetries.


title: Short-term prediction of stream turbidity using surrogate data and a meta-model approach

abstract: Many water-quality monitoring programs aim to measure turbidity to help guide effective management of waterways and catchments, yet distributing turbidity sensors throughout networks is typically cost prohibitive. To this end, we built and compared the ability of dynamic regression (ARIMA), long short-term memory neural nets (LSTM), and generalized additive models (GAM) to forecast stream turbidity one step ahead, using surrogate data from relatively low-cost in-situ sensors and publicly available databases. We iteratively trialled combinations of four surrogate covariates (rainfall, water level, air temperature and total global solar exposure) selecting a final model for each type that minimised the corrected Akaike Information Criterion. Cross-validation using a rolling time-window indicated that ARIMA, which included the rainfall and water-level covariates only, produced the most accurate predictions, followed closely by GAM, which included all four covariates. We constructed a meta-model, trained on time-series features of turbidity, to take advantage of the strengths of each model over different time points and predict the best model (that with the lowest forecast error one-step prior) for each time step. The meta-model outperformed all other models, indicating that this methodology can yield high accuracy and may be a viable alternative to using measurements sourced directly from turbidity-sensors where costs prohibit their deployment and maintenance, and when predicting turbidity across the short term. Our findings also indicated that temperature and light-associated variables, for example underwater illuminance, may hold promise as cost-effective, high-frequency surrogates of turbidity, especially when combined with other covariates, like rainfall, that are typically measured at coarse levels of spatial resolution.


title: The Future of High Energy Physics Software and Computing

abstract: Software and Computing (S&C) are essential to all High Energy Physics (HEP) experiments and many theoretical studies. The size and complexity of S&C are now commensurate with that of experimental instruments, playing a critical role in experimental design, data acquisition/instrumental control, reconstruction, and analysis. Furthermore, S&C often plays a leading role in driving the precision of theoretical calculations and simulations. Within this central role in HEP, S&C has been immensely successful over the last decade. This report looks forward to the next decade and beyond, in the context of the 2021 Particle Physics Community Planning Exercise ("Snowmass") organized by the Division of Particles and Fields (DPF) of the American Physical Society.


title: On Interpolation by Functions in $\ell^p_A$

abstract: This work explores several aspects of interpolating sequences for $\ell^p_A$, the space of analytic functions on the unit disk with $p$-summable Maclaurin coefficients. Much of this work is communicated through a Carlesonian lens. We investigate various analogues of Gramian matrices, for which we show boundedness conditions are necessary and sufficient for interpolation, including a characterization of universal interpolating sequences in terms of Riesz systems. We also discuss weak separation, giving a characterization of such sequences using a generalization of the pseudohyperbolic metric. Lastly, we consider Carleson measures and embeddings.


title: Adapting Zeroth Order Algorithms for Comparison-Based Optimization

abstract: Comparison-Based Optimization (CBO) is an optimization paradigm that assumes only very limited access to the objective function f(x). Despite the growing relevance of CBO to real-world applications, this field has received little attention as compared to the adjacent field of Zeroth-Order Optimization (ZOO). In this work we propose a relatively simple method for converting ZOO algorithms to CBO algorithms, thus greatly enlarging the pool of known algorithms for CBO. Via PyCUTEst, we benchmarked these algorithms against a suite of unconstrained problems. We then used hyperparameter tuning to determine optimal values of the parameters of certain algorithms, and utilized visualization tools such as heat maps and line graphs for purposes of interpretation. All our code is available at https://github.com/ishaslavin/Comparison_Based_Optimization.


title: Controllable Radiance Fields for Dynamic Face Synthesis

abstract: Recent work on 3D-aware image synthesis has achieved compelling results using advances in neural rendering. However, 3D-aware synthesis of face dynamics hasn't received much attention. Here, we study how to explicitly control generative model synthesis of face dynamics exhibiting non-rigid motion (e.g., facial expression change), while simultaneously ensuring 3D-awareness. For this we propose a Controllable Radiance Field (CoRF): 1) Motion control is achieved by embedding motion features within the layered latent motion space of a style-based generator; 2) To ensure consistency of background, motion features and subject-specific attributes such as lighting, texture, shapes, albedo, and identity, a face parsing net, a head regressor and an identity encoder are incorporated. On head image/video data we show that CoRFs are 3D-aware while enabling editing of identity, viewing directions, and motion.


title: Moduli of curves on toric varieties and their stable cohomology

abstract: We prove that the cohomology of the moduli space of morphisms of a fixed finite degree from a smooth projective curve $C$ of genus $g$ to a complete simplicial toric variety $\mathbb{P}(\Sigma)$, denoted by the rational polyhedral fan $\Sigma$, stabilizes. As an arithmetic consequence we obtain a resolution of the Batyrev-Manin conjecture for toric varieties over global function fields in all but finitely many characteristics.


title: Patterned bilayer graphene as a tunable, strongly correlated system

abstract: Recent observations of superconductivity in Moire graphene have lead to an intense interest in that system, with subsequent studies revealing a more complex phase diagram including correlated insulators and ferromagnetic phases. Here we propose an alternate system, electrostatically patterned bilayer graphene (PBG), in which a supermodulation is induced via metallic gates rather than the moire effect. We show that, by varying either the gap or the modulation strength, bilayer graphene can be tuned into the strongly correlated regime. Further calculations show that this is not possible in monolayer graphene. We present a general technique for addressing Coulomb screening of the periodic potential and demonstrate that this system is experimentally feasible.


title: AMICO: Amodal Instance Composition

abstract: Image composition aims to blend multiple objects to form a harmonized image. Existing approaches often assume precisely segmented and intact objects. Such assumptions, however, are hard to satisfy in unconstrained scenarios. We present Amodal Instance Composition for compositing imperfect -- potentially incomplete and/or coarsely segmented -- objects onto a target image. We first develop object shape prediction and content completion modules to synthesize the amodal contents. We then propose a neural composition model to blend the objects seamlessly. Our primary technical novelty lies in using separate foreground/background representations and blending mask prediction to alleviate segmentation errors. Our results show state-of-the-art performance on public COCOA and KINS benchmarks and attain favorable visual results across diverse scenes. We demonstrate various image composition applications such as object insertion and de-occlusion.


title: Multi-scale Incoherent Electronic Transport Properties in Non-ideal CVD Graphene Devices

abstract: In this research work, roll-to-roll chemical vapor deposited graphene device electronic transport properties are benchmarked to elucidate and comprehend mobility degradation in the real-world commercial application of graphene devices. Multifarious device design morphology in the graphene and two-dimensional material with diverse background materials compositions and processing recipes incorporate various scattering sources in the devices. To understand the nature of mobility degradation in roll-to-roll chemical vapor deposited graphene production devices, we employed multi-scale, multi-physics bottom-up, non-equilibrium Green's function-based quantum transport formalism. In this framework, we numerically incorporate various scattering mechanisms to deduce the measurand mobility at the last stage of computation to observe various scattering potential impacts on the production device performance. We have analyzed the variation in transmission, electronic charge density, electrostatic Poisson potential, energy-resolved flux density, and current-voltage characteristics and inferred the Drude mobility with different scattering potentials in various graphene devices. These scattering mechanisms treat scattering potentials as the first-order phonon Dyson self-energy term in the third loop of the two-looped self-consistent Poisson-Non-equilibrium Green's function iteration. Furthermore, multiple scattering scenarios implemented through a generalized contact self-energy scattering calculation ascribe the effect of contact scattering to the graphene device in quasi-ballistic transport limit. In this scheme, the effect of all the physical scattering mechanisms is lumped into one energy uncertainty or scattering rate parameter to include in the device's contact self-energy interaction term bound by the upper limit of Heisenberg uncertainty for the interacting quantum charged particles.


title: First Principles Determination of the Potential-of-Zero-Charge in an Alumina-coated Aluminum/Water Interface Model for Corrosion Applications

abstract: The surfaces of most metals immersed in aqueous electrolytes have a several-nanometer-thick oxide/hydroxide surface layer. This gives rise to the existence of both metal|oxide and oxide|liquid electrotlyte interfaces, and makes it challenging to correlate atomic length-scale structures with electrochemical properties such the potential-of-zero-charge (PZC). The PZC value has been shown to be correlated the pitting onset potential for corrosion. In this work, we conduct large-scale Density Functional Theory and ab initio molecular dynamics to calculate the PZC of a Al(111)|gamma-Al(2)O(3)(110)|water double-interface model within the context of aluminum corrosion. By partitioning the multiple interfaces involved into binary components with additive contributions to the overall work function and voltage, we predict the PZC to be -1.53 V vs. SHE for this model. We also calculate the orbital energy levels of defects like oxygen vacancies in the oxide, which are critical parameters in theories associated with pitting corrosion. We predict that the Fermi level at the PZC lies above the impurity defect levels of the oxygen vacancies, which are therefore uncharged at the PZC. From the PZC estimate, we predict the voltage needed to create oxygen vacancies with net positive charges within a flat-band approximation.


title: Social-Group-Agnostic Word Embedding Debiasing via the Stereotype Content Model

abstract: Existing word embedding debiasing methods require social-group-specific word pairs (e.g., "man"-"woman") for each social attribute (e.g., gender), which cannot be used to mitigate bias for other social groups, making these methods impractical or costly to incorporate understudied social groups in debiasing. We propose that the Stereotype Content Model (SCM), a theoretical framework developed in social psychology for understanding the content of stereotypes, which structures stereotype content along two psychological dimensions - "warmth" and "competence" - can help debiasing efforts to become social-group-agnostic by capturing the underlying connection between bias and stereotypes. Using only pairs of terms for warmth (e.g., "genuine"-"fake") and competence (e.g.,"smart"-"stupid"), we perform debiasing with established methods and find that, across gender, race, and age, SCM-based debiasing performs comparably to group-specific debiasing


title: SaiT: Sparse Vision Transformers through Adaptive Token Pruning

abstract: While vision transformers have achieved impressive results, effectively and efficiently accelerating these models can further boost performances. In this work, we propose a dense/sparse training framework to obtain a unified model, enabling weight sharing across various token densities. Thus one model offers a range of accuracy and throughput tradeoffs for different applications. Besides, we introduce adaptive token pruning to optimize the patch token sparsity based on the input image. In addition, we investigate knowledge distillation to enhance token selection capability in early transformer modules. Sparse adaptive image Transformer (SaiT) offers varying levels of model acceleration by merely changing the token sparsity on the fly. Specifically, SaiT reduces the computation complexity (FLOPs) by 39% - 43% and increases the throughput by 67% - 91% with less than 0.5% accuracy loss for various vision transformer models. Meanwhile, the same model also provides the zero accuracy drop option by skipping the sparsification step. SaiT achieves better accuracy and computation tradeoffs than state-of-the-art transformer and convolutional models.


title: Parameter estimation of the homodyned K distribution based on neural networks and trainable fractional-order moments

abstract: Homodyned K (HK) distribution has been widely used to describe the scattering phenomena arising in various research fields, such as ultrasound imaging or optics. In this work, we propose a machine learning based approach to the estimation of the HK distribution parameters. We develop neural networks that can estimate the HK distribution parameters based on the signal-to-noise ratio, skewness and kurtosis calculated using fractional-order moments. Compared to the previous approaches, we consider the orders of the moments as trainable variables that can be optimized along with the network weights using the back-propagation algorithm. Networks are trained based on samples generated from the HK distribution. Obtained results demonstrate that the proposed method can be used to accurately estimate the HK distribution parameters.


title: Effectiveness of the Recent Advances in Capsule Networks

abstract: Convolutional neural networks (CNNs) have revolutionized the field of deep neural networks. However, recent research has shown that CNNs fail to generalize under various conditions and hence the idea of capsules was introduced in 2011, though the real surge of research started from 2017. In this paper, we present an overview of the recent advances in capsule architecture and routing mechanisms. In addition, we find that the relative focus in recent literature is on modifying routing procedure or architecture as a whole but the study of other finer components, specifically, squash function is wanting. Thus, we also present some new insights regarding the effect of squash functions in performance of the capsule networks. Finally, we conclude by discussing and proposing possible opportunities in the field of capsule networks.


title: Synthetic Power Analyses: Empirical Evaluation and Application to Cognitive Neuroimaging

abstract: In the experimental sciences, statistical power analyses are often used before data collection to determine the required sample size. However, traditional power analyses can be costly when data are difficult or expensive to collect. We propose synthetic power analyses; a framework for estimating statistical power at various sample sizes, and empirically explore the performance of synthetic power analysis for sample size selection in cognitive neuroscience experiments. To this end, brain imaging data is synthesized using an implicit generative model conditioned on observed cognitive processes. Further, we propose a simple procedure to modify the statistical tests which result in conservative statistics. Our empirical results suggest that synthetic power analysis could be a low-cost alternative to pilot data collection when the proposed experiments share cognitive processes with previously conducted experiments.


title: CLIP also Understands Text: Prompting CLIP for Phrase Understanding

abstract: Contrastive Language-Image Pretraining (CLIP) efficiently learns visual concepts by pre-training with natural language supervision. CLIP and its visual encoder have been explored on various vision and language tasks and achieve strong zero-shot or transfer learning performance. However, the application of its text encoder solely for text understanding has been less explored. In this paper, we find that the text encoder of CLIP actually demonstrates strong ability for phrase understanding, and can even significantly outperform popular language models such as BERT with a properly designed prompt. Extensive experiments validate the effectiveness of our method across different datasets and domains on entity clustering and entity set expansion tasks.


title: A composable machine-learning approach for steady-state simulations on high-resolution grids

abstract: In this paper we show that our Machine Learning (ML) approach, CoMLSim (Composable Machine Learning Simulator), can simulate PDEs on highly-resolved grids with higher accuracy and generalization to out-of-distribution source terms and geometries than traditional ML baselines. Our unique approach combines key principles of traditional PDE solvers with local-learning and low-dimensional manifold techniques to iteratively simulate PDEs on large computational domains. The proposed approach is validated on more than 5 steady-state PDEs across different PDE conditions on highly-resolved grids and comparisons are made with the commercial solver, Ansys Fluent as well as 4 other state-of-the-art ML methods. The numerical experiments show that our approach outperforms ML baselines in terms of 1) accuracy across quantitative metrics and 2) generalization to out-of-distribution conditions as well as domain sizes. Additionally, we provide results for a large number of ablations experiments conducted to highlight components of our approach that strongly influence the results. We conclude that our local-learning and iterative-inferencing approach reduces the challenge of generalization that most ML models face.


title: Pontryagin Duality for Modules over Compact Discrete Valuation Rings

abstract: We establish an analogue of Pontryagin duality for modules over compact discrete valuation rings $R$. Namely, we define the dual of a topological $R$ module to be its continuous $R$-module homomorphisms into $K/R$, the quotient module of the fraction field by its ring of integers. It is established that for locally compact $R$-modules the double dual map is an isomorphism and homeomorphism. Additionally, given a non-topological $R$-module a canonical topology is constructed, uniquely defined so that the double dual map will be injective and continuous. Finally, the functor assigning a module to itself equipped with canonical topology is shown to be fully faithful, allowing one to recontextualize the topological statements in purely algebraic forms.


title: SEAL : Interactive Tool for Systematic Error Analysis and Labeling

abstract: With the advent of Transformers, large language models (LLMs) have saturated well-known NLP benchmarks and leaderboards with high aggregate performance. However, many times these models systematically fail on tail data or rare groups not obvious in aggregate evaluation. Identifying such problematic data groups is even more challenging when there are no explicit labels (e.g., ethnicity, gender, etc.) and further compounded for NLP datasets due to the lack of visual features to characterize failure modes (e.g., Asian males, animals indoors, waterbirds on land, etc.). This paper introduces an interactive Systematic Error Analysis and Labeling (\seal) tool that uses a two-step approach to first identify high error slices of data and then, in the second step, introduce methods to give human-understandable semantics to those underperforming slices. We explore a variety of methods for coming up with coherent semantics for the error groups using language models for semantic labeling and a text-to-image model for generating visual features. SEAL toolkit and demo screencast is available at https://huggingface.co/spaces/nazneen/seal.


title: LiveSeg: Unsupervised Multimodal Temporal Segmentation of Long Livestream Videos

abstract: Livestream videos have become a significant part of online learning, where design, digital marketing, creative painting, and other skills are taught by experienced experts in the sessions, making them valuable materials. However, Livestream tutorial videos are usually hours long, recorded, and uploaded to the Internet directly after the live sessions, making it hard for other people to catch up quickly. An outline will be a beneficial solution, which requires the video to be temporally segmented according to topics. In this work, we introduced a large Livestream video dataset named MultiLive, and formulated the temporal segmentation of the long Livestream videos (TSLLV) task. We propose LiveSeg, an unsupervised Livestream video temporal Segmentation solution, which takes advantage of multimodal features from different domains. Our method achieved a $16.8\%$ F1-score performance improvement compared with the state-of-the-art method.


title: Towards Optimal Primary- and Secondary-control Design for Networks with Generators and Inverters

abstract: For power grids predominantly featuring large synchronous generators (SGs), there exists a significant body of work bridging optimization and control tasks. A generic workflow in such efforts entails: characterizing the steady state of control algorithms and SG dynamics; assessing the optimality of the resulting operating point with respect to an optimal dispatch task; and prescribing control parameters to ensure that (under reasonable ambient perturbations) the considered control nudges the system steady state to optimality. Well studied instances of the aforementioned approach include designing: i) automatic generation control (AGC) participation factors to ensure economic optimality, and ii) governor frequency-droop slopes to ensure power sharing. Recognizing that future power grids will feature a diverse mix of SGs and inverter-based resources (IBRs) with varying control structures, this work examines the different steps of the optimization-control workflow for this context. Considering a representative model of active power-frequency dynamics of IBRs and SGs, a characterization of steady state is put forth (with and without secondary frequency control). Conditions on active-power droop slopes and AGC participation factors are then derived to ascertain desired power sharing and ensure economically optimal operation under varying power demands.


title: Testing the mean field theory of scalar field dark matter

abstract: Scalar field dark matter offers an interesting alternative to the traditional WIMP dark matter picture. Astrophysical and cosmological simulations are useful to constraining the mass of the dark matter particle in this model. This is particularly true at low mass where the wavelike nature of the dark matter particle manifests on astrophysical scales. These simulations typical use a classical field approximation. In this work, we look at extending these simulations to include quantum corrections. We look into both the ways in which large corrections impact the predictions of scalar field dark matter, and the timescales on which these corrections grow large. Corrections tend to lessen density fluctuations and increase the effect of "quantum pressure". During collapse, these corrections grow exponentially, quantum corrections would become important in about ~30 dynamical times. This implies that the predictions of classical field simulations may differ from those with quantum corrections for systems with short dynamical times.


title: Cross-dataset COVID-19 Transfer Learning with Cough Detection, Cough Segmentation, and Data Augmentation

abstract: This paper addresses issues on cough-based COVID-19 detection. We propose a cross-dataset transfer learning approach to improve the performance of COVID-19 detection by incorporating cough detection, cough segmentation, and data augmentation. The first aimed at removing non-cough signals and cough signals with low probability. The second aimed at segregating several coughs in a waveform into individual coughs. The third aimed at increasing the number of samples for the deep learning model. These three processing blocks are important as our finding revealed a large margin of improvement relative to the baseline methods without these blocks. An ablation study is conducted to optimize hyperparameters and it was found that alpha mixup is an important factor among others in improving the model performance via this augmentation method. A summary of this study with previous studies on the same evaluation set was given to gain insights into different methods of cough-based COVID-19 detection.


title: SegViT: Semantic Segmentation with Plain Vision Transformers

abstract: We explore the capability of plain Vision Transformers (ViTs) for semantic segmentation and propose the SegVit. Previous ViT-based segmentation networks usually learn a pixel-level representation from the output of the ViT. Differently, we make use of the fundamental component -- attention mechanism, to generate masks for semantic segmentation. Specifically, we propose the Attention-to-Mask (ATM) module, in which the similarity maps between a set of learnable class tokens and the spatial feature maps are transferred to the segmentation masks. Experiments show that our proposed SegVit using the ATM module outperforms its counterparts using the plain ViT backbone on the ADE20K dataset and achieves new state-of-the-art performance on COCO-Stuff-10K and PASCAL-Context datasets. Furthermore, to reduce the computational cost of the ViT backbone, we propose query-based down-sampling (QD) and query-based up-sampling (QU) to build a Shrunk structure. With the proposed Shrunk structure, the model can save up to $40\%$ computations while maintaining competitive performance.


title: Contrastive Retrospection: honing in on critical steps for rapid learning and generalization in RL

abstract: In real life, success is often contingent upon multiple critical steps that are distant in time from each other and from the final reward. These critical steps are challenging to identify with traditional reinforcement learning (RL) methods that rely on the Bellman equation for credit assignment. Here, we present a new RL algorithm that uses offline contrastive learning to hone in on these critical steps. This algorithm, which we call Contrastive Retrospection (ConSpec), can be added to any existing RL algorithm. ConSpec learns a set of prototypes for the critical steps in a task by a novel contrastive loss and delivers an intrinsic reward when the current state matches one of the prototypes. The prototypes in ConSpec provide two key benefits for credit assignment: (i) They enable rapid identification of all the critical steps. (ii) They do so in a readily interpretable manner, enabling out-of-distribution generalization when sensory features are altered. Distinct from other contemporary RL approaches to credit assignment, ConSpec takes advantage of the fact that it is easier to retrospectively identify the small set of steps that success is contingent upon (and ignoring other states) than it is to prospectively predict reward at every taken step. ConSpec greatly improves learning in a diverse set of RL tasks. The code is available at the link: https://github.com/sunchipsster1/ConSpec


title: FasterRisk: Fast and Accurate Interpretable Risk Scores

abstract: Over the last century, risk scores have been the most popular form of predictive model used in healthcare and criminal justice. Risk scores are sparse linear models with integer coefficients; often these models can be memorized or placed on an index card. Typically, risk scores have been created either without data or by rounding logistic regression coefficients, but these methods do not reliably produce high-quality risk scores. Recent work used mathematical programming, which is computationally slow. We introduce an approach for efficiently producing a collection of high-quality risk scores learned from data. Specifically, our approach produces a pool of almost-optimal sparse continuous solutions, each with a different support set, using a beam-search algorithm. Each of these continuous solutions is transformed into a separate risk score through a "star ray" search, where a range of multipliers are considered before rounding the coefficients sequentially to maintain low logistic loss. Our algorithm returns all of these high-quality risk scores for the user to consider. This method completes within minutes and can be valuable in a broad variety of applications.


title: Experimental Evaluation of Baselines for Forecasting Social Media Timeseries

abstract: Forecasting social media activity can be of practical use in many scenarios, from understanding trends, such as which topics are likely to engage more users in the coming week, to identifying unusual behavior, such as coordinated information operations or PumpNDump efforts. To evaluate a new approach to forecasting, it is important to have baselines against which to assess performance gains. We experimentally evaluate the performance of four baselines for forecasting activity in several social media datasets that record discussions related to three different geo-political contexts synchronously taking place on two different platforms, Twitter and YouTube. Experiments are done over hourly time periods. Our evaluation identifies the baselines which are most accurate for particular metrics and thus provide guidance for future work in social media modeling.


title: Shortcut to synchronization in classical and quantum systems

abstract: Synchronization is a major concept in nonlinear physics. In a large number of systems, it is observed at long times for a sinusoidal excitation. In this paper, we design a transiently non-sinusoidal driving to reach the synchronization regime more quickly. We exemplify an inverse engineering method to solve this issue on the classical Van der Pol oscillator. This approach cannot be directly transposed to the quantum case as the system is no longer point-like in phase space. We explain how to adapt our method by an iterative procedure to account for the finite-size quantum distribution in phase space. We show that the resulting driving yields a density matrix close to the synchronized one according to the trace distance. Our method provides an example of fast control of a nonlinear quantum system, and raises the question of the quantum speed limit concept in the presence of nonlinearities.