title: TalkToModel: Explaining Machine Learning Models with Interactive Natural Language Conversations

abstract: Machine Learning (ML) models are increasingly used to make critical decisions in real-world applications, yet they have become more complex, making them harder to understand. To this end, researchers have proposed several techniques to explain model predictions. However, practitioners struggle to use these explainability techniques because they often do not know which one to choose and how to interpret the results of the explanations. In this work, we address these challenges by introducing TalkToModel: an interactive dialogue system for explaining machine learning models through conversations. Specifically, TalkToModel comprises of three key components: 1) a natural language interface for engaging in conversations, making ML model explainability highly accessible, 2) a dialogue engine that adapts to any tabular model and dataset, interprets natural language, maps it to appropriate explanations, and generates text responses, and 3) an execution component that constructs the explanations. We carried out extensive quantitative and human subject evaluations of TalkToModel. Overall, we found the conversational system understands user inputs on novel datasets and models with high accuracy, demonstrating the system's capacity to generalize to new situations. In real-world evaluations with humans, 73% of healthcare workers (e.g., doctors and nurses) agreed they would use TalkToModel over baseline point-and-click systems for explainability in a disease prediction task, and 85% of ML professionals agreed TalkToModel was easier to use for computing explanations. Our findings demonstrate that TalkToModel is more effective for model explainability than existing systems, introducing a new category of explainability tools for practitioners. Code & demo released here: https://github.com/dylan-slack/TalkToModel.


title: Copper migration and surface oxidation of $\text{Cu}_{x}\text{Bi}_2\text{Se}_3$ in ambient pressure environments

abstract: Chemical modifications such as intercalation can be used to modify surface properties or to further functionalize the surface states of topological insulators. Using ambient pressure X-ray photoelectron spectroscopy, we report copper migration in $\text{Cu}_{x}\text{Bi}_2\text{Se}_3$, which occurs on a timescale of hours to days after initial surface cleaving. The increase in near-surface copper proceeds along with the oxidation of the sample surface and large changes in the selenium content. These complex changes are further modelled with core-level spectroscopy simulations, which suggest a composition gradient near the surface which develops with oxygen exposure. Our results shed light on a new phenomenon that must be considered for intercalated topological insulators$\unicode{x2014}$and intercalated materials in general$\unicode{x2014}$that surface chemical composition can change when specimens are exposed to ambient conditions.


title: Automated Audio Captioning and Language-Based Audio Retrieval

abstract: This project involved participation in the DCASE 2022 Competition (Task 6) which had two subtasks: (1) Automated Audio Captioning and (2) Language-Based Audio Retrieval. The first subtask involved the generation of a textual description for audio samples, while the goal of the second was to find audio samples within a fixed dataset that match a given description. For both subtasks, the Clotho dataset was used. The models were evaluated on BLEU1, BLEU2, BLEU3, ROUGEL, METEOR, CIDEr, SPICE, and SPIDEr scores for audio captioning and R1, R5, R10 and mARP10 scores for audio retrieval. We have conducted a handful of experiments that modify the baseline models for these tasks. Our final architecture for Automated Audio Captioning is close to the baseline performance, while our model for Language-Based Audio Retrieval has surpassed its counterpart.


title: Machine learning the trilinear and light-quark Yukawa couplings from Higgs pair kinematic shapes

abstract: Revealing the Higgs pair production process is the next big challenge in high energy physics. In this work, we explore the use of interpretable machine learning and cooperative game theory for extraction of the trilinear Higgs self-coupling in Higgs pair production. In particular, we show how a topological decomposition of the gluon-gluon fusion Higgs pair production process can be used to simplify the machine learning analysis flow. Furthermore, we extend the analysis to include $q\bar{q}\to hh$ production, which is strongly suppressed in the Standard Model, to extract the trilinear Higgs coupling and to bound large deviations of the light-quark Yukawa couplings from the Standard Model values. The constraints on the rescaling of the trilinear Higgs self-coupling, $\kappa_\lambda$, and the rescaling of light-quark Yukawa couplings, $\kappa_u$ and $\kappa_d$, at HL-LHC (FCC-hh) from single parameter fits are: \begin{eqnarray} \kappa_\lambda&=&[0.53,1.7] \;\;([0.97, 1.03])\nonumber \newline \kappa_u&=&[-470,430] \;\;([-58,55])\nonumber \newline \kappa_d&=&[-360,360] \;\;([-26,28])\nonumber \end{eqnarray} We show that the simultaneous modification of the Yukawa couplings can dilute the constraints on the trilinear coupling significantly. We perform similar analyses for FCC-hh. We discuss some motivated flavourful new physics scenarios where such an analysis prevails.


title: A Survey of Task-Based Machine Learning Content Extraction Services for VIDINT

abstract: This paper provides a comparison of current video content extraction tools with a focus on comparing commercial task-based machine learning services. Video intelligence (VIDINT) data has become a critical intelligence source in the past decade. The need for AI-based analytics and automation tools to extract and structure content from video has quickly become a priority for organizations needing to search, analyze and exploit video at scale. With rapid growth in machine learning technology, the maturity of machine transcription, machine translation, topic tagging, and object recognition tasks are improving at an exponential rate, breaking performance records in speed and accuracy as new applications evolve. Each section of this paper reviews and compares products, software resources and video analytics capabilities based on tasks relevant to extracting information from video with machine learning techniques.


title: The SPEC-RG Reference Architecture for the Compute Continuum

abstract: As the next generation of diverse workloads like autonomous driving and augmented/virtual reality evolves, computation is shifting from cloud-based services to the edge, leading to the emergence of a cloud-edge compute continuum. This continuum promises a wide spectrum of deployment opportunities for workloads that can leverage the strengths of cloud (scalable infrastructure, high reliability) and edge (energy efficient, low latencies). Despite its promises, the continuum has only been studied in silos of various computing models, thus lacking strong end-to-end theoretical and engineering foundations for computing and resource management across the continuum. Consequently, developers resort to ad hoc approaches to reason about performance and resource utilization of workloads in the continuum. In this work, we conduct a first-of-its-kind systematic study of various computing models, identify salient properties, and make a case to unify them under a compute continuum reference architecture. This architecture provides an end-to-end analysis framework for developers to reason about resource management, workload distribution, and performance analysis. We demonstrate the utility of the reference architecture by analyzing two popular continuum workloads, deep learning and industrial IoT. We have developed an accompanying deployment and benchmarking framework and first-order analytical model for quantitative reasoning of continuum workloads. The framework is open-sourced and available at https://github.com/atlarge-research/continuum.


title: Nuclear cusps and singularities in the non-additive kinetic potential bi-functional from analytical inversion

abstract: The non-additive kinetic potential $v^{\text{NAD}}$ is a key quantity in density-functional theory (DFT) embedding methods, such as frozen density embedding theory and partition DFT. $v^{\text{NAD}}$ is a bi-functional of electron densities $\rho_{\rm B}$ and $\rho_{\rm tot} = \rho_{\rm A} + \rho_{\rm B}$. It can be evaluated using approximate kinetic-energy functionals, but accurate approximations are challenging. The behavior of $v^{\text{NAD}}$ in the vicinity of the nuclei has long been questioned, and singularities were seen in some approximate calculations. In this article, the existence of singularities in $v^{\text{NAD}}$ is analyzed analytically for various choices of $\rho_{\rm B}$ and $\rho_{\rm tot}$, using the nuclear cusp conditions for the density and Kohn-Sham potential. It is shown that no singularities arise from smoothly partitioned ground-state Kohn-Sham densities. We confirm this result by numerical calculations on diatomic test systems HeHe, HeLi$^+$, and H$_2$, using analytical inversion to obtain a numerically exact $v^{\rm NAD}$ for the local density approximation. We examine features of $v^{\rm NAD}$ which can be used for development and testing of approximations to $v^{\rm NAD}[\rho_{\rm B},\rho_{\rm tot}]$ and kinetic-energy functionals.


title: Few 'Zero Level Set'-Shot Learning of Shape Signed Distance Functions in Feature Space

abstract: We explore a new idea for learning based shape reconstruction from a point cloud, based on the recently popularized implicit neural shape representations. We cast the problem as a few-shot learning of implicit neural signed distance functions in feature space, that we approach using gradient based meta-learning. We use a convolutional encoder to build a feature space given the input point cloud. An implicit decoder learns to predict signed distance values given points represented in this feature space. Setting the input point cloud, i.e. samples from the target shape function's zero level set, as the support (i.e. context) in few-shot learning terms, we train the decoder such that it can adapt its weights to the underlying shape of this context with a few (5) tuning steps. We thus combine two types of implicit neural network conditioning mechanisms simultaneously for the first time, namely feature encoding and meta-learning. Our numerical and qualitative evaluation shows that in the context of implicit reconstruction from a sparse point cloud, our proposed strategy, i.e. meta-learning in feature space, outperforms existing alternatives, namely standard supervised learning in feature space, and meta-learning in euclidean space, while still providing fast inference.


title: Long and short time laws of iterated logarithms for the KPZ fixed point

abstract: We consider the KPZ fixed point starting from a general class of initial data. In this article, we study the growth of the large peaks of the KPZ fixed point at a spatial point $0$ when time $t$ goes to $\infty$ and when $t$ approaches $1$. We prove that for a very broad class of initial data, as $t\to \infty$, the limsup of the KPZ fixed point height function when scaled by $t^{1/3}(\log\log t)^{2/3}$ almost surely equals a constant. The value of the constant is $(3/4)^{2/3}$ or $(3/2)^{2/3}$ depending on the initial data being non-random or Brownian respectively. Furthermore, we show that the increments of the KPZ fixed point near $t=1$ admits a short time law of iterated logarithm. More precisely, as the time increments $\Delta t :=t-1$ goes down to $0$, for a large class of initial data including the Brownian data initial data, we show that limsup of the height increments the KPZ fixed point near time $1$ when scaled by $(\Delta t)^{1/3}(\log\log (\Delta t)^{-1})^{2/3}$ almost surely equals $(3/2)^{2/3}$.


title: Optimizing Bipedal Maneuvers of Single Rigid-Body Models for Reinforcement Learning

abstract: In this work, we propose a method to generate reduced-order model reference trajectories for general classes of highly dynamic maneuvers for bipedal robots for use in sim-to-real reinforcement learning. Our approach is to utilize a single rigid-body model (SRBM) to optimize libraries of trajectories offline to be used as expert references in the reward function of a learned policy. This method translates the model's dynamically rich rotational and translational behaviour to a full-order robot model and successfully transfers to real hardware. The SRBM's simplicity allows for fast iteration and refinement of behaviors, while the robustness of learning-based controllers allows for highly dynamic motions to be transferred to hardware. % Within this work we introduce a set of transferability constraints that amend the SRBM dynamics to actual bipedal robot hardware, our framework for creating optimal trajectories for dynamic stepping, turning maneuvers and jumps as well as our approach to integrating reference trajectories to a reinforcement learning policy. Within this work we introduce a set of transferability constraints that amend the SRBM dynamics to actual bipedal robot hardware, our framework for creating optimal trajectories for a variety of highly dynamic maneuvers as well as our approach to integrating reference trajectories for a high-speed running reinforcement learning policy. We validate our methods on the bipedal robot Cassie on which we were successfully able to demonstrate highly dynamic grounded running gaits up to 3.0 m/s.


title: Predictions for Observable Atmospheres of Trappist-1 Planets from a Fully Coupled Atmosphere-Interior Evolution Model

abstract: The Trappist-1 planets provide a unique opportunity to test the current understanding of rocky planet evolution. The James Webb Space Telescope is expected to characterize the atmospheres of these planets, potentially detecting CO$_2$, CO, H$_2$O, CH$_4$, or abiotic O$_2$ from water photodissociation and subsequent hydrogen escape. Here, we apply a coupled atmosphere-interior evolution model to the Trappist-1 planets to anticipate their modern atmospheres. This model, which has previously been validated for Earth and Venus, connects magma ocean crystallization to temperate geochemical cycling. Mantle convection, magmatic outgassing, atmospheric escape, crustal oxidation, a radiative-convective climate model, and deep volatile cycling are explicitly coupled to anticipate bulk atmospheres and planetary redox evolution over 8 Gyr. By adopting a Monte Carlo approach that samples a broad range of initial conditions and unknown parameters, we make some tentative predictions about current Trappist-1 atmospheres. We find that anoxic atmospheres are probable, but not guaranteed, for the outer planets; oxygen produced via hydrogen loss during the pre-main sequence is typically consumed by crustal sinks. In contrast, oxygen accumulation on the inner planets occurs in around half of all models runs. Complete atmospheric erosion is possible but not assured for the inner planets (occurs in 20%-50% of model runs), whereas the outer planets retain significant surface volatiles in virtually all model simulations. For all planets that retain substantial atmospheres, CO$_2$-dominated or CO$_2$-O$_2$ atmospheres are expected; water vapor is unlikely to be a detectable atmospheric constituent in most cases. There are necessarily many caveats to these predictions, but the ways in which they misalign with upcoming observations will highlight gaps in terrestrial planet knowledge.


title: Extracting Replayable Interactions from Videos of Mobile App Usage

abstract: Screen recordings of mobile apps are a popular and readily available way for users to share how they interact with apps, such as in online tutorial videos, user reviews, or as attachments in bug reports. Unfortunately, both people and systems can find it difficult to reproduce touch-driven interactions from video pixel data alone. In this paper, we introduce an approach to extract and replay user interactions in videos of mobile apps, using only pixel information in video frames. To identify interactions, we apply heuristic-based image processing and convolutional deep learning to segment screen recordings, classify the interaction in each segment, and locate the interaction point. To replay interactions on another device, we match elements on app screens using UI element detection. We evaluate the feasibility of our pixel-based approach using two datasets: the Rico mobile app dataset and a new dataset of 64 apps with both iOS and Android versions. We find that our end-to-end approach can successfully replay a majority of interactions (iOS--84.1%, Android--78.4%) on different devices, which is a step towards supporting a variety of scenarios, including automatically annotating interactions in existing videos, automated UI testing, and creating interactive app tutorials.


title: Variational Mixtures of ODEs for Inferring Cellular Gene Expression Dynamics

abstract: A key problem in computational biology is discovering the gene expression changes that regulate cell fate transitions, in which one cell type turns into another. However, each individual cell cannot be tracked longitudinally, and cells at the same point in real time may be at different stages of the transition process. This can be viewed as a problem of learning the behavior of a dynamical system from observations whose times are unknown. Additionally, a single progenitor cell type often bifurcates into multiple child cell types, further complicating the problem of modeling the dynamics. To address this problem, we developed an approach called variational mixtures of ordinary differential equations. By using a simple family of ODEs informed by the biochemistry of gene expression to constrain the likelihood of a deep generative model, we can simultaneously infer the latent time and latent state of each cell and predict its future gene expression state. The model can be interpreted as a mixture of ODEs whose parameters vary continuously across a latent space of cell states. Our approach dramatically improves data fit, latent time inference, and future cell state estimation of single-cell gene expression data compared to previous approaches.


title: Systematic analysis of strange single heavy baryons $\Xi_{c}$ and $\Xi_{b}$

abstract: Motivated by the experimental progress in the study of heavy baryons, we investigate the mass spectra of strange single heavy baryons in the $\lambda$-mode, where the relativistic quark model and the infinitesimally shifted Gaussian basis function method are employed. It is shown that the experimental data can be well reproduced by the predicted masses. The root mean square radii and radial probability density distributions of the wave functions are analyzed in detail. Meanwhile, the mass spectra allow us to successfully construct the Regge trajectories in the $(J,M^{2})$ plane. We also preliminarily assign quantum numbers to the recently observed baryons, including $\Xi_{c}(3055)$, $\Xi_{c}(3080)$, $\Xi_{c}(2930)$, $\Xi_{c}(2923)$, $\Xi_{c}(2939)$, $\Xi_{c}(2965)$, $\Xi_{c}(2970)$, $\Xi_{c}(3123)$, $\Xi_{b}(6100)$, $\Xi_{b}(6227)$, $\Xi_{b}(6327)$ and $\Xi_{b}(6333)$. At last, the spectral structure of the strange single heavy baryons is shown. Accordingly, we predict several new baryons that might be observed in forthcoming experiments.


title: Coexistence of in-plane and out-of-plane exchange Bias in correlated kagome antiferromagnet Mn3- xCrxSn

abstract: The materials exhibiting exchange bias (EB) have been extensively investigated mainly due to their great technological applications in magnetic sensors, but its underlying mechanism remains elusive. Here we report the novel coexistence of in-plane and out-of-plane EB in the Cr-doped Mn3Sn, a non-colinear antiferromagnet with a geometrically frustrated Kagome plane of Mn. Field-cooling experiments with the applied field parallel and perpendicular to the frustrated Kagome plane exhibits loop shifts and enhanced coercivities. Interestingly, a maximum EB field of 1090 Oe is observed along out-of-plane direction in the Mn2.58Cr0.42Sn sample, higher than that of in-plane value. Our results indicate that the exchange bias along perpendicular kagome plane is primarily induced by Dzyaloshinskii-Moriya interactions due to the breaking of interfacial symmetry, while the EB along kagome plane is due to the exchange effects at interface of AFM and FM component originating from the net moment. These findings provide a new insight on EB in the kagome AFM materials, which are important and highly potential to the application of antiferromagnetic spintronics.


title: Extending density functional theory with near chemical accuracy beyond pure water

abstract: Density functional simulations of condensed phase water are typically inaccurate, due to the inaccuracies of approximate functionals. A recent breakthrough showed that the SCAN approximation can yield chemical accuracy for pure water in all its phases, but only when its density is corrected. This is a crucial step toward first-principles biosimulations. However, weak dispersion forces are ubiquitous and play a key role in noncovalent interactions among biomolecules, but are not included in the new approach. Moreover, na\"ive inclusion of dispersion in HF-SCAN ruins its high accuracy for pure water. Systematic application of the principles of density-corrected DFT yields a functional (HF-r$^2$SCAN-DC4) which recovers and not only improves over HF-SCAN for pure water, but also captures vital noncovalent interactions in biomolecules, making it suitable for simulations of solutions.


title: Spanning trees with at most $5$ leaves and branch vertices in total of $K_{1,5}$-free graphs

abstract: In this paper, we prove that every $n$-vertex connected $K_{1,5}$-free graph $G$ with $\sigma_4(G)\geq n-1$ contains a spanning tree with at most $5$ leaves and branch vertices in total. Moreover, the degree sum condition "$\sigma_4(G)\geq n-1$" is best possible.


title: A Systematic Review and Thematic Analysis of Community-Collaborative Approaches to Computing Research

abstract: HCI researchers have been gradually shifting attention from individual users to communities when engaging in research, design, and system development. However, our field has yet to establish a cohesive, systematic understanding of the challenges, benefits, and commitments of community-collaborative approaches to research. We conducted a systematic review and thematic analysis of 47 computing research papers discussing participatory research with communities for the development of technological artifacts and systems, published over the last two decades. From this review, we identified seven themes associated with the evolution of a project: from establishing community partnerships to sustaining results. Our findings suggest that several tensions characterize these projects, many of which relate to the power and position of researchers, and the computing research environment, relative to community partners. We discuss the implications of our findings and offer methodological proposals to guide HCI, and computing research more broadly, towards practices that center communities.


title: Auction for Double-Wide Ads

abstract: We propose an auction for online advertising where each ad occupies either one square or two horizontally-adjacent squares of a grid of squares. Our primary application are ads for products shown on retail websites such as Instacart or Amazon where the products are naturally organized into a grid. We propose efficient algorithms for computing the optimal layout of the ads and pricing of the ads. The auction is a generalization of the generalized second-price (GSP) auction used by internet search engines (e.g. Google, Microsoft Bing, Yahoo!).


title: Stochastic Approximation with Decision-Dependent Distributions: Asymptotic Normality and Optimality

abstract: We analyze a stochastic approximation algorithm for decision-dependent problems, wherein the data distribution used by the algorithm evolves along the iterate sequence. The primary examples of such problems appear in performative prediction and its multiplayer extensions. We show that under mild assumptions, the deviation between the average iterate of the algorithm and the solution is asymptotically normal, with a covariance that clearly decouples the effects of the gradient noise and the distributional shift. Moreover, building on the work of H\'ajek and Le Cam, we show that the asymptotic performance of the algorithm with averaging is locally minimax optimal.


title: Towards Multimodal Vision-Language Models Generating Non-Generic Text

abstract: Vision-language models can assess visual context in an image and generate descriptive text. While the generated text may be accurate and syntactically correct, it is often overly general. To address this, recent work has used optical character recognition to supplement visual information with text extracted from an image. In this work, we contend that vision-language models can benefit from additional information that can be extracted from an image, but are not used by current models. We modify previous multimodal frameworks to accept relevant information from any number of auxiliary classifiers. In particular, we focus on person names as an additional set of tokens and create a novel image-caption dataset to facilitate captioning with person names. The dataset, Politicians and Athletes in Captions (PAC), consists of captioned images of well-known people in context. By fine-tuning pretrained models with this dataset, we demonstrate a model that can naturally integrate facial recognition tokens into generated text by training on limited data. For the PAC dataset, we provide a discussion on collection and baseline benchmark scores.


title: Direct Handheld Burst Imaging to Simulated Defocus

abstract: A shallow depth-of-field image keeps the subject in focus, and the foreground and background contexts blurred. This effect requires much larger lens apertures than those of smartphone cameras. Conventional methods acquire RGB-D images and blur image regions based on their depth. However, this approach is not suitable for reflective or transparent surfaces, or finely detailed object silhouettes, where the depth value is inaccurate or ambiguous. We present a learning-based method to synthesize the defocus blur in shallow depth-of-field images from handheld bursts acquired with a single small aperture lens. Our deep learning model directly produces the shallow depth-of-field image, avoiding explicit depth-based blurring. The simulated aperture diameter equals the camera translation during burst acquisition. Our method does not suffer from artifacts due to inaccurate or ambiguous depth estimation, and it is well-suited to portrait photography.


title: Internal Language Model Estimation based Language Model Fusion for Cross-Domain Code-Switching Speech Recognition

abstract: Internal Language Model Estimation (ILME) based language model (LM) fusion has been shown significantly improved recognition results over conventional shallow fusion in both intra-domain and cross-domain speech recognition tasks. In this paper, we attempt to apply our ILME method to cross-domain code-switching speech recognition (CSSR) work. Specifically, our curiosity comes from several aspects. First, we are curious about how effective the ILME-based LM fusion is for both intra-domain and cross-domain CSSR tasks. We verify this with or without merging two code-switching domains. More importantly, we train an end-to-end (E2E) speech recognition model by means of merging two monolingual data sets and observe the efficacy of the proposed ILME-based LM fusion for CSSR. Experimental results on SEAME that is from Southeast Asian and another Chinese Mainland CS data set demonstrate the effectiveness of the proposed ILME-based LM fusion method.


title: Intermediate-layer output Regularization for Attention-based Speech Recognition with Shared Decoder

abstract: Intermediate layer output (ILO) regularization by means of multitask training on encoder side has been shown to be an effective approach to yielding improved results on a wide range of end-to-end ASR frameworks. In this paper, we propose a novel method to do ILO regularized training differently. Instead of using conventional multitask methods that entail more training overhead, we directly make the intermediate layer output as input to the decoder, that is, our decoder not only accepts the output of the final encoder layer as input, it also takes the output of the encoder ILO as input during training. With the proposed method, as both encoder and decoder are simultaneously "regularized", the network is more sufficiently trained, consistently leading to improved results, over the ILO-based CTC method, as well as over the original attention-based modeling method without the proposed method employed.


title: A Scattering Matrix Formalism to Model Periodic Heat Diffusion in Stratified Solid Media

abstract: The transfer matrix formalism is widely used in modeling heat diffusion in layered structures.Due to an intrinsic numerical instability issue, which has not yet drawn enough attention to the heat transfer community,this formalism fails at high heating frequencies and/or in thick structures. Inspired by its success in modeling wave propagation, we develop a numerically-stable scattering matrix framework to model periodic heat diffusion in stratified solid media.As a concreate example, we apply this scattering matrix methodology to the three omega method.We first validate our framework using various well-known solutions.Next, we demonstrate the numerical stability of the framework using a configuration that resembles the three-dimensional stacked architecture for chip packing. Last, we propose synthetic experiments to exhibit, under certain circumstances, the merits of the scattering matrix formalism in extracting thermal properties.


title: Transformer Neural Processes: Uncertainty-Aware Meta Learning Via Sequence Modeling

abstract: Neural Processes (NPs) are a popular class of approaches for meta-learning. Similar to Gaussian Processes (GPs), NPs define distributions over functions and can estimate uncertainty in their predictions. However, unlike GPs, NPs and their variants suffer from underfitting and often have intractable likelihoods, which limit their applications in sequential decision making. We propose Transformer Neural Processes (TNPs), a new member of the NP family that casts uncertainty-aware meta learning as a sequence modeling problem. We learn TNPs via an autoregressive likelihood-based objective and instantiate it with a novel transformer-based architecture. The model architecture respects the inductive biases inherent to the problem structure, such as invariance to the observed data points and equivariance to the unobserved points. We further investigate knobs within the TNP framework that tradeoff expressivity of the decoding distribution with extra computation. Empirically, we show that TNPs achieve state-of-the-art performance on various benchmark problems, outperforming all previous NP variants on meta regression, image completion, contextual multi-armed bandits, and Bayesian optimization.


title: On Kato's smoothing effect for a fractional version of the Zakharov-Kuznetsov equation

abstract: In this work we study some regularity properties associated to the initial value problem (IVP) \begin{equation}\label{main1} \left\{ \begin{array}{ll} \partial_{t}u-\partial_{x_{1}}(-\Delta)^{\alpha/2} u+u\partial_{x_{1}}u=0, \quad 0< \alpha\leq 2,& \\ u(x,0)=u_{0}(x),\quad x=(x_{1},x_{2},\dots,x_{n})\in \mathbb{R}^{n},\, n\geq 2,\quad t\in\mathbb{R},& \\ \end{array} \right. \end{equation} where $(-\Delta)^{\alpha/2}$ denotes the $n-$dimensional fractional Laplacian. We show that solutions to the IVP (0.1) with initial data in a suitable Sobolev space exhibit a local smoothing effect in the spatial variable of $\frac{\alpha}{2}$ derivatives, almost everywhere in time. One of the main difficulties that emerge when trying to obtain this regularizing effect underlies that the operator in consideration is non-local, and the property we are trying to describe is local, so new ideas are required. Nevertheless, to avoid these problems, we use a perturbation argument replacing $(-\Delta)^{\frac{\alpha}{2}}$ by $(I-\Delta)^{\frac{\alpha}{2}},$ that through the use of pseudo-differential calculus allows us to show that solutions become locally smoother by $\frac{\alpha}{2}$ of a derivative in all spatial directions. As a by-product, we use this particular smoothing effect to show that the extra regularity of the initial data on some distinguished subsets of the Euclidean space is propagated by the flow solution with infinity speed.


title: On the spectrum of the joins of normal matrices and applications

abstract: We study the spectrum of the join of several normal matrices with constant row sums. We apply our results to compute the characteristic polynomial of the join of several regular graphs. We then use this calculation to study several problems in spectral graph theory. In particular, we provide some simple constructions of Ramanujan graphs and give new proofs for some theorems in [4].


title: Explainable Legal Case Matching via Inverse Optimal Transport-based Rationale Extraction

abstract: As an essential operation of legal retrieval, legal case matching plays a central role in intelligent legal systems. This task has a high demand on the explainability of matching results because of its critical impacts on downstream applications -- the matched legal cases may provide supportive evidence for the judgments of target cases and thus influence the fairness and justice of legal decisions. Focusing on this challenging task, we propose a novel and explainable method, namely \textit{IOT-Match}, with the help of computational optimal transport, which formulates the legal case matching problem as an inverse optimal transport (IOT) problem. Different from most existing methods, which merely focus on the sentence-level semantic similarity between legal cases, our IOT-Match learns to extract rationales from paired legal cases based on both semantics and legal characteristics of their sentences. The extracted rationales are further applied to generate faithful explanations and conduct matching. Moreover, the proposed IOT-Match is robust to the alignment label insufficiency issue commonly in practical legal case matching tasks, which is suitable for both supervised and semi-supervised learning paradigms. To demonstrate the superiority of our IOT-Match method and construct a benchmark of explainable legal case matching task, we not only extend the well-known Challenge of AI in Law (CAIL) dataset but also build a new Explainable Legal cAse Matching (ELAM) dataset, which contains lots of legal cases with detailed and explainable annotations. Experiments on these two datasets show that our IOT-Match outperforms state-of-the-art methods consistently on matching prediction, rationale extraction, and explanation generation.


title: Learning Robust Representation for Joint Grading of Ophthalmic Diseases via Adaptive Curriculum and Feature Disentanglement

abstract: Diabetic retinopathy (DR) and diabetic macular edema (DME) are leading causes of permanent blindness worldwide. Designing an automatic grading system with good generalization ability for DR and DME is vital in clinical practice. However, prior works either grade DR or DME independently, without considering internal correlations between them, or grade them jointly by shared feature representation, yet ignoring potential generalization issues caused by difficult samples and data bias. Aiming to address these problems, we propose a framework for joint grading with the dynamic difficulty-aware weighted loss (DAW) and the dual-stream disentangled learning architecture (DETACH). Inspired by curriculum learning, DAW learns from simple samples to difficult samples dynamically via measuring difficulty adaptively. DETACH separates features of grading tasks to avoid potential emphasis on the bias. With the addition of DAW and DETACH, the model learns robust disentangled feature representations to explore internal correlations between DR and DME and achieve better grading performance. Experiments on three benchmarks show the effectiveness and robustness of our framework under both the intra-dataset and cross-dataset tests.


title: Koopman-Model Predictive Control with Signal Temporal Logic Specifications for Temperature Regulation of a Warm-Water Supply System

abstract: Control of warm-water supply for dialysis treatment in a hospital environment is typical of safety-critical control problems. In order to guarantee the continuity of warm-water supply satisfying physical specifications for a wide range of operating conditions, it is inevitable to consider the nonlinearity involved in a dynamic model of a warm-water supply system for the control design. In this paper, we propose to incorporate control specifications described by signal temporal logic, which is a temporal logic with semantics over finite-time signals in formal methods, into the so-called Koopman-Model Predictive Control (MPC) as a novel technique of nonlinear MPC based on the Koopman operator framework for nonlinear systems. This enables us to generate a sequence of optimal inputs such that the controlled state of a nonlinear system can satisfy the specifications. The proposal is applied to the temperature regulation of warm-water supply, and its effectiveness is established numerically.


title: Domain Alignment Meets Fully Test-Time Adaptation

abstract: A foundational requirement of a deployed ML model is to generalize to data drawn from a testing distribution that is different from training. A popular solution to this problem is to adapt a pre-trained model to novel domains using only unlabeled data. In this paper, we focus on a challenging variant of this problem, where access to the original source data is restricted. While fully test-time adaptation (FTTA) and unsupervised domain adaptation (UDA) are closely related, the advances in UDA are not readily applicable to TTA, since most UDA methods require access to the source data. Hence, we propose a new approach, CATTAn, that bridges UDA and FTTA, by relaxing the need to access entire source data, through a novel deep subspace alignment strategy. With a minimal overhead of storing the subspace basis set for the source data, CATTAn enables unsupervised alignment between source and target data during adaptation. Through extensive experimental evaluation on multiple 2D and 3D vision benchmarks (ImageNet-C, Office-31, OfficeHome, DomainNet, PointDA-10) and model architectures, we demonstrate significant gains in FTTA performance. Furthermore, we make a number of crucial findings on the utility of the alignment objective even with inherently robust models, pre-trained ViT representations and under low sample availability in the target domain.


title: A Study on Self-Supervised Object Detection Pretraining

abstract: In this work, we study different approaches to self-supervised pretraining of object detection models. We first design a general framework to learn a spatially consistent dense representation from an image, by randomly sampling and projecting boxes to each augmented view and maximizing the similarity between corresponding box features. We study existing design choices in the literature, such as box generation, feature extraction strategies, and using multiple views inspired by its success on instance-level image representation learning techniques. Our results suggest that the method is robust to different choices of hyperparameters, and using multiple views is not as effective as shown for instance-level image representation learning. We also design two auxiliary tasks to predict boxes in one view from their features in the other view, by (1) predicting boxes from the sampled set by using a contrastive loss, and (2) predicting box coordinates using a transformer, which potentially benefits downstream object detection tasks. We found that these tasks do not lead to better object detection performance when finetuning the pretrained model on labeled data.


title: Variance Analysis of Multiple Importance Sampling Schemes

abstract: Multiple importance sampling (MIS) is an increasingly used methodology where several proposal densities are used to approximate integrals, generally involving target probability density functions. The use of several proposals allows for a large variety of sampling and weighting schemes. Then, the practitioner must choose a given scheme, i.e., sampling mechanism and weighting function. A variance analysis has been proposed in Elvira et al (2019, Statistical Science 34, 129-155), showing the superiority of the balanced heuristic estimator with respect to other competing schemes in some scenarios. However, some of their results are valid only for two proposals. In this paper, we extend and generalize these results, providing novel proofs that allow to determine the variance relations among MIS schemes.


title: Supervised Machine Learning for Effective Missile Launch Based on Beyond Visual Range Air Combat Simulations

abstract: This work compares supervised machine learning methods using reliable data from constructive simulations to estimate the most effective moment for launching missiles during air combat. We employed resampling techniques to improve the predictive model, analyzing accuracy, precision, recall, and f1-score. Indeed, we could identify the remarkable performance of the models based on decision trees and the significant sensitivity of other algorithms to resampling techniques. The models with the best f1-score brought values of 0.379 and 0.465 without and with the resampling technique, respectively, which is an increase of 22.69%. Thus, if desirable, resampling techniques can improve the model's recall and f1-score with a slight decline in accuracy and precision. Therefore, through data obtained through constructive simulations, it is possible to develop decision support tools based on machine learning models, which may improve the flight quality in BVR air combat, increasing the effectiveness of offensive missions to hit a particular target.


title: Testing the equivalence principle with time-diffracted free-falling quantum particles

abstract: The equivalence principle of gravity is examined at the quantum level using the diffraction in time of matter waves in two ways. First, we consider a quasi-monochromatic beam of particles incident on a shutter which is removed at time $t = 0$ and fall due to the gravitational field. The probability density exhibits a set of mass-dependent oscillations which are genuinely quantum in nature, thereby reflecting quantum violations to the weak equivalence principle, although the strong equivalence principle remains valid. We estimate the degree of violation in terms of the width of the diffraction-in-time effect. Second, motivated by the recent advances in the manipulation of ultracold atoms and neutrons as well as the experimental observation of quantum states of ultracold neutrons in the gravitational field above a flat mirror, we study the diffraction in time of a suddenly released beam of particles initially prepared in gravitational quantum bound states. In this case, we quantify the degree of violation by comparing the time of flight from the mean position of the initial wave packet versus the time of flight as measured from the mirror. We show that, in this case both the weak and strong versions of the equivalence principle are violated. We demonstrate that compatibility between equivalence principle and quantum mechanics is recovered in the macroscopic (large-mass) limit. Possible realizations with ultracold neutrons, cesium atoms and large molecules are discussed.


title: Charmless two-body $B$ meson decays in perturbative QCD factorization approach

abstract: The perturbative QCD (PQCD) approach based on $k_T$ factorization has made a great achievement for the QCD calculation of the hadronic B decays. Regulating the endpoint divergence by the transverse momentum of quarks in the propagators, one can do the perturbation calculation for kinds of diagrams including the annihilation type diagrams. In this paper, we review the current status of PQCD factorization calculation of two-body charmless $B\to PP, PV, VV$ decays up to the next-to-leading order (NLO) QCD corrections. two new power suppressed terms in decaying amplitudes are also taken into account. By using the universal input (non-perturbative) parameters, we collected the branching ratios and ${\bf CP}$ asymmetry parameters for all the charmless two body $B$ decays, calculated in the PQCD approach up to the NLO, including some power suppressed terms in decaying amplitudes. The results are compared with the ones from QCD factorization approach, soft-collinear effective theory approach and the current experimental measurements. For most considered B meson decays, the PQCD results for branching ratios agree well with other approaches and the experimental data. The PQCD predictions for the ${\bf CP}$ asymmetry parameters for many of the decay channels do not agree with other approaches, but have a better agreement with the experimental data. The longstanding $K \pi $ puzzle about the pattern of the direct CP asymmetries of the penguin-dominated $B \to K \pi $ decays can be understood after the inclusion of the NLO contributions in PQCD. The NLO corrections and power suppressed terms play an important role in the color suppressed and pure annihilation type $B$ decay modes. These rare decays are more sensitive to different types of corrections, providing opportunity to examine the factorization approach with the more precise experimental measurements.


title: Quantum phase transition in XXZ central spin model

abstract: We investigate the quantum phase transition (QPT) in the XXZ central spin model, which can be described as a spin-1/2 particle coupled to N bath spins. In general, the QPT is supposed to occur only in the thermodynamical limit. In contrast, we present that the central spin model exhibits a normal-to-superradiant phase transition in the limit where the ratio of the transition frequency of the central spin to that of the bath spins and the number of the bath spins tend to infinity. We give the low-energy effective Hamiltonian analytically in the normal phase and the superradiant phase, and we find that the longitudinal interaction can significantly influence the excitation number and the coherence of the ground state. These two quantities are remarkably enhanced for the negative longitudinal interaction while suppressed for the positive longitudinal interaction. We also use the quantum Fisher information (QFI) to characterize the QPT and illustrate a measurement scheme that can be applied in practice. This work builds a novel connection between the qubit-spin systems and the qubit-field systems, which provides a possibility for the realization of criticality-enhanced quantum sensing in central spin systems.


title: Efficient Stackelberg Strategies for Finitely Repeated Games

abstract: We study Stackelberg equilibria in finitely repeated games, where the leader commits to a strategy that picks actions in each round and can be adaptive to the history of play (i.e. they commit to an algorithm). In particular, we study static repeated games with no discounting. We give efficient algorithms for finding approximate Stackelberg equilibria in this setting, along with rates of convergence depending on the time horizon $T$. In many cases, these algorithms allow the leader to do much better on average than they can in the single-round Stackelberg. We give two algorithms, one computing strategies with an optimal $\frac{1}{T}$ rate at the expense of an exponential dependence on the number of actions, and another (randomized) approach computing strategies with no dependence on the number of actions but a worse dependence on $T$ of $\frac{1}{T^{0.25}}$. Both algorithms build upon a linear program to produce simple automata leader strategies and induce corresponding automata best-responses for the follower. We complement these results by showing that approximating the Stackelberg value in three-player finite-horizon repeated games is a computationally hard problem via a reduction from balanced vertex cover.


title: A Bott periodicity theorem for $\ell^p$-spaces and the coarse Novikov conjecture at infinity

abstract: We formulate and prove a Bott periodicity theorem for an $\ell^p$-space ($1\leq p<\infty$). For a proper metric space $X$ with bounded geometry, we introduce a version of $K$-homology at infinity, denoted by $K_*^{\infty}(X)$, and the Roe algebra at infinity, denoted by $C^*_{\infty}(X)$. Then the coarse assembly map descents to a map from $\lim_{d\to\infty}K_*^{\infty}(P_d(X))$ to $K_*(C^*_{\infty}(X))$, called the coarse assembly map at infinity. We show that to prove the coarse Novikov conjecture, it suffices to prove the coarse assembly map at infinity is an injection. As a result, we show that the coarse Novikov conjecture holds for any metric space with bounded geometry which admits a fibred coarse embedding into an $\ell^p$-space. These include all box spaces of a residually finite hyperbolic group and a large class of warped cones of a compact space with an action by a hyperbolic group.


title: Online algorithms for finding distinct substrings with length and multiple prefix and suffix conditions

abstract: Let two static sequences of strings $P$ and $S$, representing prefix and suffix conditions respectively, be given as input for preprocessing. For the query, let two positive integers $k_1$ and $k_2$ be given, as well as a string $T$ given in an online manner, such that $T_i$ represents the length-$i$ prefix of $T$ for $1 \leq i \leq |T|$. In this paper we are interested in computing the set $\mathit{ans_i}$ of distinct substrings $w$ of $T_i$ such that $k_1 \leq |w| \leq k_2$, and $w$ contains some $p \in P$ as a prefix and some $s \in S$ as a suffix. More specifically, the counting problem is to output $|\mathit{ans_i}|$, whereas the reporting problem is to output all elements of $\mathit{ans_i}$, for each iteration $i$. Let $\sigma$ denote the alphabet size, and for a sequence of strings $A$, $\Vert A\Vert=\sum_{u\in A}|u|$. Then, we show that after $O((\Vert P\Vert +\Vert S\Vert)\log\sigma)$-time preprocessing, the solutions for the counting and reporting problems for each iteration up to $i$ can be output in $O(|T_i| \log\sigma)$ and $O(|T_i| \log\sigma + |\mathit{ans_i}|)$ total time. The preprocessing time can be reduced to $O(\Vert P\Vert +\Vert S\Vert)$ for integer alphabets of size polynomial with regard to $\Vert P\Vert +\Vert S\Vert$. Our algorithms have possible applications to network traffic classification.


title: Near-Infrared plasmon induced hot electron extraction evidence in an indium tin oxide nanoparticle / monolayer molybdenum disulphide heterostructure

abstract: In this work, we observe plasmon induced hot electron extraction in a heterojunction between indium tin oxide nanocrystals and monolayer molybdenum disulphide. We study the sample with ultrafast differential transmission exciting the sample at 1750 nm where the intense localized plasmon surface resonance of the indium tin oxide nanocrystals is and where the monolayer molybdenum disulphide does not absorb light. With the excitation at 1750 nm we observe the excitonic features of molybdenum disulphide in the visible range, close to the exciton of molybdenum disulphide. Such phenomenon can be ascribed to a charge transfer between indium tin oxide nanocrystals and monolayer molybdenum disulphide upon plasmon excitation. These results are a first step towards the implementation of near infrared plasmonic materials for photoconversion.


title: Robotic Depowdering for Additive Manufacturing Via Pose Tracking

abstract: With the rapid development of powder-based additive manufacturing, depowdering, a process of removing unfused powder that covers 3D-printed parts, has become a major bottleneck to further improve its productiveness. Traditional manual depowdering is extremely time-consuming and costly, and some prior automated systems either require pre-depowdering or lack adaptability to different 3D-printed parts. To solve these problems, we introduce a robotic system that automatically removes unfused powder from the surface of 3D-printed parts. The key component is a visual perception system, which consists of a pose-tracking module that tracks the 6D pose of powder-occluded parts in real-time, and a progress estimation module that estimates the depowdering completion percentage. The tracking module can be run efficiently on a laptop CPU at up to 60 FPS. Experiments show that our depowdering system can remove unfused powder from the surface of various 3D-printed parts without causing any damage. To the best of our knowledge, this is one of the first vision-based robotic depowdering systems that adapt to parts with various shapes without the need for pre-depowdering.


title: Multi-label Classification with High-rank and High-order Label Correlations

abstract: Exploiting label correlations is important to multi-label classification. Previous methods capture the high-order label correlations mainly by transforming the label matrix to a latent label space with low-rank matrix factorization. However, the label matrix is generally a full-rank or approximate full-rank matrix, making the low-rank factorization inappropriate. Besides, in the latent space, the label correlations will become implicit. To this end, we propose a simple yet effective method to depict the high-order label correlations explicitly, and at the same time maintain the high-rank of the label matrix. Moreover, we estimate the label correlations and infer model parameters simultaneously via the local geometric structure of the input to achieve mutual enhancement. Comparative studies over twelve benchmark data sets validate the effectiveness of the proposed algorithm in multi-label classification. The exploited high-order label correlations are consistent with common sense empirically. Our code is publicly available at https://github.com/Chongjie-Si/HOMI.


title: Improved Binary Forward Exploration: Learning Rate Scheduling Method for Stochastic Optimization

abstract: A new gradient-based optimization approach by automatically scheduling the learning rate has been proposed recently, which is called Binary Forward Exploration (BFE). The Adaptive version of BFE has also been discussed thereafter. In this paper, the improved algorithms based on them will be investigated, in order to optimize the efficiency and robustness of the new methodology. This improved approach provides a new perspective to scheduling the update of learning rate and will be compared with the stochastic gradient descent, aka SGD algorithm with momentum or Nesterov momentum and the most successful adaptive learning rate algorithm e.g. Adam. The goal of this method does not aim to beat others but provide a different viewpoint to optimize the gradient descent process. This approach combines the advantages of the first-order and second-order optimizations in the aspects of speed and efficiency.


title: Serving Hybrid-Cloud SQL Interactive Queries at Twitter

abstract: The demand for data analytics has been consistently increasing in the past years at Twitter. In order to fulfill the requirements and provide a highly scalable and available query experience, a large-scale in-house SQL system is heavily relied on. Recently, we evolved the SQL system into a hybrid-cloud SQL federation system, compliant with Twitter's Partly Cloudy strategy. The hybrid-cloud SQL federation system is capable of processing queries across Twitter's data centers and the public cloud, interacting with around 10PB of data per day. In this paper, the design of the hybrid-cloud SQL federation system is presented, which consists of query, cluster, and storage federations. We identify challenges in a modern SQL system and demonstrate how our system addresses them with some important design decisions. We also conduct qualitative examinations and summarize instructive lessons learned from the development and operation of such a SQL system.


title: Learning Structured Representations of Visual Scenes

abstract: As the intermediate-level representations bridging the two levels, structured representations of visual scenes, such as visual relationships between pairwise objects, have been shown to not only benefit compositional models in learning to reason along with the structures but provide higher interpretability for model decisions. Nevertheless, these representations receive much less attention than traditional recognition tasks, leaving numerous open challenges unsolved. In the thesis, we study how machines can describe the content of the individual image or video with visual relationships as the structured representations. Specifically, we explore how structured representations of visual scenes can be effectively constructed and learned in both the static-image and video settings, with improvements resulting from external knowledge incorporation, bias-reducing mechanism, and enhanced representation models. At the end of this thesis, we also discuss some open challenges and limitations to shed light on future directions of structured representation learning for visual scenes.


title: Human-centric Spatio-Temporal Video Grounding via the Combination of Mutual Matching Network and TubeDETR

abstract: In this technical report, we represent our solution for the Human-centric Spatio-Temporal Video Grounding (HC-STVG) track of the 4th Person in Context (PIC) workshop and challenge. Our solution is built on the basis of TubeDETR and Mutual Matching Network (MMN). Specifically, TubeDETR exploits a video-text encoder and a space-time decoder to predict the starting time, the ending time and the tube of the target person. MMN detects persons in images, links them as tubes, extracts features of person tubes and the text description, and predicts the similarities between them to choose the most likely person tube as the grounding result. Our solution finally finetunes the results by combining the spatio localization of MMN and with temporal localization of TubeDETR. In the HC-STVG track of the 4th PIC challenge, our solution achieves the third place.


title: Smart Multi-tenant Federated Learning

abstract: Federated learning (FL) is an emerging distributed machine learning method that empowers in-situ model training on decentralized edge devices. However, multiple simultaneous training activities could overload resource-constrained devices. In this work, we propose a smart multi-tenant FL system, MuFL, to effectively coordinate and execute simultaneous training activities. We first formalize the problem of multi-tenant FL, define multi-tenant FL scenarios, and introduce a vanilla multi-tenant FL system that trains activities sequentially to form baselines. Then, we propose two approaches to optimize multi-tenant FL: 1) activity consolidation merges training activities into one activity with a multi-task architecture; 2) after training it for rounds, activity splitting divides it into groups by employing affinities among activities such that activities within a group have better synergy. Extensive experiments demonstrate that MuFL outperforms other methods while consuming 40% less energy. We hope this work will inspire the community to further study and optimize multi-tenant FL.


title: Learning to Separate Voices by Spatial Regions

abstract: We consider the problem of audio voice separation for binaural applications, such as earphones and hearing aids. While today's neural networks perform remarkably well (separating $4+$ sources with 2 microphones) they assume a known or fixed maximum number of sources, K. Moreover, today's models are trained in a supervised manner, using training data synthesized from generic sources, environments, and human head shapes. This paper intends to relax both these constraints at the expense of a slight alteration in the problem definition. We observe that, when a received mixture contains too many sources, it is still helpful to separate them by region, i.e., isolating signal mixtures from each conical sector around the user's head. This requires learning the fine-grained spatial properties of each region, including the signal distortions imposed by a person's head. We propose a two-stage self-supervised framework in which overheard voices from earphones are pre-processed to extract relatively clean personalized signals, which are then used to train a region-wise separation model. Results show promising performance, underscoring the importance of personalization over a generic supervised approach. (audio samples available at our project website: https://uiuc-earable-computing.github.io/binaural/. We believe this result could help real-world applications in selective hearing, noise cancellation, and audio augmented reality.


title: Variational Approach for Intensity Domain Multi-exposure Image Fusion

abstract: Recent innovations shows that blending of details captured by single Low Dynamic Range (LDR) sensor overcomes the limitations of standard digital cameras to capture details from high dynamic range scene. We present a method to produce well-exposed fused image that can be displayed directly on conventional display devices. The ambition is to preserve details in poorly illuminated and brightly illuminated regions. Proposed approach does not require true radiance reconstruction and tone manipulation steps. The aforesaid objective is achieved by taking into account local information measure that select well-exposed regions across input exposures. In addition, Contrast Limited Adaptive Histogram equalization (CLAHE) is introduced to improve uniformity of input multi-exposure image prior to fusion.


title: Superconductivity in bilayer $t$-$t'$ Hubbard models

abstract: The relationship between crystal structures and superconducting critical temperatures has attracted considerable attention as a clue to designing higher-$T_{\rm c}$ superconductors. In particular, the relationship between the number $n$ of CuO$_2$ layers in a unit cell of cuprate superconductors and the optimum superconducting transition temperature $T_{\rm c}^{\rm opt}$ is intriguing. As experimentally observed in layered cuprates, $T_{\rm c}^{\rm opt}$ increases when $n$ is increased, up to $n=3$, and, then, decreases for larger $n$. However, the mechanism behind the $n$ dependence of $T_{\rm c}^{\rm opt}$ remains elusive although there have been many studies on the $n$ dependence. In this paper, we studied a bilayer $t$-$t'$ Hubbard model to clarify the effects of the adjacent CuO$_2$ layers on the stability of the superconductivity by using a many-variable variational Monte Carlo method. We calculate the superconducting correlation at long distance and zero temperature, and the amplitude of the superconducting gap functions estimated from the momentum distribution as the observables correlated with $T_{\rm c}^{\rm opt}$. It is found that the in-plane superconducting correlation is not enhanced in comparison with that in the single-layer $t$-$t'$ Hubbard model. The superconducting correlations of the bilayer Hamiltonian are significantly small in the overdoped region in comparison with those of single-layer Hamiltonian, which is attributed to the van Hove singularity. In addition, we found that the amplitude of the superconducting gap functions is also similar in both the single-layer and bilayer $t$-$t'$ Hubbard model at the optimal doping. Therefore, we conclude that the adjacent Hubbard layers are not relevant to the enhancement of $T_{\rm c}^{\rm opt}$ in the bilayer cuprates. Possible origins of the enhanced $T_{\rm c}^{\rm opt}$ other than the adjacent layers are also discussed.


title: A Study of Syntactic Multi-Modality in Non-Autoregressive Machine Translation

abstract: It is difficult for non-autoregressive translation (NAT) models to capture the multi-modal distribution of target translations due to their conditional independence assumption, which is known as the "multi-modality problem", including the lexical multi-modality and the syntactic multi-modality. While the first one has been well studied, the syntactic multi-modality brings severe challenge to the standard cross entropy (XE) loss in NAT and is under studied. In this paper, we conduct a systematic study on the syntactic multi-modality problem. Specifically, we decompose it into short- and long-range syntactic multi-modalities and evaluate several recent NAT algorithms with advanced loss functions on both carefully designed synthesized datasets and real datasets. We find that the Connectionist Temporal Classification (CTC) loss and the Order-Agnostic Cross Entropy (OAXE) loss can better handle short- and long-range syntactic multi-modalities respectively. Furthermore, we take the best of both and design a new loss function to better handle the complicated syntactic multi-modality in real-world datasets. To facilitate practical usage, we provide a guide to use different loss functions for different kinds of syntactic multi-modality.


title: Quantitative estimates for fractional Sobolev mappings in rational homotopy groups

abstract: Let $\mathcal{N} \subset \mathbb{R}^M$ be a smooth simply connected compact manifold without boundary. A rational homotopy subgroup of $\pi_{N}(\mathcal{N})$ is represented by a homomorphism \[{\rm deg}: \pi_{N}(\mathcal{N}) \to \mathbb{R}.\] For maps $f: \mathbb{S}^N \to \mathcal{N}$ we give a quantitative estimate of its rational homotopy group element ${\rm deg}([f]) \in \mathbb{R}$ in terms of its fractional Sobolev-norm or H\"older norm. That is, we show that for all $\beta \in (\beta_0({\rm deg}),1]$, \[ |{\rm deg}([f])|\leq C({\rm deg})\, [f]_{W^{\beta,\frac{N}{\beta}}(\mathbb{S}^N)}^{\frac{N+L({\rm deg})}{\beta}}, \] and \[ |{\rm deg}([f])|\leq C({\rm deg})\, [f]_{C^{\beta}(\mathbb{S}^N)}^{\frac{N+L({\rm deg})}{\beta}}. \] Here $C({\rm deg}) > 0$, $L({\rm deg}) \in \mathbb{N}$, $\beta_0({\rm deg}) \in (0,1)$ are computable from the rational homotopy group represented by ${\rm deg}$. This extends earlier work by Van Schaftingen and the second author on the Hopf degree to the Novikov's integral representation for rational homotopy groups as developed by Sullivan, Novikov, Hardt and Rivi\`ere.


title: SCouT: Synthetic Counterfactuals via Spatiotemporal Transformers for Actionable Healthcare

abstract: The Synthetic Control method has pioneered a class of powerful data-driven techniques to estimate the counterfactual reality of a unit from donor units. At its core, the technique involves a linear model fitted on the pre-intervention period that combines donor outcomes to yield the counterfactual. However, linearly combining spatial information at each time instance using time-agnostic weights fails to capture important inter-unit and intra-unit temporal contexts and complex nonlinear dynamics of real data. We instead propose an approach to use local spatiotemporal information before the onset of the intervention as a promising way to estimate the counterfactual sequence. To this end, we suggest a Transformer model that leverages particular positional embeddings, a modified decoder attention mask, and a novel pre-training task to perform spatiotemporal sequence-to-sequence modeling. Our experiments on synthetic data demonstrate the efficacy of our method in the typical small donor pool setting and its robustness against noise. We also generate actionable healthcare insights at the population and patient levels by simulating a state-wide public health policy to evaluate its effectiveness, an in silico trial for asthma medications to support randomized controlled trials, and a medical intervention for patients with Friedreich's ataxia to improve clinical decision-making and promote personalized therapy.


title: Invisible Backdoor Attacks Using Data Poisoning in the Frequency Domain

abstract: With the broad application of deep neural networks (DNNs), backdoor attacks have gradually attracted attention. Backdoor attacks are insidious, and poisoned models perform well on benign samples and are only triggered when given specific inputs, which cause the neural network to produce incorrect outputs. The state-of-the-art backdoor attack work is implemented by data poisoning, i.e., the attacker injects poisoned samples into the dataset, and the models trained with that dataset are infected with the backdoor. However, most of the triggers used in the current study are fixed patterns patched on a small fraction of an image and are often clearly mislabeled, which is easily detected by humans or defense methods such as Neural Cleanse and SentiNet. Also, it's difficult to be learned by DNNs without mislabeling, as they may ignore small patterns. In this paper, we propose a generalized backdoor attack method based on the frequency domain, which can implement backdoor implantation without mislabeling and accessing the training process. It is invisible to human beings and able to evade the commonly used defense methods. We evaluate our approach in the no-label and clean-label cases on three datasets (CIFAR-10, STL-10, and GTSRB) with two popular scenarios (self-supervised learning and supervised learning). The results show our approach can achieve a high attack success rate (above 90%) on all the tasks without significant performance degradation on main tasks. Also, we evaluate the bypass performance of our approach for different kinds of defenses, including the detection of training data (i.e., Activation Clustering), the preprocessing of inputs (i.e., Filtering), the detection of inputs (i.e., SentiNet), and the detection of models (i.e., Neural Cleanse). The experimental results demonstrate that our approach shows excellent robustness to such defenses.


title: Modeling of multimode radially pulsating High-Amplitude Delta Scuti stars from the OGLE Galactic bulge sample

abstract: Thanks to relatively firm mode identification, possible based on period ratios only, High Amplitude Delta Scuti Stars pulsating in at least three radial modes are promising targets for asteroseismic inference. In this study we used the most numerous sample of HADS from the OGLE inner bulge fields that likely pulsate in either three or four radial modes simultaneously. We have computed a grid of pulsation models along evolutionary tracks and determined the physical parameters of stars by matching their pulsation periods and period ratios. For 176 HADS we determined physical parameters, i.e. masses, luminosities, effective temperatures, metallicities and ages. We present the distribution of physical parameters and discuss their properties. We selected 16 candidates for SX Phoenicis stars.


title: BOSS: Bottom-up Cross-modal Semantic Composition with Hybrid Counterfactual Training for Robust Content-based Image Retrieval

abstract: Content-Based Image Retrieval (CIR) aims to search for a target image by concurrently comprehending the composition of an example image and a complementary text, which potentially impacts a wide variety of real-world applications, such as internet search and fashion retrieval. In this scenario, the input image serves as an intuitive context and background for the search, while the corresponding language expressly requests new traits on how specific characteristics of the query image should be modified in order to get the intended target image. This task is challenging since it necessitates learning and understanding the composite image-text representation by incorporating cross-granular semantic updates. In this paper, we tackle this task by a novel \underline{\textbf{B}}ottom-up cr\underline{\textbf{O}}ss-modal \underline{\textbf{S}}emantic compo\underline{\textbf{S}}ition (\textbf{BOSS}) with Hybrid Counterfactual Training framework, which sheds new light on the CIR task by studying it from two previously overlooked perspectives: \emph{implicitly bottom-up composition of visiolinguistic representation} and \emph{explicitly fine-grained correspondence of query-target construction}. On the one hand, we leverage the implicit interaction and composition of cross-modal embeddings from the bottom local characteristics to the top global semantics, preserving and transforming the visual representation conditioned on language semantics in several continuous steps for effective target image search. On the other hand, we devise a hybrid counterfactual training strategy that can reduce the model's ambiguity for similar queries.


title: COVID-19 Disease Identification on Chest-CT images using CNN and VGG16

abstract: A newly identified coronavirus disease called COVID-19 mainly affects the human respiratory system. COVID-19 is an infectious disease caused by a virus originating in Wuhan, China, in December 2019. Early diagnosis is the primary challenge of health care providers. In the earlier stage, medical organizations were dazzled because there were no proper health aids or medicine to detect a COVID-19. A new diagnostic tool RT-PCR (Reverse Transcription Polymerase Chain Reaction), was introduced. It collects swab specimens from the patient's nose or throat, where the COVID-19 virus gathers. This method has some limitations related to accuracy and testing time. Medical experts suggest an alternative approach called CT (Computed Tomography) that can quickly diagnose the infected lung areas and identify the COVID-19 in an earlier stage. Using chest CT images, computer researchers developed several deep learning models identifying the COVID-19 disease. This study presents a Convolutional Neural Network (CNN) and VGG16-based model for automated COVID-19 identification on chest CT images. The experimental results using a public dataset of 14320 CT images showed a classification accuracy of 96.34% and 96.99% for CNN and VGG16, respectively.


title: Dual-Path Cross-Modal Attention for better Audio-Visual Speech Extraction

abstract: Audio-visual target speech extraction, which aims to extract a certain speaker's speech from the noisy mixture by looking at lip movements, has made significant progress combining time-domain speech separation models and visual feature extractors (CNN). One problem of fusing audio and video information is that they have different time resolutions. Most current research upsamples the visual features along the time dimension so that audio and video features are able to align in time. However, we believe that lip movement should mostly contain long-term, or phone-level information. Based on this assumption, we propose a new way to fuse audio-visual features. We observe that for DPRNN \cite{dprnn}, the interchunk dimension's time resolution could be very close to the time resolution of video frames. Like \cite{sepformer}, the LSTM in DPRNN is replaced by intra-chunk and inter-chunk self-attention, but in the proposed algorithm, inter-chunk attention incorporates the visual features as an additional feature stream. This prevents the upsampling of visual cues, resulting in more efficient audio-visual fusion. The result shows we achieve superior results compared with other time-domain based audio-visual fusion models.


title: Adaptive Structural Similarity Preserving for Unsupervised Cross Modal Hashing

abstract: Cross-modal hashing is an important approach for multimodal data management and application. Existing unsupervised cross-modal hashing algorithms mainly rely on data features in pre-trained models to mine their similarity relationships. However, their optimization objectives are based on the static metric between the original uni-modal features, without further exploring data correlations during the training. In addition, most of them mainly focus on association mining and alignment among pairwise instances in continuous space but ignore the latent structural correlations contained in the semantic hashing space. In this paper, we propose an unsupervised hash learning framework, namely Adaptive Structural Similarity Preservation Hashing (ASSPH), to solve the above problems. Firstly, we propose an adaptive learning scheme, with limited data and training batches, to enrich semantic correlations of unlabeled instances during the training process and meanwhile to ensure a smooth convergence of the training process. Secondly, we present an asymmetric structural semantic representation learning scheme. We introduce structural semantic metrics based on graph adjacency relations during the semantic reconstruction and correlation mining stage and meanwhile align the structure semantics in the hash space with an asymmetric binary optimization process. Finally, we conduct extensive experiments to validate the enhancements of our work in comparison with existing works.


title: Applicability of Hulthen-Hellmann potential to predict the mass-spectra of heavy mesons via series expansion method

abstract: We adopt Hulth\'en plus Hellmann potential as the quark-antiquark interaction potential for predicting the mass spectra of heavy mesons. The adopted potential was made to be temperature-dependent by replacing the screening parameter with Debye mass.The radial Schr\"odinger equation was analytically solved using the series expansion method and energy eigenvalues were obtained. The energy eigenvalues is used to predict the mass spectra of heavy mesons such as charmonium and bottomonium. Four special cases were considered when some of the potential parameters were set to zero, resulting in Hellmann potential, Yukawa potential, Coulomb potential, and Hulth\'en potential, respectively. The present potential provides satisfying results in comparison with experimental data and the work of other researchers with a maximum error of 0.034 GeV.


title: Wasserstein Graph Distance Based on $L_1$-Approximated Tree Edit Distance between Weisfeiler-Lehman Subtrees

abstract: The Weisfeiler-Lehman (WL) test is a widely used algorithm in graph machine learning, including graph kernels, graph metrics, and graph neural networks. However, it focuses only on the consistency of the graph, which means that it is unable to detect slight structural differences. Consequently, this limits its ability to capture structural information, which also limits the performance of existing models that rely on the WL test. This limitation is particularly severe for traditional metrics defined by the WL test, which cannot precisely capture slight structural differences. In this paper, we propose a novel graph metric called the Wasserstein WL Subtree (WWLS) distance to address this problem. Our approach leverages the WL subtree as structural information for node neighborhoods and defines node metrics using the $L_1$-approximated tree edit distance ($L_1$-TED) between WL subtrees of nodes. Subsequently, we combine the Wasserstein distance and the $L_1$-TED to define the WWLS distance, which can capture slight structural differences that may be difficult to detect using conventional metrics. We demonstrate that the proposed WWLS distance outperforms baselines in both metric validation and graph classification experiments.


title: Generating Pseudo-labels Adaptively for Few-shot Model-Agnostic Meta-Learning

abstract: Model-Agnostic Meta-Learning (MAML) is a famous few-shot learning method that has inspired many follow-up efforts, such as ANIL and BOIL. However, as an inductive method, MAML is unable to fully utilize the information of query set, limiting its potential of gaining higher generality. To address this issue, we propose a simple yet effective method that generates psuedo-labels adaptively and could boost the performance of the MAML family. The proposed methods, dubbed Generative Pseudo-label based MAML (GP-MAML), GP-ANIL and GP-BOIL, leverage statistics of the query set to improve the performance on new tasks. Specifically, we adaptively add pseudo labels and pick samples from the query set, then re-train the model using the picked query samples together with the support set. The GP series can also use information from the pseudo query set to re-train the network during the meta-testing. While some transductive methods, such as Transductive Propagation Network (TPN), struggle to achieve this goal.


title: Subclasses of Class Function used to Implement Transformations of Statistical Models

abstract: A library of software for inductive inference guided by the Minimum Message Length (MML) principle was created previously. It contains various (object-oriented-) classes and subclasses of statistical Model and can be used to infer Models from given data sets in machine learning problems. Here transformations of statistical Models are considered and implemented within the library so as to have desirable properties from the object-oriented programming and mathematical points of view. The subclasses of class Function needed to do such transformations are defined.


title: Multi-Attribute Attention Network for Interpretable Diagnosis of Thyroid Nodules in Ultrasound Images

abstract: Ultrasound (US) is the primary imaging technique for the diagnosis of thyroid cancer. However, accurate identification of nodule malignancy is a challenging task that can elude less-experienced clinicians. Recently, many computer-aided diagnosis (CAD) systems have been proposed to assist this process. However, most of them do not provide the reasoning of their classification process, which may jeopardize their credibility in practical use. To overcome this, we propose a novel deep learning framework called multi-attribute attention network (MAA-Net) that is designed to mimic the clinical diagnosis process. The proposed model learns to predict nodular attributes and infer their malignancy based on these clinically-relevant features. A multi-attention scheme is adopted to generate customized attention to improve each task and malignancy diagnosis. Furthermore, MAA-Net utilizes nodule delineations as nodules spatial prior guidance for the training rather than cropping the nodules with additional models or human interventions to prevent losing the context information. Validation experiments were performed on a large and challenging dataset containing 4554 patients. Results show that the proposed method outperformed other state-of-the-art methods and provides interpretable predictions that may better suit clinical needs.


title: Rethinking Persistent Homology for Visual Recognition

abstract: Persistent topological properties of an image serve as an additional descriptor providing an insight that might not be discovered by traditional neural networks. The existing research in this area focuses primarily on efficiently integrating topological properties of the data in the learning process in order to enhance the performance. However, there is no existing study to demonstrate all possible scenarios where introducing topological properties can boost or harm the performance. This paper performs a detailed analysis of the effectiveness of topological properties for image classification in various training scenarios, defined by: the number of training samples, the complexity of the training data and the complexity of the backbone network. We identify the scenarios that benefit the most from topological features, e.g., training simple networks on small datasets. Additionally, we discuss the problem of topological consistency of the datasets which is one of the major bottlenecks for using topological features for classification. We further demonstrate how the topological inconsistency can harm the performance for certain scenarios.


title: Learning to Register Unbalanced Point Pairs

abstract: Point cloud registration methods can effectively handle large-scale, partially overlapping point cloud pairs. Despite its practicality, matching the unbalanced pairs in terms of spatial extent and density has been overlooked and rarely studied. We present a novel method, dubbed UPPNet, for Unbalanced Point cloud Pair registration. We propose to incorporate a hierarchical framework that effectively finds inlier correspondences by gradually reducing search space. The proposed method first predicts subregions within target point cloud that are likely to be overlapped with query. Then following super-point matching and fine-grained refinement modules predict accurate inlier correspondences between the target and query. Additional geometric constraints are applied to refine the correspondences that satisfy spatial compatibility. The proposed network can be trained in an end-to-end manner, predicting the accurate rigid transformation with a single forward pass. To validate the efficacy of the proposed method, we create a carefully designed benchmark, named KITTI-UPP dataset, by augmenting the KITTI odometry dataset. Extensive experiments reveal that the proposed method not only outperforms state-of-the-art point cloud registration methods by large margins on KITTI-UPP benchmark, but also achieves competitive results on the standard pairwise registration benchmark including 3DMatch, 3DLoMatch, ScanNet, and KITTI, thus showing the applicability of our method on various datasets. The source code and dataset will be publicly released.


title: Accurate estimation of dynamical quantities for nonequilibrium nanoscale system

abstract: Fluctuations of dynamical quantities are fundamental and inevitable. For the booming research in nanotechnology, huge relative fluctuation comes with the reduction of system size, leading to large uncertainty for the estimates of dynamical quantities. Thus, increasing statistical efficiency, i.e., reducing the number of samples required to achieve a given accuracy, is of great significance for accurate estimation. Here we propose a theory as a fundamental solution for such problem by constructing auxiliary path for each real path. The states on auxiliary paths constitute canonical ensemble and share the same macroscopic properties with the initial states of the real path. By implementing the theory in molecular dynamics simulations, we obtain a nanoscale Couette flow field with an accuracy of 0.2 {\mu}m/s with relative standard error < 0.1. The required number of samples is reduced by 12 orders compared to conventional method. The predicted thermolubric behavior of water sliding on a self-assembled surface is directly validated by experiment under the same velocity. As the theory only assumes the system is initially in thermal equilibrium then driven from that equilibrium by an external perturbation, we believe it could serve as a general approach for extracting the accurate estimate of dynamical quantities from large fluctuations to provide insights on atomic level under experimental conditions, and benefit the studies on mass transport across (biological) nanochannels and fluid film lubrication of nanometer thickness.


title: Shot noise in resonant tunneling: Role of inelastic scattering

abstract: We study the influence of inelastic processes on shot noise and the Fano factor for a one-dimensional double-barrier structure, where resonant tunneling takes place between two terminals. Most studies to date have found, by means of various approximate or phenomenological methods, that shot noise is insensitive to dephasing caused by inelastic scattering. In this paper, we explore the status of this statement by deriving a general Landaur-B\"uttiker-type formula that expresses the current noise and Fano factor in a one-dimensional conductor through inelastic scattering amplitudes. For a double-barrier structure, exact scattering amplitudes are calculated in the presence of a time-dependent potential. As an example of dephasing potential, we consider the one induced by equilibrium phonons. We calculate transmission coefficients of a double-barrier structure for these two types of phonon-induced dephasing. In the case of diffusive phase relaxation valid for one dimension phonons, the resonant level has a Lorentzian shape. For phonons whith high dimensions logarithmic dephasing realized which leads to an unusual shape of the size-quantized level characterized by the two energy scales. We further calculate the Fano factor for these types of dephasing, using exact expressions for inelastic transmission and reflection amplitudes. It turned out that when an integer number of levels fall into the energy window of width eV, where V is the voltage applied to the structure, the Fano factor is really insensitive to inelastic processes inside the structure and coincides with the prediction of phenomenological models with an accuracy of small corrections depending on these processes. On the contrary, at low voltages, when the eV window is smaller than the level width, this dependence is particularly pronounced and the phenomenological formula does not work.


title: SiaTrans: Siamese Transformer Network for RGB-D Salient Object Detection with Depth Image Classification

abstract: RGB-D SOD uses depth information to handle challenging scenes and obtain high-quality saliency maps. Existing state-of-the-art RGB-D saliency detection methods overwhelmingly rely on the strategy of directly fusing depth information. Although these methods improve the accuracy of saliency prediction through various cross-modality fusion strategies, misinformation provided by some poor-quality depth images can affect the saliency prediction result. To address this issue, a novel RGB-D salient object detection model (SiaTrans) is proposed in this paper, which allows training on depth image quality classification at the same time as training on SOD. In light of the common information between RGB and depth images on salient objects, SiaTrans uses a Siamese transformer network with shared weight parameters as the encoder and extracts RGB and depth features concatenated on the batch dimension, saving space resources without compromising performance. SiaTrans uses the Class token in the backbone network (T2T-ViT) to classify the quality of depth images without preventing the token sequence from going on with the saliency detection task. Transformer-based cross-modality fusion module (CMF) can effectively fuse RGB and depth information. And in the testing process, CMF can choose to fuse cross-modality information or enhance RGB information according to the quality classification signal of the depth image. The greatest benefit of our designed CMF and decoder is that they maintain the consistency of RGB and RGB-D information decoding: SiaTrans decodes RGB-D or RGB information under the same model parameters according to the classification signal during testing. Comprehensive experiments on nine RGB-D SOD benchmark datasets show that SiaTrans has the best overall performance and the least computation compared with recent state-of-the-art methods.


title: The radical of functorially finite subcategories

abstract: Let $\Lambda$ be an artin algebra and $\mathcal{C}$ be a functorially finite subcategory of mod$\Lambda$ which contains $\Lambda$ or $D\Lambda$. We use the concept of the infinite radical of $\mathcal{C}$ and show that $\mathcal{C}$ has an additive generator if and only if rad$^\infty_{\mathcal{C}}$ vanishes. In this case we describe the morphisms in powers of the radical of $\mathcal{C}$ in terms of its irreducible morphisms. Moreover, under a mild assumption, we prove that $\mathcal{C}$ is of finite representation type if and only if any family of monomorphisms (epimorphisms) between indecomposable objects in $\mathcal{C}$ is noetherian (conoetherian). Also, by using injective envelopes, projective covers, left $\mathcal{C}$-approximations and right $\mathcal{C}$-approximations of simple $\Lambda$-modules, we give other criteria to describe whether $\mathcal{C}$ is of finite representation type. In addition, we give a nilpotency index of the radical of $\mathcal{C}$ which is independent from the maximal length of indecomposable $\Lambda$-modules in $\mathcal{C}$.


title: Bergman theory for the inhomogeneous Cimmino system

abstract: We first prove a Cauchy's integral theorem and Cauchy type formula for certain inhomogeneous Cimmino system from quaternionic analysis perspective. The second part of the paper directs the attention towards some applications of the mentioned results, dealing in particular with four kinds of weighted Bergman spaces, reproducing kernels, projection and conformal invariant properties.


title: On the Robustness and Anomaly Detection of Sparse Neural Networks

abstract: The robustness and anomaly detection capability of neural networks are crucial topics for their safe adoption in the real-world. Moreover, the over-parameterization of recent networks comes with high computational costs and raises questions about its influence on robustness and anomaly detection. In this work, we show that sparsity can make networks more robust and better anomaly detectors. To motivate this even further, we show that a pre-trained neural network contains, within its parameter space, sparse subnetworks that are better at these tasks without any further training. We also show that structured sparsity greatly helps in reducing the complexity of expensive robustness and detection methods, while maintaining or even improving their results on these tasks. Finally, we introduce a new method, SensNorm, which uses the sensitivity of weights derived from an appropriate pruning method to detect anomalous samples in the input.


title: Batch-efficient EigenDecomposition for Small and Medium Matrices

abstract: EigenDecomposition (ED) is at the heart of many computer vision algorithms and applications. One crucial bottleneck limiting its usage is the expensive computation cost, particularly for a mini-batch of matrices in the deep neural networks. In this paper, we propose a QR-based ED method dedicated to the application scenarios of computer vision. Our proposed method performs the ED entirely by batched matrix/vector multiplication, which processes all the matrices simultaneously and thus fully utilizes the power of GPUs. Our technique is based on the explicit QR iterations by Givens rotation with double Wilkinson shifts. With several acceleration techniques, the time complexity of QR iterations is reduced from $O{(}n^5{)}$ to $O{(}n^3{)}$. The numerical test shows that for small and medium batched matrices (\emph{e.g.,} $dim{<}32$) our method can be much faster than the Pytorch SVD function. Experimental results on visual recognition and image generation demonstrate that our methods also achieve competitive performances.


title: Spatiotemporal singular value decomposition for denoising in photoacoustic imaging with low-energy excitation light source

abstract: Photoacoustic (PA) imaging is an emerging hybrid imaging modality that combines rich optical spectroscopic contrast and high ultrasonic resolution and thus holds tremendous promise for a wide range of pre-clinical and clinical applications. Compact and affordable light sources such as light-emitting diodes (LEDs) and laser diodes (LDs) are promising alternatives to bulky and expensive solid-state laser systems that are commonly used as PA light sources. These could accelerate the clinical translation of PA technology. However, PA signals generated with these light sources are readily degraded by noise due to the low optical fluence, leading to decreased signal-to-noise ratio (SNR) in PA images. In this work, a spatiotemporal singular value decomposition (SVD) based PA denoising method was investigated for these light sources that usually have low fluence and high repetition rates. The proposed method leverages both spatial and temporal correlations between radiofrequency (RF) data frames. Validation was performed on simulations and in vivo PA data acquired from human fingers (2D) and forearm (3D) using a LED-based system. Spatiotemporal SVD greatly enhanced the PA signals of blood vessels corrupted by noise while preserving a high temporal resolution to slow motions, improving the SNR of in vivo PA images by 1.1, 0.7, and 1.9 times compared to single frame-based wavelet denoising, averaging across 200 frames, and single frame without denoising, respectively. The proposed method demonstrated a processing time of around 50 \mus per frame with SVD acceleration and GPU. Thus, spatiotemporal SVD is well suited to PA imaging systems with low-energy excitation light sources for real-time in vivo applications.


title: Einstein-Yang-Mills-aether theory with nonlinear axion field: Decay of color aether and the axionic dark matter production

abstract: We establish a nonlinear version of the SU(N) symmetric theory, which describes self-consistently the interaction between the gravitational, gauge, vector and pseudoscalar (axion) fields. In the context of this theory the SU(N) symmetric multiplet of vector fields is associated with the color aether, the decay of which in the early Universe produced the canonic dynamic aether and the axionic dark matter. The SU(N) symmetric Yang-Mills field, associated with the color aether, forms the source, which transfers the energy of the decaying color aether to the axion field. The nonlinear modification of the model uses explicitly the requirement of discrete symmetry, prescribed by the axion field, and is based on the analogy with nonlinear physical pendulum. We show that in the framework of this nonlinear regular model the axion field can grow to an arbitrarily large value, thus explaining the abundance of the axionic dark matter in the Universe.


title: CEG4N: Counter-Example Guided Neural Network Quantization Refinement

abstract: Neural networks are essential components of learning-based software systems. However, their high compute, memory, and power requirements make using them in low resources domains challenging. For this reason, neural networks are often quantized before deployment. Existing quantization techniques tend to degrade the network accuracy. We propose Counter-Example Guided Neural Network Quantization Refinement (CEG4N). This technique combines search-based quantization and equivalence verification: the former minimizes the computational requirements, while the latter guarantees that the network's output does not change after quantization. We evaluate CEG4N~on a diverse set of benchmarks, including large and small networks. Our technique successfully quantizes the networks in our evaluation while producing models with up to 72% better accuracy than state-of-the-art techniques.


title: Construction of MDS self-dual codes from generalized Reed-Solomon codes

abstract: MDS codes and self-dual codes are important families of classical codes in coding theory. It is of interest to investigate MDS self-dual codes. The existence of MDS self-dual codes over finite field $F_q$ is completely solved for $q$ is even. In this paper, for finite field with odd characteristic, we construct some new classes of MDS self-dual codes by (extended) generalized Reed-Solomon codes.