title: On computing root polynomials and minimal bases of matrix pencils

abstract: We revisit the notion of root polynomials, thoroughly studied in [F. Dopico and V. Noferini, Root polynomials and their role in the theory of matrix polynomials, Linear Algebra Appl. 584:37--78, 2020] for general polynomial matrices, and show how they can efficiently be computed in the case of matrix pencils. The staircase algorithm implicitly computes so-called zero directions, as defined in [P. Van Dooren, Computation of zero directions of transfer functions, Proceedings IEEE 32nd CDC, 3132--3137, 1993]. However, zero directions generally do not provide the correct information on partial multiplicities and minimal indices. These indices are instead provided by two special cases of zero directions, namely, root polynomials and vectors of a minimal basis of the pencil. We show how to extract, starting from the block triangular pencil that the staircase algorithm computes, both a minimal basis and a maximal set of root polynomials in an efficient manner. Moreover, we argue that the accuracy of the computation of the root polynomials can be improved by making use of iterative refinement.


title: Vulnerability Characterization and Privacy Quantification for Cyber-Physical Systems

abstract: Cyber-physical systems (CPS) data privacy protection during sharing, aggregating, and publishing is a challenging problem. Several privacy protection mechanisms have been developed in the literature to protect sensitive data from adversarial analysis and eliminate the risk of re-identifying the original properties of shared data. However, most of the existing solutions have drawbacks, such as (i) lack of a proper vulnerability characterization model to accurately identify where privacy is needed, (ii) ignoring data providers privacy preference, (iii) using uniform privacy protection which may create inadequate privacy for some provider while overprotecting others, and (iv) lack of a comprehensive privacy quantification model assuring data privacy-preservation. To address these issues, we propose a personalized privacy preference framework by characterizing and quantifying the CPS vulnerabilities as well as ensuring privacy. First, we introduce a Standard Vulnerability Profiling Library (SVPL) by arranging the nodes of an energy-CPS from maximum to minimum vulnerable based on their privacy loss. Based on this model, we present our personalized privacy framework (PDP) in which Laplace noise is added based on the individual node's selected privacy preferences. Finally, combining these two proposed methods, we demonstrate that our privacy characterization and quantification model can attain better privacy preservation by eliminating the trade-off between privacy, utility, and risk of losing information.


title: Temperature Dependent Characteristics and Electrostatic Threshold Voltage Tuning of Accumulated Body MOSFETs

abstract: Narrow-channel accumulated body nMOSFET devices with p-type side-gates surrounding the active area have been electrically characterized between 100 and 400 K with varied side-gate biasing (Vside). The subthreshold slope (SS) and drain induced barrier lowering (DIBL) decrease and threshold voltage (Vt) increases linearly with reduced temperature and reduced side-gate bias. Detailed analysis on a 27 nm x 78 nm (width x length) device show SS decreasing from 115 mV/dec at 400 K to 90 mV/dec at 300 K and down to 36 mV/dec at 100 K, DIBL decreasing by approximately 10 mV/V for each 100 K reduction in operating temperature, and Vt increasing from 0.42 V to 0.61 V as the temperature is reduced from 400 K to 100 K. Vt can be adjusted from ~ 0.3 V to ~ 1.1 V with ~0.3 V/V sensitivity by depletion or accumulation of the body of the device using Vside. This high level of tunability allows electronic control of Vt and drive current for variable temperature operation in a wide temperature range with extremely low leakage currents (< 10-13 A).


title: EPTAS and Subexponential Algorithm for Maximum Clique on Disk and Unit Ball Graphs

abstract: A (unit) disk graph is the intersection graph of closed (unit) disks in the plane. Almost three decades ago, an elegant polynomial-time algorithm was found for \textsc{Maximum Clique} on unit disk graphs [Clark, Colbourn, Johnson; Discrete Mathematics '90]. Since then, it has been an intriguing open question whether or not tractability can be extended to general disk graphs. We show that the disjoint union of two odd cycles is never the complement of a disk graph nor of a unit (3-dimensional) ball graph. From that fact and existing results, we derive a simple QPTAS and a subexponential algorithm running in time $2^{\tilde{O}(n^{2/3})}$ for \textsc{Maximum Clique} on disk and unit ball graphs. We then obtain a randomized EPTAS for computing the independence number on graphs having no disjoint union of two odd cycles as an induced subgraph, bounded VC-dimension, and linear independence number. This, in combination with our structural results, yields a randomized EPTAS for \textsc{Max Clique} on disk and unit ball graphs. \textsc{Max Clique} on unit ball graphs is equivalent to finding, given a collection of points in $\mathbb R^3$, a maximum subset of points with diameter at most some fixed value. In stark contrast, \textsc{Maximum Clique} on ball graphs and unit $4$-dimensional ball graphs, as well as intersection graphs of filled ellipses (even close to unit disks) or filled triangles is unlikely to have such algorithms. Indeed, we show that, for all those problems, there is a constant ratio of approximation which cannot be attained even in time $2^{n^{1-\varepsilon}}$, unless the Exponential Time Hypothesis fails.


title: Iterative and greedy algorithms for the sparsity in levels model in compressed sensing

abstract: Motivated by the question of optimal functional approximation via compressed sensing, we propose generalizations of the Iterative Hard Thresholding and the Compressive Sampling Matching Pursuit algorithms able to promote sparse in levels signals. We show, by means of numerical experiments, that the proposed algorithms are successfully able to outperform their unstructured variants when the signal exhibits the sparsity structure of interest. Moreover, in the context of piecewise smooth function approximation, we numerically demonstrate that the structure promoting decoders outperform their unstructured variants and the basis pursuit program when the encoder is structure agnostic.


title: Recognizing k-leaf powers in polynomial time, for constant k

abstract: A graph $G$ is a $k$-leaf power if there exists a tree $T$ whose leaf set is $V(G)$, and such that $uv \in E(G)$ if and only if the distance between $u$ and $v$ in $T$ is at most $k$. The graph classes of $k$-leaf powers have several applications in computational biology, but recognizing them has remained a challenging algorithmic problem for the past two decades. The best known result is that $6$-leaf powers can be recognized in polynomial time. In this paper, we present an algorithm that decides whether a graph $G$ is a $k$-leaf power in time $O(n^{f(k)})$ for some function $f$ that depends only on $k$ (but has the growth rate of a power tower function). Our techniques are based on the fact that either a $k$-leaf power has a corresponding tree of low maximum degree, in which case finding it is easy, or every corresponding tree has large maximum degree. In the latter case, large degree vertices in the tree imply that $G$ has redundant substructures which can be pruned from the graph. In addition to solving a longstanding open problem, we hope that the structural results presented in this work can lead to further results on $k$-leaf powers.


title: Controllability of vertex delay type problems by the regular linear systems approach

abstract: In this paper, we study the well-posedness and approximate controllability of a class of network systems having delays and controls at the boundary conditions. The particularity of this work is that the network system is defined on infinite metric graphs. This fact offers many difficulties in applying the usual methods. In fact, the well-posedness of the delay network system is obtained by using a semigroup approach on product spaces which is based on the concept of feedback theory of infinite-dimensional linear systems. This technique allows us to reformulate the delay system into a free-delay distributed control system. From this transformation, we deduce necessary and sufficient conditions for the boundary approximate controllability of such systems. Furthermore, a Rank condition for the approximate controllability is also obtained. This condition coincides with the usual Kalman controllability criterion in the case of a simple transport process on a finite graph. Finally, by applying our approach to a linear Eulerian model (with airborne delays) for (ATFM), we provide a new algebraic condition for the controllability of such a model in terms of the generic rank of the so-called extended controllability matrix.


title: Nanosecond Pulsed Discharge Dynamics During Passage of a Transient Laminar Flame

abstract: This work presents an experimental study of a nanosecond repetitively pulsed dielectric barrier discharge interacting with a transient laminar flame propagating in a channel of height near the quenching distance of the flame. The discharge and the flame are of comparable size, and the discharge is favoured at a location where it is coupled with the reaction zone and burned gas. The primary goal is to determine how the discharge evolves on the time scale of the flame passage, with the evolution driven by the changing gas state produced by the moving flame front. This work complements the large body of work investigating the effect of plasma to modify flame dynamics, by considering the other side of the interaction (how the discharge is modified by the flame). The hot gas produced by the combustion had a strong effect on the discharge, with the discharge preferentially forming in the region of hot combustion products. The per-pulse energy deposited by the discharge was measured and found to increase with the size of the discharge region and applied voltage. The pulse repetition frequency did not have a direct impact on the per-pulse energy, but did have an effect on the morphology and size of the discharge region. Two distinct discharge regimes were observed: uniform and filamentary (microdischarges). Higher pulse repetition frequencies and faster-cooling combustion products were more likely to transition to the filamentary regime, while lower frequencies and slower-cooling combustion products maintained a uniform regime for the entirety of the time the discharge was active. This regime transition was influenced by the ratio of the time scale of fluid motion to the pulse repetition rate. This work demonstrates the importance of considering how the discharge properties will change due to combustion processes in applications utilizing plasma assistance for transient combustion systems.


title: Physics-Driven Learning of Wasserstein GAN for Density Reconstruction in Dynamic Tomography

abstract: Object density reconstruction from projections containing scattered radiation and noise is of critical importance in many applications. Existing scatter correction and density reconstruction methods may not provide the high accuracy needed in many applications and can break down in the presence of unmodeled or anomalous scatter and other experimental artifacts. Incorporating machine-learned models could prove beneficial for accurate density reconstruction particularly in dynamic imaging, where the time-evolution of the density fields could be captured by partial differential equations or by learning from hydrodynamics simulations. In this work, we demonstrate the ability of learned deep neural networks to perform artifact removal in noisy density reconstructions, where the noise is imperfectly characterized. We use a Wasserstein generative adversarial network (WGAN), where the generator serves as a denoiser that removes artifacts in densities obtained from traditional reconstruction algorithms. We train the networks from large density time-series datasets, with noise simulated according to parametric random distributions that may mimic noise in experiments. The WGAN is trained with noisy density frames as generator inputs, to match the generator outputs to the distribution of clean densities (time-series) from simulations. A supervised loss is also included in the training, which leads to improved density restoration performance. In addition, we employ physics-based constraints such as mass conservation during network training and application to further enable highly accurate density reconstructions. Our preliminary numerical results show that the models trained in our frameworks can remove significant portions of unknown noise in density time-series data.


title: Distill: Domain-Specific Compilation for Cognitive Models

abstract: This paper discusses our proposal and implementation of Distill, a domain-specific compilation tool based on LLVM to accelerate cognitive models. Cognitive models explain the process of cognitive function and offer a path to human-like artificial intelligence. However, cognitive modeling is laborious, requiring composition of many types of computational tasks, and suffers from poor performance as it relies on high-level languages like Python. In order to continue enjoying the flexibility of Python while achieving high performance, Distill uses domain-specific knowledge to compile Python-based cognitive models into LLVM IR, carefully stripping away features like dynamic typing and memory management that add overheads to the actual model. As we show, this permits significantly faster model execution. We also show that the code so generated enables using classical compiler data flow analysis passes to reveal properties about data flow in cognitive models that are useful to cognitive scientists. Distill is publicly available, is being used by researchers in cognitive science, and has led to patches that are currently being evaluated for integration into mainline LLVM.


title: RadBERT-CL: Factually-Aware Contrastive Learning For Radiology Report Classification

abstract: Radiology reports are unstructured and contain the imaging findings and corresponding diagnoses transcribed by radiologists which include clinical facts and negated and/or uncertain statements. Extracting pathologic findings and diagnoses from radiology reports is important for quality control, population health, and monitoring of disease progress. Existing works, primarily rely either on rule-based systems or transformer-based pre-trained model fine-tuning, but could not take the factual and uncertain information into consideration, and therefore generate false-positive outputs. In this work, we introduce three sedulous augmentation techniques which retain factual and critical information while generating augmentations for contrastive learning. We introduce RadBERT-CL, which fuses these information into BlueBert via a self-supervised contrastive loss. Our experiments on MIMIC-CXR show superior performance of RadBERT-CL on fine-tuning for multi-class, multi-label report classification. We illustrate that when few labeled data are available, RadBERT-CL outperforms conventional SOTA transformers (BERT/BlueBert) by significantly larger margins (6-11%). We also show that the representations learned by RadBERT-CL can capture critical medical information in the latent space.


title: High resolution calibration of string network evolution

abstract: The canonical velocity-dependent one-scale (VOS) model for cosmic string evolution contains a number of free parameters which cannot be obtained ab initio. Therefore it must be calibrated using high resolution numerical simulations. We exploit our state of the art graphically accelerated implementation of the evolution of local Abelian-Higgs string networks to provide a statistically robust calibration of this model. In order to do so, we will make use of the largest set of high resolution simulations carried out to date, for a variety of cosmological expansion rates, and explore the impact of key numerical choices on model calibration, including the dynamic range, lattice spacing, and the choice of numerical estimators for the mean string velocity. This sensitivity exploration shows that certain numerical choices will indeed have consequences for observationally crucial parameters, such as the loop chopping parameter. To conclude, we will also briefly illustrate how our results impact observational constraints on cosmic strings.


title: The SuperCam Infrared Spectrometer for the Perseverance Rover of the Mars2020 mission

abstract: We present the Infrared spectrometer of SuperCam Instrument Suite that enables the Mars 2020 Perseverance Rover to study remotely the Martian mineralogy within the Jezero crater. The SuperCam IR spectrometer is designed to acquire spectra in the 1.3-2.6 $\mu$m domain at a spectral resolution ranging from 5 to 20~nm. The field-of-view of 1.15 mrad, is coaligned with the boresights of the other remote-sensing techniques provided by SuperCam: laser-induced breakdown spectroscopy, remote time-resolved Raman and luminescence spectroscopies, and visible reflectance spectroscopy, and micro-imaging. The IR spectra can be acquired from the robotic-arm workspace to long-distances, in order to explore the mineralogical diversity of the Jezero crater, guide the Perseverance Rover in its sampling task, and to document the samples' environment. We present the design, the performance, the radiometric calibration, and the anticipated operations at the surface of Mars.


title: Discrepancy of arithmetic progressions in grids

abstract: We prove that the the discrepancy of arithmetic progressions in the $d$-dimensional grid $\{1, \dots, N\}^d$ is within a constant factor depending only on $d$ of $N^{\frac{d}{2d+2}}$. This extends the case $d=1$, which is a celebrated result of Roth and of Matou\v{s}ek and Spencer, and removes the polylogarithmic factor from the previous upper bound of Valk\'o from about two decades ago. We further prove similarly tight bounds for grids of differing side lengths in many cases.


title: Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction

abstract: Noise robustness is essential for deploying automatic speech recognition (ASR) systems in real-world environments. One way to reduce the effect of noise interference is to employ a preprocessing module that conducts speech enhancement, and then feed the enhanced speech to an ASR backend. In this work, instead of suppressing background noise with a conventional cascaded pipeline, we employ a noise-robust representation learned by a refined self-supervised framework for noisy speech recognition. We propose to combine a reconstruction module with contrastive learning and perform multi-task continual pre-training on noisy data. The reconstruction module is used for auxiliary learning to improve the noise robustness of the learned representation and thus is not required during inference. Experiments demonstrate the effectiveness of our proposed method. Our model substantially reduces the word error rate (WER) for the synthesized noisy LibriSpeech test sets, and yields around 4.1/7.5% WER reduction on noisy clean/other test sets compared to data augmentation. For the real-world noisy speech from the CHiME-4 challenge (1-channel track), we have obtained the state of the art ASR performance without any denoising front-end. Moreover, we achieve comparable performance to the best supervised approach reported with only 16% of labeled data.


title: Universal Decision Models

abstract: Humans are universal decision makers: we reason causally to understand the world; we act competitively to gain advantage in commerce, games, and war; and we are able to learn to make better decisions through trial and error. In this paper, we propose Universal Decision Model (UDM), a mathematical formalism based on category theory. Decision objects in a UDM correspond to instances of decision tasks, ranging from causal models and dynamical systems such as Markov decision processes and predictive state representations, to network multiplayer games and Witsenhausen's intrinsic models, which generalizes all these previous formalisms. A UDM is a category of objects, which include decision objects, observation objects, and solution objects. Bisimulation morphisms map between decision objects that capture structure-preserving abstractions. We formulate universal properties of UDMs, including information integration, decision solvability, and hierarchical abstraction. We describe universal functorial representations of UDMs, and propose an algorithm for computing the minimal object in a UDM using algebraic topology. We sketch out an application of UDMs to causal inference in network economics, using a complex multiplayer producer-consumer two-sided marketplace.


title: The Hubbard Model on the Honeycomb Lattice with Hybrid Monte Carlo

abstract: We take advantage of recent improvements in the grand canonical Hybrid Monte Carlo (HMC) algorithm, to perform a precision study of the single-particle gap in the hexagonal Hubbard model, with on-site electron-electron interactions. After carefully controlled analyses of the Trotter error, the thermodynamic limit, and finite-size scaling with inverse temperature, we find a critical coupling of $U_c/\kappa=3.835(14)$ and the critical exponent $\nu=1.181(43)$ for the semimetal-antiferromagnetic Mott insulator quantum phase transition in the hexagonal Hubbard Model. Based on these results, we provide a unified, comprehensive treatment of all operators that contribute to the anti-ferromagnetic, ferromagnetic, and charge-density-wave structure factors and order parameters of the hexagonal Hubbard Model. We expect our findings to improve the consistency of Monte Carlo determinations of critical exponents. We perform a data collapse analysis and determine the critical exponent $\beta=0.898(37)$. We consider our findings in view of the $SU(2)$ Gross-Neveu, or chiral Heisenberg, universality class. We also discuss the computational scaling of the HMC algorithm. Our methods are applicable to a wide range of lattice theories of strongly correlated electrons. The Ising model, a simple statistical model for ferromagnetism, is one such theory. There are analytic solutions for low dimensions and very efficient Monte Carlo methods, such as cluster algorithms, for simulating this model in special cases. However most approaches do not generalise to arbitrary lattices and couplings. We present a formalism that allows one to apply HMC simulations to the Ising model, demonstrating how a system with discrete degrees of freedom can be simulated with continuous variables.


title: Fuzzm: Finding Memory Bugs through Binary-Only Instrumentation and Fuzzing of WebAssembly

abstract: WebAssembly binaries are often compiled from memory-unsafe languages, such as C and C++. Because of WebAssembly's linear memory and missing protection features, e.g., stack canaries, source-level memory vulnerabilities are exploitable in compiled WebAssembly binaries, sometimes even more easily than in native code. This paper addresses the problem of detecting such vulnerabilities through the first binary-only fuzzer for WebAssembly. Our approach, called Fuzzm, combines canary instrumentation to detect overflows and underflows on the stack and the heap, an efficient coverage instrumentation, a WebAssembly VM, and the input generation algorithm of the popular AFL fuzzer. Besides as an oracle for fuzzing, our canaries also serve as a stand-alone binary hardening technique to prevent the exploitation of vulnerable binaries in production. We evaluate Fuzzm with 28 real-world WebAssembly binaries, some compiled from source and some found in the wild without source code. The fuzzer explores thousands of execution paths, triggers dozens of crashes, and performs hundreds of program executions per second. When used for binary hardening, the approach prevents previously published exploits against vulnerable WebAssembly binaries while imposing low runtime overhead.


title: Synthesis and characterization of boron nitride powders produced under concentrated light

abstract: Synthesis and research of the properties of boron nitride powders and BN powders with additives produced under effect of concentrated light in a flow of nitrogen in a xenon high-flux optical furnace are presented. A scanning and transmission electron microscopes demonstrated structures of new morphologies for the powders, which were formed. XRD, Raman scattering and electron diffraction study have confirmed a complicated structure and phase composition of the powders with a prevalence of the amorphous phases. It was demonstrated an effect of experimental conditions, surface modification and additives on phase composition, morphology and structure formation. The gaseous model based on an evolution of the bubble has been confirmed new nanostructure formation. Burst of these bubbles may result in graphene-like structures formation.


title: Threshold dynamics of SAIRS epidemic model with Semi-Markov switching

abstract: We study the threshold dynamics of a stochastic SAIRS-type model with vaccination, where the role of asymptomatic and symptomatic infectious individuals is explicitly considered in the epidemic dynamics. In the model, the values of the disease transmission rate may switch between different levels under the effect of a semi-Markov process. We provide sufficient conditions ensuring the almost surely epidemic extinction and persistence in time mean. In the case of disease persistence, we investigate the omega-limit set of the system and give sufficient conditions for the existence and uniqueness of an invariant probability measure.


title: Solving the Yamabe-Type Equations on Closed Manifolds by Iteration Schemes

abstract: We introduce a double iterative scheme and local variational method to solve the Yamabe-type equation $ - \frac{4(n - 1)}{n - 2}\Delta_{g} u + (S_{g} + \beta ) u = \lambda u^{\frac{n + 2}{n - 2}} $ for some constant $ \beta \leqslant 0 $, locally on Riemannian domain $ (\Omega, g) $ with trivial Dirichlet condition and globally on closed manifolds $ (M, g) $; the dimensions of $ \Omega $ and $ M $ are at least 3. In contrast to the traditional global variational method, these Yamabe-type equations on closed manifolds are analyzed by local analysis and monotone iteration scheme. In particular, we do not need to use the Weyl tensor. In particular, the sign of the first eigenvalue $ \eta_{1} $ of conformal Laplacian $ \Box_{g} u : = - \frac{4(n - 1)}{n - 2}\Delta_{g} u + S_{g} u $ plays the central role. When letting $ \beta \rightarrow 0 $ from the left, we reproof the classical Yamabe problem as a natural consequence of the Yamabe-type equations. The results are classified by the sign of $ \eta_{1} $.


title: Discrete-time random walks and L\'evy flights on arbitrary networks: when resetting becomes advantageous?

abstract: The spectral theory of random walks on networks of arbitrary topology can be readily extended to study random walks and L\'evy flights subject to resetting on these structures. When a discrete-time process is stochastically brought back from time to time to its starting node, the mean search time needed to reach another node of the network may be significantly decreased. In other cases, however, resetting is detrimental to search. Using the eigenvalues and eigenvectors of the transition matrix defining the process without resetting, we derive a general criterion for finite networks that establishes when there exists a non-zero resetting probability that minimizes the mean first passage time at a target node. Right at optimality, the coefficient of variation of the first passage time is not unity, unlike in continuous time processes with instantaneous resetting, but above 1 and depends on the minimal mean first passage time. The approach is general and applicable to the study of different discrete-time ergodic Markov processes such as L\'evy flights, where the long-range dynamics is introduced in terms of the fractional Laplacian of the graph. We apply these results to the study of optimal transport on rings and Cayley trees.


title: InfoGCL: Information-Aware Graph Contrastive Learning

abstract: Various graph contrastive learning models have been proposed to improve the performance of learning tasks on graph datasets in recent years. While effective and prevalent, these models are usually carefully customized. In particular, although all recent researches create two contrastive views, they differ greatly in view augmentations, architectures, and objectives. It remains an open question how to build your graph contrastive learning model from scratch for particular graph learning tasks and datasets. In this work, we aim to fill this gap by studying how graph information is transformed and transferred during the contrastive learning process and proposing an information-aware graph contrastive learning framework called InfoGCL. The key point of this framework is to follow the Information Bottleneck principle to reduce the mutual information between contrastive parts while keeping task-relevant information intact at both the levels of the individual module and the entire framework so that the information loss during graph representation learning can be minimized. We show for the first time that all recent graph contrastive learning methods can be unified by our framework. We empirically validate our theoretical analysis on both node and graph classification benchmark datasets, and demonstrate that our algorithm significantly outperforms the state-of-the-arts.


title: Dense Hierarchical Retrieval for Open-Domain Question Answering

abstract: Dense neural text retrieval has achieved promising results on open-domain Question Answering (QA), where latent representations of questions and passages are exploited for maximum inner product search in the retrieval process. However, current dense retrievers require splitting documents into short passages that usually contain local, partial, and sometimes biased context, and highly depend on the splitting process. As a consequence, it may yield inaccurate and misleading hidden representations, thus deteriorating the final retrieval result. In this work, we propose Dense Hierarchical Retrieval (DHR), a hierarchical framework that can generate accurate dense representations of passages by utilizing both macroscopic semantics in the document and microscopic semantics specific to each passage. Specifically, a document-level retriever first identifies relevant documents, among which relevant passages are then retrieved by a passage-level retriever. The ranking of the retrieved passages will be further calibrated by examining the document-level relevance. In addition, hierarchical title structure and two negative sampling strategies (i.e., In-Doc and In-Sec negatives) are investigated. We apply DHR to large-scale open-domain QA datasets. DHR significantly outperforms the original dense passage retriever and helps an end-to-end QA system outperform the strong baselines on multiple open-domain QA benchmarks.


title: HD-cos Networks: Efficient Neural Architectures for Secure Multi-Party Computation

abstract: Multi-party computation (MPC) is a branch of cryptography where multiple non-colluding parties execute a well designed protocol to securely compute a function. With the non-colluding party assumption, MPC has a cryptographic guarantee that the parties will not learn sensitive information from the computation process, making it an appealing framework for applications that involve privacy-sensitive user data. In this paper, we study training and inference of neural networks under the MPC setup. This is challenging because the elementary operations of neural networks such as the ReLU activation function and matrix-vector multiplications are very expensive to compute due to the added multi-party communication overhead. To address this, we propose the HD-cos network that uses 1) cosine as activation function, 2) the Hadamard-Diagonal transformation to replace the unstructured linear transformations. We show that both of the approaches enjoy strong theoretical motivations and efficient computation under the MPC setup. We demonstrate on multiple public datasets that HD-cos matches the quality of the more expensive baselines.


title: The Semimetal-Antiferromagnetic Mott Insulator Quantum Phase Transition of the Hubbard Model on the Honeycomb Lattice

abstract: The Hubbard model on the honeycomb lattice undergoes a quantum phase transition from a semimetallic to a Mott insulating phase and from a disordered to an anti-ferromagnetically phase. We show that these transitions occur simultaneously and we calculate the critical coupling $U_c=3.835(14)$ as well as the critical exponents $\nu=1.181(43)$ and $\beta=0.898(37)$ which are expected to fall into the $SU(2)$ Gross-Neveu universality class. For this we employ Hybrid Monte Carlo simulations, extrapolate the single particle gap and the spin structure factors to the thermodynamic and continuous time limits, and perform a data collapse fit. We also determine the zero temperature values of single particle gap and staggered magnetisation on both sides of the phase transition.


title: Scalable Unidirectional Pareto Optimality for Multi-Task Learning with Constraints

abstract: Multi-objective optimization (MOO) problems require balancing competing objectives, often under constraints. The Pareto optimal solution set defines all possible optimal trade-offs over such objectives. In this work, we present a novel method for Pareto-front learning: inducing the full Pareto manifold at train-time so users can pick any desired optimal trade-off point at run-time. Our key insight is to exploit Fritz-John Conditions for a novel guided double gradient descent strategy. Evaluation on synthetic benchmark problems allows us to vary MOO problem difficulty in controlled fashion and measure accuracy vs. known analytic solutions. We further test scalability and generalization in learning optimal neural model parameterizations for Multi-Task Learning (MTL) on image classification. Results show consistent improvement in accuracy and efficiency over prior MTL methods as well as techniques from operations research.


title: Equivariant $Q$ Learning in Spatial Action Spaces

abstract: Recently, a variety of new equivariant neural network model architectures have been proposed that generalize better over rotational and reflectional symmetries than standard models. These models are relevant to robotics because many robotics problems can be expressed in a rotationally symmetric way. This paper focuses on equivariance over a visual state space and a spatial action space -- the setting where the robot action space includes a subset of $\rm{SE}(2)$. In this situation, we know a priori that rotations and translations in the state image should result in the same rotations and translations in the spatial action dimensions of the optimal policy. Therefore, we can use equivariant model architectures to make $Q$ learning more sample efficient. This paper identifies when the optimal $Q$ function is equivariant and proposes $Q$ network architectures for this setting. We show experimentally that this approach outperforms standard methods in a set of challenging manipulation problems.


title: 10 Security and Privacy Problems in Large Foundation Models

abstract: Foundation models--such as GPT, CLIP, and DINO--have achieved revolutionary progress in the past several years and are commonly believed to be a promising approach for general-purpose AI. In particular, self-supervised learning is adopted to pre-train a foundation model using a large amount of unlabeled data. A pre-trained foundation model is like an ``operating system'' of the AI ecosystem. Specifically, a foundation model can be used as a feature extractor for many downstream tasks with little or no labeled training data. Existing studies on foundation models mainly focused on pre-training a better foundation model to improve its performance on downstream tasks in non-adversarial settings, leaving its security and privacy in adversarial settings largely unexplored. A security or privacy issue of a pre-trained foundation model leads to a single point of failure for the AI ecosystem. In this book chapter, we discuss 10 basic security and privacy problems for the pre-trained foundation models, including six confidentiality problems, three integrity problems, and one availability problem. For each problem, we discuss potential opportunities and challenges. We hope our book chapter will inspire future research on the security and privacy of foundation models.


title: Aggregation Phenomena in Lyotropic Chromonic Liquid Crystals

abstract: We study the aggregation phenomenon in lyotropic chromonic liquid crystals as the molecular concentration changes and condensing agents are added into the system. Using properties of the critical points of the Oseen-Frank energy of a nematic liquid crystal, combined with the geometric constraints of the hexagonal columnar chromonic phases, we show that the minimizers of the total energy are topologically equivalent to tori, in agreement with available experimental evidence on chromonic liquid crystals and DNA condensates, in viral capsids as well as in free solution. We model the system as bi-phasic, consisting of liquid crystal molecules and water, and postulate the total energy as the sum of the Flory-Huggins energy of mixing together with the bending and surface tension contributions of the liquid crystal. Two types of problems are considered, one related to finding the optimal shape of a torus, once the phase separation has occurred, and the second one that models the conditions leading to molecular aggregation. This work follows recent experimental investigations, but without addressing the topological properties of the toroidal nuclei observed and focusing on how the liquid crystal order competes with the aggregation phenomenon.


title: Choice and Market Design

abstract: A textbook chapter on modeling choice behavior and designing institutional choice functions for matching and market design. The chapter is to appear in: Online and Matching-Based Market Design. Federico Echenique, Nicole Immorlica and Vijay V. Vazirani, Editors. Cambridge University Press. 2021


title: On Wasted Contributions: Understanding the Dynamics of Contributor-Abandoned Pull Requests

abstract: Pull-based development has enabled numerous volunteers to contribute to open-source projects with fewer barriers. Nevertheless, a considerable amount of pull requests (PRs) with valid contributions are abandoned by their contributors, wasting the effort and time put in by both the contributors and maintainers. To better understand the underlying dynamics of contributor-abandoned PRs, we conduct a mixed-methods study using both quantitative and qualitative methods. We curate a dataset consisting of 265,325 PRs including 4,450 abandoned ones from ten popular and mature GitHub projects and measure 16 features characterizing PRs, contributors, review processes, and projects. Using statistical and machine learning techniques, we find that complex PRs, novice contributors, and lengthy reviews have a higher probability of abandonment and the rate of PR abandonment fluctuates alongside the projects' maturity or workload. To identify why contributors abandon their PRs, we also manually examine a random sample of 354 abandoned PRs. We observe that the most frequent abandonment reasons are related to the obstacles faced by contributors, followed by the hurdles imposed by maintainers during the review process. Finally, we survey the top core maintainers of the studied projects to understand their perspectives on dealing with PR abandonment and on our findings.


title: Automated Translation of Rebar Information from GPR Data into As-Built BIM: A Deep Learning-based Approach

abstract: Building Information Modeling (BIM) is increasingly used in the construction industry, but existing studies often ignore embedded rebars. Ground Penetrating Radar (GPR) provides a potential solution to develop as-built BIM with surface elements and rebars. However, automatically translating rebars from GPR into BIM is challenging since GPR cannot provide any information about the scanned element. Thus, we propose an approach to link GPR data and BIM according to Faster R-CNN. A label is attached to each element scanned by GPR for capturing the labeled images, which are used with other images to build a 3D model. Meanwhile, Faster R-CNN is introduced to identify the labels, and the projection relationship between images and the model is used to localize the scanned elements in the 3D model. Two concrete buildings is selected to evaluate the proposed approach, and the results reveal that our method could accurately translate the rebars from GPR data into corresponding elements in BIM with correct distributions.


title: Privacy-Preserving Inference on the Ratio of Two Gaussians Using Sums

abstract: The ratio of two Gaussians is useful in many contexts of statistical inference. We discuss statistically valid inference of the ratio under Differential Privacy (DP). We use the delta method to derive the asymptotic distribution of the ratio estimator and use the Gaussian mechanism to provide (epsilon, delta)-DP guarantees. Like many statistics, quantities involved in the inference of a ratio can be re-written as functions of sums, and sums are easy to work with for many reasons. In the context of DP, the sensitivity of a sum is easy to calculate. We focus on getting the correct coverage probability of 95\% confidence intervals (CIs) of the DP ratio estimator. Our simulations show that the no-correction method, which ignores the DP noise, gives CIs that are too narrow to provide proper coverage for small samples. In our specific simulation scenario, the coverage of 95% CIs can be as low as below 10%. We propose two methods to mitigate the under-coverage issue, one based on Monte Carlo simulation and the other based on analytical correction. We show that the CIs of our methods have much better coverage with reasonable privacy budgets. In addition, our methods can handle weighted data, when the weights are fixed and bounded.


title: Sobolev regularity for nonlinear Poisson equations with Neumann boundary conditions on Riemannian manifolds

abstract: In this paper, we study the Sobolev regularity of solutions to nonlinear second order elliptic equations with super-linear first-order terms on Riemannian manifolds, complemented with Neumann boundary conditions, when the source term of the equation belongs to a Lebesgue space, under various integrability regimes. Our method is based on an integral refinement of the Bochner's identity, and leads to "semilinear Calder\'on-Zygmund" type results. Applications to the problem of smoothness of solutions to Mean Field Games systems with Neumann boundary conditions posed on convex domains of the Euclidean space will also be discussed.


title: On the Potential of Fourier-Encoded Saturation Transfers for Sensitizing Solid-State Magic-Angle Spinning NMR Experiments

abstract: Chemical exchange saturation transfer (CEST) is widely used for enhancing the solution NMR signatures of magnetically-dilute spin pools; in particular species at low concentrations undergoing chemical exchanges with an abundant spin pool. CEST's main feature involves encoding and then detecting the weak NMR signals of the magnetically dilute spin pools on a magnetically abundant spin pool of much easier detection - for instance the protons of H2O. Inspired by this method, we propose and exemplify a methodology to enhance the sensitivity of magic-angle spinning (MAS) solid-state NMR spectra. Our proposal uses the abundant 1H reservoir arising in organic solids as the magnetically abundant spin pool, and relies on proton spin diffusion in lieu of chemical exchange to mediate polarization transfer between a magnetically dilute spin pool and this magnetically abundant spin reporter. As an initial test of this idea we target the spectroscopy of naturally-abundant 13C, and rely on a Fourier-encoded version of the CEST experiment for achieving broadbandness in coordination with both MAS and heteronuclear decoupling - features normally absent in CEST. Arbitrary evolutions of multiple 13C sites can thus be imprinted on the entire 1H reservoir, which is subsequently detected. Theoretical predictions suggest that orders-of-magnitude signal enhancements should be achievable in this manner - on the order of the ratio between the 13C and the 1H reservoirs' abundances. Experiments carried out under magic-angle spinning conditions evidenced ca. 5-10x enhancements. Further opportunities and challenges arising in this Fourier-Encoded Saturation Transfer (FEST) MAS NMR approach are briefly discussed.


title: Theory of Figures to the 7th order and the interiors of Jupiter and Saturn

abstract: Interior modeling of Jupiter and Saturn has advanced to a state where thousands of models are generated that cover the uncertainty space of many parameters. This approach demands a fast method of computing their gravity field and shape. Moreover, the Cassini mission at Saturn and the ongoing Juno mission delivered gravitational harmonics up to J12. Here, we report the expansion of the Theory of Figures, which is a fast method for gravity field and shape computation, to the 7th-order (ToF7), which allows for computation of up to J14. We apply three different codes to compare the accuracy using polytropic models. We apply ToF7 to Jupiter and Saturn interior models in conjunction with CMS-19 H/He-EOS. For Jupiter, we find that J6 is best matched by a transition from He-depleted to He-enriched envelope at 2-2.5 Mbar. However, the atmospheric metallicity reaches 1xtimes solar only if the adiabat is perturbed toward lower densities, or if the surface temperature is enhanced by ~14 K from the Galileo value. Our Saturn models imply a largely homogeneous-in-Z envelope at 1.5-4x solar atop a small core. Perturbing the adiabat yields metallicity profiles with extended, heavy-element enriched deep interior (diffuse core) out to 0.4 RSat, as for Jupiter. Classical models with compact, dilute, or no core are possible as long as the deep interior is enriched in heavy-elements. Including a thermal wind fitted to the observed wind speeds, representative Jupiter and Saturn models are consistent with all observed Jn values.


title: Using Text Analytics for Health to Get Meaningful Insights from a Corpus of COVID Scientific Papers

abstract: Since the beginning of COVID pandemic, there have been around 700000 scientific papers published on the subject. A human researcher cannot possibly get acquainted with such a huge text corpus -- and therefore developing AI-based tools to help navigating this corpus and deriving some useful insights from it is highly needed. In this paper, we will use Text Analytics for Health pre-trained service together with some cloud tools to extract some knowledge from scientific papers, gain insights, and build a tool to help researcher navigate the paper collection in a meaningful way.


title: VigDet: Knowledge Informed Neural Temporal Point Process for Coordination Detection on Social Media

abstract: Recent years have witnessed an increasing use of coordinated accounts on social media, operated by misinformation campaigns to influence public opinion and manipulate social outcomes. Consequently, there is an urgent need to develop an effective methodology for coordinated group detection to combat the misinformation on social media. However, existing works suffer from various drawbacks, such as, either limited performance due to extreme reliance on predefined signatures of coordination, or instead an inability to address the natural sparsity of account activities on social media with useful prior domain knowledge. Therefore, in this paper, we propose a coordination detection framework incorporating neural temporal point process with prior knowledge such as temporal logic or pre-defined filtering functions. Specifically, when modeling the observed data from social media with neural temporal point process, we jointly learn a Gibbs-like distribution of group assignment based on how consistent an assignment is to (1) the account embedding space and (2) the prior knowledge. To address the challenge that the distribution is hard to be efficiently computed and sampled from, we design a theoretically guaranteed variational inference approach to learn a mean-field approximation for it. Experimental results on a real-world dataset show the effectiveness of our proposed method compared to the SOTA model in both unsupervised and semi-supervised settings. We further apply our model on a COVID-19 Vaccine Tweets dataset. The detection result suggests the presence of suspicious coordinated efforts on spreading misinformation about COVID-19 vaccines.


title: Study of $\text{D}^0$ meson interactions via femtoscopic correlations

abstract: Femtoscopy is a powerful tool that can be used to investigate the space-time dimensions of the region from which the particles are emitted. When applied to high energy collisions this method is sensitive not only to quantum statistics, but also to final state interactions, such as strong interactions between hadrons and Coulomb interactions when considering charged particles. In particular, this procedure is used to investigate the sensitivity of the strong interaction to different source sizes for $\textrm{D}^{0}$ mesons correlations.


title: FAST: DNN Training Under Variable Precision Block Floating Point with Stochastic Rounding

abstract: Block Floating Point (BFP) can efficiently support quantization for Deep Neural Network (DNN) training by providing a wide dynamic range via a shared exponent across a group of values. In this paper, we propose a Fast First, Accurate Second Training (FAST) system for DNNs, where the weights, activations, and gradients are represented in BFP. FAST supports matrix multiplication with variable precision BFP input operands, enabling incremental increases in DNN precision throughout training. By increasing the BFP precision across both training iterations and DNN layers, FAST can greatly shorten the training time while reducing overall hardware resource usage. Our FAST Multipler-Accumulator (fMAC) supports dot product computations under multiple BFP precisions. We validate our FAST system on multiple DNNs with different datasets, demonstrating a 2-6$\times$ speedup in training on a single-chip platform over prior work based on \textbf{mixed-precision or block} floating point number systems while achieving similar performance in validation accuracy.


title: DFL: High-Performance Blockchain-Based Federated Learning

abstract: Many researchers have proposed replacing the aggregation server in federated learning with a blockchain system to improve privacy, robustness, and scalability. In this approach, clients would upload their updated models to the blockchain ledger and use a smart contract to perform model averaging. However, the significant delay and limited computational capabilities of blockchain systems make it inefficient to support machine learning applications on the blockchain. In this paper, we propose a new public blockchain architecture called DFL, which is specially optimized for distributed federated machine learning. Our architecture inherits the merits of traditional blockchain systems while achieving low latency and low resource consumption by waiving global consensus. To evaluate the performance and robustness of our architecture, we implemented a prototype and tested it on a physical four-node network, and also developed a simulator to simulate larger networks and more complex situations. Our experiments show that the DFL architecture can reach over 90\% accuracy for non-I.I.D. datasets, even in the presence of model poisoning attacks, while ensuring that the blockchain part consumes less than 5\% of hardware resources.


title: Open Problem: Tight Online Confidence Intervals for RKHS Elements

abstract: Confidence intervals are a crucial building block in the analysis of various online learning problems. The analysis of kernel based bandit and reinforcement learning problems utilize confidence intervals applicable to the elements of a reproducing kernel Hilbert space (RKHS). However, the existing confidence bounds do not appear to be tight, resulting in suboptimal regret bounds. In fact, the existing regret bounds for several kernelized bandit algorithms (e.g., GP-UCB, GP-TS, and their variants) may fail to even be sublinear. It is unclear whether the suboptimal regret bound is a fundamental shortcoming of these algorithms or an artifact of the proof, and the main challenge seems to stem from the online (sequential) nature of the observation points. We formalize the question of online confidence intervals in the RKHS setting and overview the existing results.


title: Learning physics confers pose-sensitivity in structure-based virtual screening

abstract: In drug discovery, structure-based virtual high-throughput screening (vHTS) campaigns aim to identify bioactive ligands or "hits" for therapeutic protein targets from docked poses at specific binding sites. However, while generally successful at this task, many deep learning methods are known to be insensitive to protein-ligand interactions, decreasing the reliability of hit detection and hindering discovery at novel binding sites. Here, we overcome this limitation by introducing a class of models with two key features: 1) we condition bioactivity on pose quality score, and 2) we present poor poses of true binders to the model as negative examples. The conditioning forces the model to learn details of physical interactions. We evaluate these models on a new benchmark designed to detect pose-sensitivity.


title: Human-Computer Interaction Glow Up: Examining Operational Trust and Intention Towards Mars Autonomous Systems

abstract: Tactful coordination on earth between hundreds of operators from diverse disciplines and backgrounds is needed to ensure that Martian rovers have a high likelihood of achieving their science goals while enduring the harsh environment of the red planet. The operations team includes many individuals, each with independent and overlapping objectives, working to decide what to execute on the Mars surface during the next planning period. The team must work together to understand each other's objectives and constraints within a fixed time period, often requiring frequent revision. This study examines the challenges faced during Mars surface operations, from high-level science objectives to formulating a valid, safe, and optimal activity plan that is ready to be radiated to the rover. Through this examination, we aim to illuminate how planning intent can be formulated and effectively communicated to future spacecrafts that will become more and more autonomous. Our findings reveal the intricate nature of human-to-human interactions that require a large array of soft skills and core competencies to communicate concurrently with science and engineering teams during plan formulation. Additionally, our findings exposed significant challenges in eliciting planning intent from operators, which will intensify in the future, as operators on the ground asynchronously co-operate the rover with the on board autonomy. Building a marvellous robot and landing it onto the Mars surface are remarkable feats -however, ensuring that scientists can get the best out of the mission is an ongoing challenge and will not cease to be a difficult task with increased autonomy.


title: A Quantitative Analysis of the Ignition Characteristics of Fine Iron Particles

abstract: Ignition of iron particles in an oxidizing environment marks the onset of a self-sustained combustion. The objective of the current study is to quantitatively examine the ignition characteristics of fine iron particles governed by the kinetics of solid-phase iron oxidation. The oxidation rates are inversely proportional to the thickness of the oxide layer and calibrated using the experimentally measured growth of iron-oxide layers over time. Steady-state and unsteady analysis have been performed to probe the dependence of the critical gas temperature required to trigger a thermal runaway (namely, the ignition temperature $T_\mathrm{ign}$) on particle size, initial thickness of oxide layer, inert gas species, radiative heat loss, and the collective heating effect in a suspension of particles. Both analyses indicate that $T_\mathrm{ign}$ depends on $\delta_0$, i.e., the ratio between the initial oxide layer thickness and particle size, regardless of the absolute size of the particle. The unsteady analysis predicts that, for $\delta_0 \lesssim 0.003$, $T_\mathrm{ign}$ becomes independent of $\delta_0$. Under standard conditions in air, $T_\mathrm{ign}$ is approximately 1080 K for any particle size greater than 5 microns. Radiative heat loss has a minor effect on $T_\mathrm{ign}$. The collective effect of a suspension of iron particles in reducing $T_\mathrm{ign}$ is demonstrated. The transition behavior between kinetic-controlled and external-diffusion-controlled combustion regimes of an ignited iron particle is systematically examined. The influences of initial oxide-layer thickness and particle temperature on the ignition delay time, $\tau_\mathrm{ign}$, of iron particles are parametrically probed. A $d^2$-law scaling between $\tau_\mathrm{ign}$ and particle size is identified.


title: Coupled Surface Diffusion and Mean Curvature Motion: Axisymmetric Steady States with Two Grains and a Hole

abstract: The evolution of two grains, which lie on a substrate and are in contact with each other, can be roughly described by a model in which the exterior surfaces of the grains evolve by surface diffusion and the grain boundary, namely the contact surface between the adjacent grains, evolves by motion by mean curvature. We consider an axi-symmetric two grain system, contained within an inert bounding semi-infinite cylinder with a hole along the axis of symmetry. Boundary conditions are imposed reflecting the considerations of W.W. Mullins, 1958. We focus here on the steady states of this system. At steady state, the exterior surfaces have constant and equal mean curvatures, and the grain boundary has zero mean curvature; the exterior surfaces are nodoids and the grain boundary surface is a catenoid. The physical parameters in the model can be expressed via two angles $\beta$ and $\theta_c$, which depend on the surface free energies. Typically if a steady state solution exists for given values of $(\beta, \theta_c)$, then there exists a continuum of such solutions. In particular, we prove that there exists a continuum of solutions with $\theta_c=\pi$ for any $\beta \in (\pi/2, \pi)$.


title: Metric Assisted Stochastic Sampling (MASS) search for gravitational waves from binary black hole mergers

abstract: We present a novel gravitational wave detection algorithm that conducts a matched filter search stochastically across the compact binary parameter space rather than relying on a fixed bank of template waveforms. This technique is competitive with standard template-bank-driven pipelines in both computational cost and sensitivity. However, the complexity of the analysis is simpler allowing for easy configuration and horizontal scaling across heterogeneous grids of computers. To demonstrate the method we analyze approximately one month of public LIGO data from July 27 00:00 2017 UTC - Aug 25 22:00 2017 UTC and recover eight known confident gravitational wave candidates. We also inject simulated binary black hole (BBH) signals to demonstrate the sensitivity.


title: Mixed QCD--EW corrections to $\boldsymbol{pp\!\to\!\ell\nu_\ell\!+\!X}$ at the LHC

abstract: We discuss about a recent computation of the mixed QCD--EW corrections to the hadroproduction of a massive charged lepton plus the corresponding neutrino through the Drell--Yan mechanism. The calculation, based on an extension of the $q_T$ subtraction formalism for heavy-quark production in next-to-next-to leading order QCD, includes for the first time all the real and virtual contributions due to initial- and final-state radiation, except for the finite part of the two-loop virtual correction, which is approximated in the pole approximation. We report results for the fiducial cross section and the transverse momentum spectrum of the charged lepton.


title: A hierarchical behavior prediction framework at signalized intersections

abstract: Road user behavior prediction is one of the most critical components in trajectory planning for autonomous driving, especially in urban scenarios involving traffic signals. In this paper, a hierarchical framework is proposed to predict vehicle behaviors at a signalized intersection, using the traffic signal information of the intersection. The framework is composed of two phases: a discrete intention prediction phase and a continuous trajectory prediction phase. In the discrete intention prediction phase, a Bayesian network is adopted to predict the vehicle's high-level intention, after that, maximum entropy inverse reinforcement learning is utilized to learn the human driving model offline; during the online trajectory prediction phase, a driver characteristic is designed and updated to capture the different driving preferences between human drivers. We applied the proposed framework to one of the most challenging scenarios in autonomous driving: the yellow light running scenario. Numerical experiment results are presented in the later part of the paper which show the viability of the method. The accuracy of the Bayesian network for discrete intention prediction is 91.1%, and the prediction results are getting more and more accurate as the yellow time elapses. The average Euclidean distance error in continuous trajectory prediction is only 0.85 m in the yellow light running scenario.


title: On the complexity of quantum partition functions

abstract: The partition function and free energy of a quantum many-body system determine its physical properties in thermal equilibrium. Here we study the computational complexity of approximating these quantities for $n$-qubit local Hamiltonians. First, we report a classical algorithm with $\mathrm{poly}(n)$ runtime which approximates the free energy of a given $2$-local Hamiltonian provided that it satisfies a certain denseness condition. Our algorithm combines the variational characterization of the free energy and convex relaxation methods. It contributes to a body of work on efficient approximation algorithms for dense instances of optimization problems which are hard in the general case, and can be viewed as simultaneously extending existing algorithms for (a) the ground energy of dense $2$-local Hamiltonians, and (b) the free energy of dense classical Ising models. Secondly, we establish polynomial-time equivalence between the problem of approximating the free energy of local Hamiltonians and three other natural quantum approximate counting problems, including the problem of approximating the number of witness states accepted by a QMA verifier. These results suggest that simulation of quantum many-body systems in thermal equilibrium may precisely capture the complexity of a broad family of computational problems that has yet to be defined or characterized in terms of known complexity classes. Finally, we summarize state-of-the-art classical and quantum algorithms for approximating the free energy and show how to improve their runtime and memory footprint.


title: Measurements of sub-jet fragmentation with ALICE

abstract: High-energy jets offer rich opportunities to study quantum chromodynamics, from investigating the limits of perturbative calculability to constraining the emergent properties of the quark-gluon plasma (QGP). In these proceedings, we present new measurements of the fragmentation properties of jets. We report distributions of the sub-jet momentum fraction $z_r$ measured in pp and Pb-Pb collisions with ALICE at the Large Hadron Collider. These measurements serve as input to test the universality of jet fragmentation in the QGP, and offer a path to elucidate jet quenching effects in the large-$z$ region.


title: Interval Estimation of Relative Risks for Combined Unilateral and Bilateral Correlated Data

abstract: Measurements are generally collected as unilateral or bilateral data in clinical trials or observational studies. For example, in ophthalmology studies, the primary outcome is often obtained from one eye or both eyes of an individual. In medical studies, the relative risk is usually the parameter of interest and is commonly used. In this article, we develop three confidence intervals for the relative risk for combined unilateral and bilateral correlated data under the equal dependence assumption. The proposed confidence intervals are based on maximum likelihood estimates of parameters derived using the Fisher scoring method. Simulation studies are conducted to evaluate the performance of proposed confidence intervals with respect to the empirical coverage probability, the mean interval width, and the ratio of mesial non-coverage probability to the distal non-coverage probability. We also compare the proposed methods with the confidence interval based on the method of variance estimates recovery and the confidence interval obtained from the modified Poisson regression model with correlated binary data. We recommend the score confidence interval for general applications because it best controls converge probabilities at the 95% level with reasonable mean interval width. We illustrate the methods with a real-world example.


title: Global Sky Models can Improve Flux Estimates in Pulsar and FRB Studies

abstract: It is commonplace in pulsar and fast radio burst (FRB) literature to estimate sky temperature by frequency-scaling of the Haslam et al. (1982) 408 MHz map. I suggest that this practice should stop, in favor of using readily-available global sky models of diffuse foregrounds. This practical change will improve accuracy of pulse flux estimates.


title: New insights in smoothness and strong convexity with improved convergence of gradient descent

abstract: The starting assumptions to study the convergence and complexity of gradient-type methods may be the smoothness (also called Lipschitz continuity of gradient) and the strong convexity. In this note, we revisit these two basic properties from a new perspective that motivates their definitions and equivalent characterizations, along with an improved linear convergence of the gradient descent method.


title: Decoherent Histories Quantum Mechanics and Copenhagen Quantum Mechanics

abstract: This paper discusses the relation between the decoherent histories approach to quantum mechanics that is based on coarse-grained decoherent histories of a closed system, and the approximate quantum mechanics of measured subsystems, as in the Copenhagen interpretation. We show how the a classical world used in such formulations is not to something to be postulated but rather explained by suitable sets of alternative histories of quasiclassical variables. We discuss the general definition of measurement, the collapse of the wave function, and irreversibility from the perspective of decoherent histories quantum theory..


title: From KP-I lump solution to travelling waves of Gross-Pitaevskii equation

abstract: Let $q(x,y)$ be an nondegenerate lump solution to KP-I (Kadomtsev-Petviashvili-I) equation $$\partial_x^4q-2\sqrt{2}\partial_x^2q-3\sqrt{2}\partial_x((\partial_xq) ^2)-2\partial_y^2q=0. $$ We prove the existence of a traveling wave solution $ u_{\e} (x-ct, y)$ to GP (Gross-Pitaevskii) equation $$ i\partial_{t}\Psi+\Delta\Psi+(1-|\Psi|^{2})\Psi=0,\ \ \ \mbox{in} \ {\mathbb R}^2 $$ in the transonic limit $$ c=\sqrt{2}-\epsilon^2 $$ with $$ u_\epsilon =1 + i \epsilon q(x,y) + {\mathcal O} (\epsilon^2). $$ This proves the existence of finite energy solutions in the so-called Jones-Roberts program in the transonic range $ c \in (\sqrt{2}-\epsilon^2, \sqrt{2})$. The main ingredients in our proof are detailed point-wise estimates of the Green function associated to a family of fourth order hypoelliptic operators $$\partial_x^4-(2\sqrt{2}-\e^2)\partial_x^2-2\partial_y^2+\e^2\partial_x^2\partial_y^2+\e^4\partial_y^4.$$


title: AWSOM-LP: An Effective Log Parsing Technique Using Pattern Recognition and Frequency Analysis

abstract: Logs provide users with useful insights to help with a variety of development and operations tasks. The problem is that logs are often unstructured, making their analysis a complex task. This is mainly due to the lack of guidelines and best practices for logging, combined with a large number of logging libraries at the disposal of software developers. There exist studies that aim to parse automatically large logs. The main objective is to extract templates from samples of log data that are used to recognize future logs. In this paper, we propose AWSOM-LP, a powerful log parsing and abstraction tool, which is highly accurate, stable, and efficient. AWSOM-LP is built on the idea of applying pattern recognition and frequency analysis. First, log events are organized into patterns using a simple text processing method. Frequency analysis is then applied locally to instances of the same group to identify static and dynamic content of log events. When applied to 16 log datasets of the the LogPai project, AWSOM-LP achieves an average grouping accuracy of 93.5%, which outperforms the accuracy of five leading log parsing tools namely, Logram, Lenma, Drain, IPLoM and AEL. Additionally, AWSOM-LP can generate more than 80% of the final log templates from 10% to 50% of the entire log dataset and can parse up to a million log events in an average time of 5 minutes. AWSOM-LP is available online as an open source. It can be used by practitioners and researchers to parse effectively and efficiently large log files so as to support log analysis tasks.


title: On the Number of Representations for Simple Lie Groups

abstract: The growth rate function $r_N$ counts the number of irreducible representations of simple complex Lie groups of dimension $N$. While no explicit formula is known for this function, previous works have found bounds for $R_N=\sum_{i=1}^Nr_i$. In this paper we improve on previous bounds and show that $R_N=O(N)$.


title: Counting Hamiltonian Cycles in Dirac Hypergraphs

abstract: For $0\leq \ell <k$, a Hamiltonian $\ell$-cycle in a $k$-uniform hypergraph $H$ is a cyclic ordering of the vertices of $H$ in which the edges are segments of length $k$ and every two consecutive edges overlap in exactly $\ell$ vertices. We show that for all $0\le \ell<k-1$, every $k$-graph with minimum co-degree $\delta n$ with $\delta>1/2$ has (asymptotically and up to a subexponential factor) at least as many Hamiltonian $\ell$-cycles as in a typical random $k$-graph with edge-probability $\delta$. This significantly improves a recent result of Glock, Gould, Joos, K\"uhn, and Osthus, and verifies a conjecture of Ferber, Krivelevich and Sudakov for all values $0\leq \ell<k-1$.


title: On free field realization of quantum affine $W$-algebras

abstract: We find an explicit formula for the conformal vector of any quantum affine $W$-algebra in its free field realization.


title: Theory of engineering flat bands in graphene using doubly-periodic electrostatic gating

abstract: We explore the use of applied electrical potentials to induce band flattening in graphene for bands near zero energy. We consider various families of doubly periodic potentials and simulate their effect on the electronic band structure using a tight-binding and a continuum approach. From these families, we find that an applied potential with symmetries of wallpaper group 17, in particular a Kagome potential, works best for inducing a high degree of band flattening for a range of realistic potential amplitudes and periods. Our work indicates that it should be possible to engineer the band structure of graphene using electrostatic gating, thus enabling a new approach to the development of graphene-based metamaterials.


title: HI 21 cm observation and mass models of the extremely thin galaxy FGC 1440

abstract: We present observations and models of the kinematics and distribution of neutral hydrogen (HI) in the superthin galaxy FGC 1440 with an optical axial ratio $a/b = 20.4$. Using the Giant Meterwave Radio telescope (GMRT), we imaged the galaxy with a spectral resolution of 1.7 $\rm kms^{-1}$ and a spatial resolution of $15" \times 13.5"$. We find that FGC 1440 has an asymptotic rotational velocity of 141.8 $\rm kms^{-1}$ . The structure of the HI disc in FGC 1440 is that of a typical thin disc warped along the line of sight, but we can not rule out the presence of a central thick HI disc. We find that the dark matter halo in FGC 1440 could be modeled by a pseudo-isothermal (PIS) profile with $\rm R_{c}/ R_{d} <2$, where $R_{c}$ is the core radius of the PIS halo and $R_{d}$ the exponential stellar disc scale length. We note that in spite of the unusually large axial ratio of FGC 1440, the ratio of the rotational velocity to stellar vertical velocity dispersion, $\frac{V_{Rot}}{\sigma_{z}} \sim 5 - 8$, which is comparable to other superthins. Interestingly, unlike previously studied superthin galaxies which are outliers in the $log_{10}(j_{*}) - log_{10}(M_{*})$ relation for ordinary bulgeless disc galaxies, FGC 1440 is found to comply with the same. The values of $j$ for the stars, gas and the baryons in FGC 1440 are consistent with those of normal spiral galaxies with similar mass.


title: The Set of Orthogonal Tensor Trains

abstract: In this paper we study the set of tensors that admit a special type of decomposition called an orthogonal tensor train decomposition. Finding equations defining varieties of low-rank tensors is generally a hard problem, however, the set of orthogonally decomposable tensors is defined by appealing quadratic equations. The tensors we consider are an extension of orthogonally decomposable tensors. We show that they are defined by similar quadratic equations, as well as an interesting higher-degree additional equation.


title: Multiple-Splitting Projection Test for High-Dimensional Mean Vectors

abstract: We propose a multiple-splitting projection test (MPT) for one-sample mean vectors in high-dimensional settings. The idea of projection test is to project high-dimensional samples to a 1-dimensional space using an optimal projection direction such that traditional tests can be carried out with projected samples. However, estimation of the optimal projection direction has not been systematically studied in the literature. In this work, we bridge the gap by proposing a consistent estimation via regularized quadratic optimization. To retain type I error rate, we adopt a data-splitting strategy when constructing test statistics. To mitigate the power loss due to data-splitting, we further propose a test via multiple splits to enhance the testing power. We show that the $p$-values resulted from multiple splits are exchangeable. Unlike existing methods which tend to conservatively combine dependent $p$-values, we develop an exact level $\alpha$ test that explicitly utilizes the exchangeability structure to achieve better power. Numerical studies show that the proposed test well retains the type I error rate and is more powerful than state-of-the-art tests.


title: Brick-by-Brick: Combinatorial Construction with Deep Reinforcement Learning

abstract: Discovering a solution in a combinatorial space is prevalent in many real-world problems but it is also challenging due to diverse complex constraints and the vast number of possible combinations. To address such a problem, we introduce a novel formulation, combinatorial construction, which requires a building agent to assemble unit primitives (i.e., LEGO bricks) sequentially -- every connection between two bricks must follow a fixed rule, while no bricks mutually overlap. To construct a target object, we provide incomplete knowledge about the desired target (i.e., 2D images) instead of exact and explicit volumetric information to the agent. This problem requires a comprehensive understanding of partial information and long-term planning to append a brick sequentially, which leads us to employ reinforcement learning. The approach has to consider a variable-sized action space where a large number of invalid actions, which would cause overlap between bricks, exist. To resolve these issues, our model, dubbed Brick-by-Brick, adopts an action validity prediction network that efficiently filters invalid actions for an actor-critic network. We demonstrate that the proposed method successfully learns to construct an unseen object conditioned on a single image or multiple views of a target object.


title: First order strong approximation of Ait-Sahalia-type interest rate model with Poisson jumps

abstract: For Ait-Sahalia-type interest rate model with Poisson jumps, we are interested in strong convergence of a novel time-stepping method, called transformed jump-adapted backward Euler method (TJABEM). Under certain hypothesis, the considered model takes values in positive domain $(0,\infty)$. It is shown that the TJABEM can preserve the domain of the underlying problem. Furthermore, for the above model with non-globally Lipschitz drift and diffusion coefficients, the strong convergence rate of order one of the TJABEM is recovered with respect to a $L^p$-error criterion. Finally, numerical experiments are given to illustrate the theoretical results.


title: Polytopes, supersymmetry, and integrable systems

abstract: We review some links between Lie-theoretic polytopes and field theories in physics, which were proposed in the 1990's. A basic ingredient is the Coxeter Plane, whose relation to integrable systems and the Stokes Phenomenon has only recently come to light. We use this to give a systematic mathematical treatment, which gives further support to the physical proposals. This article is based on a talk which was scheduled to be given at the workshop "Representations of Discrete Groups and Geometric Topology on Manifolds", Josai University, 12-13 March 2020.


title: Cycle-Balanced Representation Learning For Counterfactual Inference

abstract: With the widespread accumulation of observational data, researchers obtain a new direction to learn counterfactual effects in many domains (e.g., health care and computational advertising) without Randomized Controlled Trials(RCTs). However, observational data suffer from inherent missing counterfactual outcomes, and distribution discrepancy between treatment and control groups due to behaviour preference. Motivated by recent advances of representation learning in the field of domain adaptation, we propose a novel framework based on Cycle-Balanced REpresentation learning for counterfactual inference (CBRE), to solve above problems. Specifically, we realize a robust balanced representation for different groups using adversarial training, and meanwhile construct an information loop, such that preserve original data properties cyclically, which reduces information loss when transforming data into latent representation space.Experimental results on three real-world datasets demonstrate that CBRE matches/outperforms the state-of-the-art methods, and it has a great potential to be applied to counterfactual inference.


title: Location-routing Optimisation for Urban Logistics Using Mobile Parcel Locker Based on Hybrid Q-Learning Algorithm

abstract: Mobile parcel lockers (MPLs) have been recently introduced by urban logistics operators as a means to reduce traffic congestion and operational cost. Their capability to relocate their position during the day has the potential to improve customer accessibility and convenience (if deployed and planned accordingly), allowing customers to collect parcels at their preferred time among one of the multiple locations. This paper proposes an integer programming model to solve the Location Routing Problem for MPLs to determine the optimal configuration and locker routes. In solving this model, a Hybrid Q-Learning algorithm-based Method (HQM) integrated with global and local search mechanisms is developed, the performance of which is examined for different problem sizes and benchmarked with genetic algorithms. Furthermore, we introduced two route adjustment strategies to resolve stochastic events that may cause delays. The results show that HQM achieves 443.41% improvement on average in solution improvement, compared with the 94.91% improvement of heuristic counterparts, suggesting HQM enables a more efficient search for better solutions. Finally, we identify critical factors that contribute to service delays and investigate their effects.


title: DOCKSTRING: easy molecular docking yields better benchmarks for ligand design

abstract: The field of machine learning for drug discovery is witnessing an explosion of novel methods. These methods are often benchmarked on simple physicochemical properties such as solubility or general druglikeness, which can be readily computed. However, these properties are poor representatives of objective functions in drug design, mainly because they do not depend on the candidate's interaction with the target. By contrast, molecular docking is a widely successful method in drug discovery to estimate binding affinities. However, docking simulations require a significant amount of domain knowledge to set up correctly which hampers adoption. To this end, we present DOCKSTRING, a bundle for meaningful and robust comparison of ML models consisting of three components: (1) an open-source Python package for straightforward computation of docking scores; (2) an extensive dataset of docking scores and poses of more than 260K ligands for 58 medically-relevant targets; and (3) a set of pharmaceutically-relevant benchmark tasks including regression, virtual screening, and de novo design. The Python package implements a robust ligand and target preparation protocol that allows non-experts to obtain meaningful docking scores. Our dataset is the first to include docking poses, as well as the first of its size that is a full matrix, thus facilitating experiments in multiobjective optimization and transfer learning. Overall, our results indicate that docking scores are a more appropriate evaluation objective than simple physicochemical properties, yielding more realistic benchmark tasks and molecular candidates.


title: Effect of strain on charge density wave order in \alpha-U

abstract: The effect of strain on charge density wave (CDW) order in $\alpha$-U is investigated within the framework of relativistic density-functional theory. The energetical stability of $\alpha$-U with CDW distortion is enhanced by the tensile strain along $a$ and $b$ directions, which is similar to the case of negative pressure and normal. However, the tensile strain along $c$ direction suppresses the energetical stability of CDW phase. This abnormal effect could be understood from the emergence of a new one-dimensional atomic chain along $c$ direction in $\alpha$-U. Furthermore, this effect is supported by the calculations of Fermi surface and phonon mode, in which the topological objects and the dynamical instability show opposite behavior between strain along $a$/$b$ and $c$ directions.


title: Ultralight dark matter or dark radiation cosmologically produced from infrared dressing

abstract: Infrared dressing of bosonic or fermionic heavy particles by a cloud of massless particles to which they couple is studied as a possible production mechanism of ultra light dark matter or dark radiation in a radiation dominated cosmology. We implement an adiabatic expansion valid for wavelengths much smaller than the Hubble radius combined with a non-perturbative and manifestly unitary dynamical resummation method to study the time evolution of an initial single heavy particle state. We find a striking resemblance to the process of particle decay: the initial amplitude of the single particle decays in time, not exponentially but with a power law with anomalous dimension $\propto t^{-\Delta/2}$ featuring a crossover to $t^{-\Delta}$ as the heavy particle becomes non-relativistic in both bosonic and fermionic cases suggesting certain universality. At long time the asymptotic state is an entangled state of the heavy and massless particles. The entanglement entropy is shown to grow under time evolution describing the flow of information from the initial single particle to the final multiparticle state. The expectation value of the energy momentum tensor in the asymptotic state is described by two indpendent fluids each obeying covariant conservation, one of heavy particles and the other of relativistic (massless) particles (dark radiation). Both fluids share the same frozen distribution function and entropy as a consequence of entanglement.

categories: gr-qc astro-ph.CO hep-ph hep-th quant-ph


title: GalilAI: Out-of-Task Distribution Detection using Causal Active Experimentation for Safe Transfer RL

abstract: Out-of-distribution (OOD) detection is a well-studied topic in supervised learning. Extending the successes in supervised learning methods to the reinforcement learning (RL) setting, however, is difficult due to the data generating process - RL agents actively query their environment for data, and the data are a function of the policy followed by the agent. An agent could thus neglect a shift in the environment if its policy did not lead it to explore the aspect of the environment that shifted. Therefore, to achieve safe and robust generalization in RL, there exists an unmet need for OOD detection through active experimentation. Here, we attempt to bridge this lacuna by first defining a causal framework for OOD scenarios or environments encountered by RL agents in the wild. Then, we propose a novel task: that of Out-of-Task Distribution (OOTD) detection. We introduce an RL agent that actively experiments in a test environment and subsequently concludes whether it is OOTD or not. We name our method GalilAI, in honor of Galileo Galilei, as it discovers, among other causal processes, that gravitational acceleration is independent of the mass of a body. Finally, we propose a simple probabilistic neural network baseline for comparison, which extends extant Model-Based RL. We find that GalilAI outperforms the baseline significantly. See visualizations of our method https://galil-ai.github.io/


title: Collective enhancement in dissipative quantum batteries

abstract: We study a quantum battery made out of $N$ non-mutually interacting qubits coupled to a dissipative single electromagnetic field mode in a resonator. We quantify the charging energy, ergotropy, transfer rate, and power of the system, showing that collective enhancements are still present despite of losses, and can even increase with dissipation. Moreover, we observe that a performance deterioration due to dissipation can be reduced by scaling up the battery size. This is useful for experimental realizations when controlling the quality of the resonator and the number of qubits are limiting factors.


title: Newtonian Mechanics Based Transient Stability PART VI: Machine Transformation

abstract: This paper focuses on the transformations from the individual machine to the equivalent machine through the "correction" perspective of the inner-group machine. The machines are first classified as the real machine with equation of motion and the pseudo machine without equation of motion. Then, it is clarified that both individual machine and equivalent machine are real machines, while the superimposed machine is a pseudo machine. Based on the classifications of the machines, two types of machine transformations are provided. The two types of machine transformations are based on the "energy correction" and "trajectory correction" of the inner-group machine, respectively. For the energy correction case, it is clarified that the trajectory transformation completely fails, while the energy transformation mathematically holds yet it is physically meaningless. For the trajectory correction case, it is clarified that both energy transformation and trajectory transformation are established. The reason is that each trajectory-correction based individual machine has the same equation of motion, i.e., the motion of the equivalent Machine-CR. Simulation results show that the machine transformation from the individual machine to the equivalent machine can be realized only through trajectory correction.


title: Distributed Multi-Area Optimal Power Flow via Rotated Coordinate Descent Critical Region Exploration

abstract: We consider the problem of distributed optimal power flow (OPF) for multi-area electric power systems. A novel distributed algorithm is proposed, referred to as the rotated coordinate descent critical region exploration (RCDCRE). It allows each entity to independently update its boundary information and optimally solve its local OPF in an asynchronous fashion. RCDCRE method stitches coordinate descent and parametric programming using coordinate system rotation to reduce coordination, keep privacy and ensure convergence. The solution process does not require warm starts and can iterate from infeasible initial points using penalty-based formulations. The effectiveness of RCDCRE is verified based on IEEE 2-area 44-bus and 4-area 472-bus systems.


title: Comment on "Failure of the simultaneous block diagonalization technique applied to complete and cluster synchronization of random networks"

abstract: In their recent preprint [arXiv:2108.07893v1], S. Panahi, N. Amaya, I. Klickstein, G. Novello, and F. Sorrentino tested the simultaneous block diagonalization (SBD) technique on synchronization in random networks and found the dimensionality reduction to be limited. Based on this observation, they claimed the SBD technique to be a failure in generic situations. Here, we show that this is not a failure of the SBD technique. Rather, it is caused by inappropriate choices of network models. SBD provides a unified framework to analyze the stability of synchronization patterns that are not encumbered by symmetry considerations, and it always finds the optimal reduction for any given synchronization pattern and network structure [SIAM Rev. 62, 817-836 (2020)]. The networks considered by Panahi et al. are poor benchmarks for the performance of the SBD technique, as these systems are often intrinsically irreducible, regardless of the method used. Thus, although the results in Panahi et al. are technically valid, their interpretations are misleading and akin to claiming a community detection algorithm to be a failure because it does not find any meaningful communities in Erd\H{o}s-R\'enyi networks.

categories: cond-mat.dis-nn cs.SY eess.SY math.DS nlin.AO


title: Error Bounds for Extended Source Inversion applied to an Acoustic Transmission Inverse Problem

abstract: A simple inverse problem for the wave equation requires determination of both the wave velocity in a homogenous acoustic material and the transient waveform of an isotropic point radiator, given the time history of the wavefield at a remote point in space. The duration (support) of the source waveform and the source-to-receiver distance are assumed known. A least squares formulation of this problem exhibits the "cycle-skipping" behaviour observed in field scale problems of this type, with many local minima differing greatly from the global minimizer. An extended formulation, dropping the support constraint on the source waveform in favor of a weighted quadratic penalty, eliminates this misbehaviour. With proper choice of the weight operator, the velocity component at any local minimizer of this extended objective function differs from the global minimizer of the least-squares formulation by less than a linear combination of the source waveform support radius and data noise-to-signal ratio.


title: The drainage of glacier and ice sheet surface lakes

abstract: Supraglacial lakes play a central role in storing melt water, enhancing surface melt, and ultimately in driving ice flow and ice shelf melt through injecting water into the subglacial environment and facilitating fracturing. Here, we develop a model for the drainage of supraglacial lakes through the dissipation-driven incision of a surface channel. The model consists of the St Venant equations for flow in the channel, fed by an upstream lake reservoir, coupled with an equation for the evolution of channel elevation due to advection, uplift, and downward melting. After reduction to a `stream power'-type hyperbolic model, we show that lake drainage occurs above a critical rate of water supply to the lake due to the backward migration of a shock that incises the lake seal. The critical water supply rate depends on advection velocity and uplift (or more precisely, drawdown downstream of the lake) as well as model parameters such as channel wall roughness and the parameters defining the relationship between channel cross-section and wetted perimeter. Once lake drainage does occur, it can either continue until the lake is empty, or terminate early, leading to oscillatory cycles of lake filling and draining, with the latter favoured by large lake volumes and relatively small water supply rates.


title: Baire property of space of Baire-one functions

abstract: A topological space $X$ is Baire if the Baire Category Theorem holds for $X$, i.e., the intersection of any sequence of open dense subsets of $X$ is dense in $X$. One of the interesting problems for the space $B_1(X)$ of all Baire-one real-valued functions is characterization topological space $X$ for which the function space $B_1(X)$ is Baire. In this paper, we solve this problem, namely, we have obtained a characterization when a function space $B_1(X)$ has the Baire property for any Tychonoff space $X$. Also we proved that $B_1(X)$ is Baire for any $\gamma$-space $X$. This answers a question posed recently by T. Banakh and S. Gabriyelyan. We also conclude that, it is consistent there are no uncountable separable metrizable space $X$ such that $B_1(X)$ is countable dense homogeneous.


title: Unsupervised Foreground Extraction via Deep Region Competition

abstract: We present Deep Region Competition (DRC), an algorithm designed to extract foreground objects from images in a fully unsupervised manner. Foreground extraction can be viewed as a special case of generic image segmentation that focuses on identifying and disentangling objects from the background. In this work, we rethink the foreground extraction by reconciling energy-based prior with generative image modeling in the form of Mixture of Experts (MoE), where we further introduce the learned pixel re-assignment as the essential inductive bias to capture the regularities of background regions. With this modeling, the foreground-background partition can be naturally found through Expectation-Maximization (EM). We show that the proposed method effectively exploits the interaction between the mixture components during the partitioning process, which closely connects to region competition, a seminal approach for generic image segmentation. Experiments demonstrate that DRC exhibits more competitive performances on complex real-world data and challenging multi-object scenes compared with prior methods. Moreover, we show empirically that DRC can potentially generalize to novel foreground objects even from categories unseen during training.


title: Learning Personal Food Preferences via Food Logs Embedding

abstract: Diet management is key to managing chronic diseases such as diabetes. Automated food recommender systems may be able to assist by providing meal recommendations that conform to a user's nutrition goals and food preferences. Current recommendation systems suffer from a lack of accuracy that is in part due to a lack of knowledge of food preferences, namely foods users like to and are able to eat frequently. In this work, we propose a method for learning food preferences from food logs, a comprehensive but noisy source of information about users' dietary habits. We also introduce accompanying metrics. The method generates and compares word embeddings to identify the parent food category of each food entry and then calculates the most popular. Our proposed approach identifies 82% of a user's ten most frequently eaten foods. Our method is publicly available on (https://github.com/aametwally/LearningFoodPreferences)


title: UDIS: Unsupervised Discovery of Bias in Deep Visual Recognition Models

abstract: Deep learning models have been shown to learn spurious correlations from data that sometimes lead to systematic failures for certain subpopulations. Prior work has typically diagnosed this by crowdsourcing annotations for various protected attributes and measuring performance, which is both expensive to acquire and difficult to scale. In this work, we propose UDIS, an unsupervised algorithm for surfacing and analyzing such failure modes. UDIS identifies subpopulations via hierarchical clustering of dataset embeddings and surfaces systematic failure modes by visualizing low performing clusters along with their gradient-weighted class-activation maps. We show the effectiveness of UDIS in identifying failure modes in models trained for image classification on the CelebA and MSCOCO datasets.


title: Layer-dependent pressure effect on electronic structures of 2D black phosphorus

abstract: Through infrared spectroscopy, we systematically study the pressure effect on electronic structures of few-layer black phosphorus (BP) with layer number ranging from 2 to 13. We reveal that the pressure-induced shift of optical transitions exhibits strong layer-dependence. In sharp contrast to the bulk counterpart which undergoes a semiconductor to semimetal transition under ~1.8 GPa, the bandgap of 2 L increases with increasing pressure until beyond 2 GPa. Meanwhile, for a sample with a given layer number, the pressure-induced shift also differs for transitions with different indices. Through the tight-binding model in conjunction with a Morse potential for the interlayer coupling, this layer- and transition-index-dependent pressure effect can be fully accounted. Our study paves a way for versatile van der Waals engineering of two-dimensional BP.