title: Improving Pretrained Models for Zero-shot Multi-label Text Classification through Reinforced Label Hierarchy Reasoning

abstract: Exploiting label hierarchies has become a promising approach to tackling the zero-shot multi-label text classification (ZS-MTC) problem. Conventional methods aim to learn a matching model between text and labels, using a graph encoder to incorporate label hierarchies to obtain effective label representations \cite{rios2018few}. More recently, pretrained models like BERT \cite{devlin2018bert} have been used to convert classification tasks into a textual entailment task \cite{yin-etal-2019-benchmarking}. This approach is naturally suitable for the ZS-MTC task. However, pretrained models are underexplored in the existing work because they do not generate individual vector representations for text or labels, making it unintuitive to combine them with conventional graph encoding methods. In this paper, we explore to improve pretrained models with label hierarchies on the ZS-MTC task. We propose a Reinforced Label Hierarchy Reasoning (RLHR) approach to encourage interdependence among labels in the hierarchies during training. Meanwhile, to overcome the weakness of flat predictions, we design a rollback algorithm that can remove logical errors from predictions during inference. Experimental results on three real-life datasets show that our approach achieves better performance and outperforms previous non-pretrained methods on the ZS-MTC task.


title: A Logical Programming Language as an Instrument for Specifying and Verifying Dynamic Memory

abstract: This work proposes a Prolog-dialect for the found and prioritised problems on expressibility and automation. Given some given C-like program, if dynamic memory is allocated, altered and freed on runtime, then a description of desired dynamic memory is a heap specification. The check of calculated memory state against a given specification is dynamic memory verification. This contribution only considers formal specification and verification in a Hoare calculus. Issues found include: invalid assignment, (temporary) unavailable data in memory cells, excessive memory allocation, (accidental) heap alteration in unexpected regions and others. Excessive memory allocation is nowadays successfully resolved by memory analysers like Valgrind. Essentially, papers in those areas did not bring any big breakthrough. Possible reasons may also include the decrease of tension due to more available memory and parallel threads. However, starting with Apt, problems related to variable modes have not yet been resolved -- neither entirely nor in an acceptable way. Research contributions over the last decades show again and again that heap issues remain and remain complex and still important. A significant contribution was reached in 2016 by Peter O'Hearn, who accepted the G\"{o}del prize for his parallel approach on a spatial heap operation.


title: The active centaur 2020 MK4

abstract: Context. Centaurs go around the Sun between the orbits of Jupiter and Neptune. Only a fraction of the known centaurs have been found to display comet-like features. Comet 29P/Schwassmann-Wachmann 1 is the most remarkable active centaur. It orbits the Sun just beyond Jupiter in a nearly circular path. Only a handful of known objects follow similar trajectories. Aims. We present photometric observations of 2020 MK4, a recently found centaur with an orbit not too different from that of 29P, and we perform a preliminary exploration of its dynamical evolution. Methods. We analyzed broadband Cousins R and Sloan g', r', and i' images of 2020 MK4 acquired with the Jacobus Kapteyn Telescope and the IAC80 telescope to search for cometary-like activity, and to derive its surface colors and size. Its orbital evolution was studied using direct N-body simulations. Results. Centaur 2020 MK4 is neutral-gray in color and has a faint, compact cometary-like coma. The values of its color indexes, (g'-r')=0.42+/-0.04 and (r'-i')=0.17+/-0.04, are similar to the solar ones. A lower limit for the absolute magnitude of the nucleus is Hg=11.30+/-0.03 mag which, for an albedo in the range of 0.1-0.04, gives an upper limit for its size in the interval (23, 37) km. Its orbital evolution is very chaotic and 2020 MK4 may be ejected from the Solar System during the next 200 kyr. Comet 29P experienced relatively close flybys with 2020 MK4 in the past, sometimes when they were temporary Jovian satellites. Conclusions. We confirm the presence of a coma of material around a central nucleus. Its surface colors place this centaur among the most extreme members of the gray group. Although its past, present, and future dynamical evolution resembles that of 29P, more data are required to confirm or reject a possible connection between the two objects and perhaps others.


title: H{\"o}lder classes in $L^p$ norm on a chord arc curve in $\mathbb R^3$

abstract: We define H{\"o}lder classes in the $L^p$ norm on a chord-arc curve in $\mathbb{R}^3$ and prove direct and inverse approximation theorems for functions from these classes by functions harmonic in a neighborhood of the curve. The approximation is estimated in the $L^p$ norm, and the smaller the neighborhood, the more accurate the approximation.


title: Exotic instantons in eight dimensions

abstract: In this paper, we study the (anti-)self-duality equations $\ast F\wedge F=\pm F\wedge F$ in the eight-dimensional Euclidean space. Using properties of the Clifford algebra $Cl_{0,8}(\mathbb{R})$, we find a new solution to these equations.


title: EKO: Adaptive Sampling of Compressed Video Data

abstract: Researchers have presented systems for efficiently analysing video data at scale using sampling algorithms. While these systems effectively leverage the temporal redundancy present in videos, they suffer from three limitations. First, they use traditional video storage formats are tailored for human consumption. Second, they load and decode the entire compressed video in memory before applying the sampling algorithm. Third, the sampling algorithms often require labeled training data obtained using a specific deep learning model. These limitations lead to lower accuracy, higher query execution time, and larger memory footprint. In this paper, we present EKO, a storage engine for efficiently managing video data. EKO relies on two optimizations. First, it uses a novel unsupervised, adaptive sampling algorithm for identifying the key frames in a given video. Second, it stores the identified key frames in a compressed representation that is optimized for machine consumption. We show that EKO improves F1-score by up to 9% compared to the next best performing state-of-the-art unsupervised, sampling algorithms by selecting more representative frames. It reduces query execution time by 3X and memory footprint by 10X in comparison to a widely-used, traditional video storage format.


title: Topological Information Retrieval with Dilation-Invariant Bottleneck Comparative Measures

abstract: Appropriately representing elements in a database so that queries may be accurately matched is a central task in information retrieval; recently, this has been achieved by embedding the graphical structure of the database into a manifold in a hierarchy-preserving manner using a variety of metrics. Persistent homology is a tool commonly used in topological data analysis that is able to rigorously characterize a database in terms of both its hierarchy and connectivity structure. Computing persistent homology on a variety of embedded datasets reveals that some commonly used embeddings fail to preserve the connectivity. We show that those embeddings which successfully retain the database topology coincide in persistent homology by introducing two dilation-invariant comparative measures to capture this effect: in particular, they address the issue of metric distortion on manifolds. We provide an algorithm for their computation that exhibits greatly reduced time complexity over existing methods. We use these measures to perform the first instance of topology-based information retrieval and demonstrate its increased performance over the standard bottleneck distance for persistent homology. We showcase our approach on databases of different data varieties including text, videos, and medical images.


title: Efficient Experimental Design for Regularized Linear Models

abstract: Regularized linear models, such as Lasso, have attracted great attention in statistical learning and data science. However, there is sporadic work on constructing efficient data collection for regularized linear models. In this work, we propose an experimental design approach, using nearly orthogonal Latin hypercube designs, to enhance the variable selection accuracy of the regularized linear models. Systematic methods for constructing such designs are presented. The effectiveness of the proposed method is illustrated with several examples.


title: Stability Estimates for the X-Ray Transform on Simple Asymptotically Hyperbolic Manifolds

abstract: We study the normal operator to the geodesic X-ray transform on functions in the setting of simple asymptotically hyperbolic manifolds. We construct a parametrix for the normal operator in the 0-pseudodifferential calculus and use it show a stability estimate.


title: Stochastic half-space theorems for minimal surfaces and $H$-surfaces of $\mathbb{R}^{3}$

abstract: We prove a version of the strong half-space theorem between the classes of recurrent minimal surfaces and complete minimal surfaces with bounded curvature of $\mathbb{R}^{3}_{\raisepunct{.}}$ We also show that any minimal hypersurface immersed with bounded curvature in $M\times \R_+$ equals some $M\times \{s\}$ provided $M$ is a complete, recurrent $n$-dimensional Riemannian manifold with $\text{Ric}_M \geq 0$ and whose sectional curvatures are bounded from above. For $H$-surfaces we prove that a stochastically complete surface $M$ can not be in the mean convex side of a $H$-surface $N$ embedded in $\R^3$ with bounded curvature if $\sup \vert H_{_M}\vert < H$, or ${\rm dist}(M,N)=0$ when $\sup \vert H_{_M}\vert = H$. Finally, a maximum principle at infinity is shown assuming $M$ has non-empty boundary.


title: One-dimensionality of the minimizers in the large volume limit for a diffuse interface attractive/repulsive model in general dimension

abstract: In this paper we consider the diffuse interface generalized antiferromagnetic model with local/nonlocal attractive/repulsive terms in competition studied in Daneri-Kerschbaum-Runa arXiv:1907.06419. The parameters of the model are denoted by $\tau$ and $\varepsilon$: the parameter $\tau$ represents the relative strength of the local term with respect to the nonlocal one, while the parameter $\varepsilon$ describes the transition scale in the Modica-Mortola type term. Restricting to a periodic box of size $L$, with $L$ multiple of the period of the minimal one-dimensional minimizers, in Daneri-Kerschbaum-Runa arXiv:1907.06419 the authors prove that in any dimension $d\geq1$ and for small but positive $\tau$ and $\varepsilon$ (eventually depending on $L$), the minimizers are non-constant one-dimensional periodic functions. In this paper we prove that periodicity and one-dimensionality of minimizers occurs also in the zero temperature analogue of the thermodynamic limit, namely as $L\to+\infty$.


title: A contrastive rule for meta-learning

abstract: Humans and other animals are capable of improving their learning performance as they solve related tasks from a given problem domain, to the point of being able to learn from extremely limited data. While synaptic plasticity is generically thought to underlie learning in the brain, the precise neural and synaptic mechanisms by which learning processes improve through experience are not well understood. Here, we present a general-purpose, biologically-plausible meta-learning rule which estimates gradients with respect to the parameters of an underlying learning algorithm by simply running it twice. Our rule may be understood as a generalization of contrastive Hebbian learning to meta-learning and notably, it neither requires computing second derivatives nor going backwards in time, two characteristic features of previous gradient-based methods that are hard to conceive in physical neural circuits. We demonstrate the generality of our rule by applying it to two distinct models: a complex synapse with internal states which consolidate task-shared information, and a dual-system architecture in which a primary network is rapidly modulated by another one to learn the specifics of each task. For both models, our meta-learning rule matches or outperforms reference algorithms on a wide range of benchmark problems, while only using information presumed to be locally available at neurons and synapses. We corroborate these findings with a theoretical analysis of the gradient estimation error incurred by our rule.


title: Understanding Continual Learning Settings with Data Distribution Drift Analysis

abstract: Classical machine learning algorithms often assume that the data are drawn i.i.d. from a stationary probability distribution. Recently, continual learning emerged as a rapidly growing area of machine learning where this assumption is relaxed, i.e. where the data distribution is non-stationary and changes over time. This paper represents the state of data distribution by a context variable $c$. A drift in $c$ leads to a data distribution drift. A context drift may change the target distribution, the input distribution, or both. Moreover, distribution drifts might be abrupt or gradual. In continual learning, context drifts may interfere with the learning process and erase previously learned knowledge; thus, continual learning algorithms must include specialized mechanisms to deal with such drifts. In this paper, we aim to identify and categorize different types of context drifts and potential assumptions about them, to better characterize various continual-learning scenarios. Moreover, we propose to use the distribution drift framework to provide more precise definitions of several terms commonly used in the continual learning field.


title: Filtering ASVs/OTUs via Mutual Information-Based Microbiome Network Analysis

abstract: Microbial communities are widely studied using high-throughput sequencing techniques, such as 16S rRNA gene sequencing. These techniques have attracted biologists as they offer powerful tools to explore microbial communities and investigate their patterns of diversity in biological and biomedical samples at remarkable resolution. However, the accuracy of these methods can negatively affected by the presence of contamination. Several studies have recognized that contamination is a common problem in microbial studies and have offered promising computational and laboratory-based approaches to assess and remove contaminants. Here we propose a novel strategy, MI-based (mutual information based) filtering method, which uses information theoretic functionals and graph theory to identify and remove contaminants. We applied MI-based filtering method to a mock community data set and evaluated the amount of information loss due to filtering taxa. We also compared our method to commonly practice traditional filtering methods. In a mock community data set, MI-based filtering approach maintained the true bacteria in the community without significant loss of information. Our results indicate that MI-based filtering method effectively identifies and removes contaminants in microbial communities and hence it can be beneficial as a filtering method to microbiome studies. We believe our filtering method has two advantages over traditional filtering methods. First, it does not required an arbitrary choice of threshold and second, it is able to detect true taxa with low abundance.


title: On Homogeneous Landsberg Surfaces

abstract: In this paper, we prove that every homogeneous Landsberg surface has isotropic flag curvature. Using this special form of the flag curvature, we prove a rigidity result on homogeneous Landsberg surface. Indeed, we prove that every homogeneous Landsberg surface is Riemannian or locally Minkowskian. This gives a positive answer to the Xu-Deng's well-known conjecture in 2-dimensional homogeneous Finsler manifolds.


title: Faster Convolution Inference Through Using Pre-Calculated Lookup Tables

abstract: Low-cardinality activations permit an algorithm based on fetching the inference values from pre-calculated lookup tables instead of calculating them every time. This algorithm can have extensions, some of which offer abilities beyond those of the currently used algorithms. It also allows for a simpler and more effective CNN-specialized hardware.


title: Magnetic skyrmion braids

abstract: Filamentary textures can take the form of braided, rope-like superstructures in nonlinear media such as plasmas and superfluids. The formation of similar superstructures in solids has been predicted, for example from flux lines in superconductors. However, their observation has proved challenging. Here, we use electron microscopy and numerical methods to reveal braided superstructures of magnetic skyrmions in thin crystals of B20-type FeGe. Their discovery opens the door to applications of rich topological landscapes of geometric braids in magnetic solids.


title: Of Aliens and Exoplanets: Why the search for life, probably, requires the search for water

abstract: It is not currently possible to create a living organism ab initio due to the overwhelming complexity of biological systems. In fact, the origin of life mechanism, this being how biological organisms form from non-living matter, is unknown. In an attempt to better understand how abiogenesis can occur, some researchers have taken water out of their models and instead opted for more exotic approaches. These assumptions will have strong implications for astronomical observations and potential future space exploration. By breaking down water's properties to the physical, chemical and biological level, herewith it is demonstrated to be the most adequate medium for the formation of life.


title: General structure of a gauge boson propagator and pressure of deconfined QCD matter in a weakly magnetized medium

abstract: We have systematically constructed the general structure of the gauge boson self-energy and the effective propagator in presence of a nontrivial background like hot magnetized material medium. Based on this as well as the general structure of fermion propagator in weakly magnetized medium we have calculated pressure of deconfined QCD matter within HTL approximation.


title: An adaptive boundary element method for the transmission problem with hyperbolic metamaterials

abstract: In this work we present an adaptive boundary element method for computing the electromagnetic response of wave interactions in hyperbolic metamaterials. One unique feature of hyperbolic metamaterial is the strongly directional wave in its propagating cone, which induces sharp transition for the solution of the integral equation across the cone boundary when wave starts to decay or grow exponentially. In order to avoid a global refined mesh over the whole boundary, we employ a two-level a posteriori error estimator and an adaptive mesh refinement procedure to resolve the singularity locally for the solution of the integral equation. Such an adaptive procedure allows for the reduction of the degree of freedom significantly for the integral equation solver while achieving desired accuracy for the solution. In addition, to resolve the fast transition of the fundamental solution and its derivatives accurately across the propagation cone boundary, adaptive numerical quadrature rules are applied to evaluate the integrals for the stiff matrices. Finally, in order to formulate the integral equations over the boundary, we also derive the limits of layer potentials and their derivatives in the hyperbolic media when the target points approach the boundary.


title: Development and Modeling of a Low-voltage DC Distribution Nanogrid with Distributed Generation Systems

abstract: The concept of direct current distribution minigrids has been gaining ground in academia and industry regarding the development of distribution grid applications with high penetration of distributed energy sources and storage systems. The adoption of a direct current distribution system facilitates the integration of sources such as photovoltaic and wind generation and storage systems such as batteries, as these technologies in general operate intrinsically in direct current. This work presents the development of a direct current distribution nanogrid (DCDN) installed in the laboratory of the Grupo de Estudos e Desenvolvimento de Alternativas Energeticas (GEDAE), of the Universidade Federal do Para. The developed grid is composed of three photovoltaic generation and storage systems in battery banks and three load banks, distributed over the 200 m grid in a ring topology, with a 24 Vdc bus. Two simulation methodologies were developed and can reproduce the nanogrid operational behavior under static and dynamic conditions, allowing the evaluation of the grid performance over a day of operation. Tests are also presented with measurements at strategic points of the grid to evaluate the system behavior under specific operating conditions, being normal or under contingency. The results attest the nanogrid ability to reliably supply the loads, as long as it respects the limitations of the implemented power generation and storage capacities. In addition, it was found that the characteristics related to the topology of the commercial charge controller that is used to form the DC distribution nanogrid benefits the power quality for the developed grid size and topology.


title: 3D Convolutional Neural Networks for Stalled Brain Capillary Detection

abstract: Adequate blood supply is critical for normal brain function. Brain vasculature dysfunctions such as stalled blood flow in cerebral capillaries are associated with cognitive decline and pathogenesis in Alzheimer's disease. Recent advances in imaging technology enabled generation of high-quality 3D images that can be used to visualize stalled blood vessels. However, localization of stalled vessels in 3D images is often required as the first step for downstream analysis, which can be tedious, time-consuming and error-prone, when done manually. Here, we describe a deep learning-based approach for automatic detection of stalled capillaries in brain images based on 3D convolutional neural networks. Our networks employed custom 3D data augmentations and were used weight transfer from pre-trained 2D models for initialization. We used an ensemble of several 3D models to produce the winning submission to the Clog Loss: Advance Alzheimer's Research with Stall Catchers machine learning competition that challenged the participants with classifying blood vessels in 3D image stacks as stalled or flowing. In this setting, our approach outperformed other methods and demonstrated state-of-the-art results, achieving 0.85 Matthews correlation coefficient, 85% sensitivity, and 99.3% specificity. The source code for our solution is made publicly available.


title: Optimal Load Balancing and Assessment of Existing Load Balancing Criteria

abstract: Parallel iterative applications often suffer from load imbalance, one of the most critical performance degradation factors. Hence, load balancing techniques are used to distribute the workload evenly to maximize performance. A key challenge is to know \textit{when} to use load balancing techniques. In general, this is done through load balancing criteria, which trigger load balancing based on runtime application data and/or user-defined information. In the first part of this paper, we introduce a novel, automatic load balancing criterion derived from a simple mathematical model. In the second part, we propose a branch-and-bound algorithm to find the load balancing iterations that lead to the optimal application performance. This algorithm finds the optimal load balancing scenario in quadratic time while, to the best of our knowledge, this has never been addressed in less than an exponential time. Finally, we compare the performance of the scenarios produced by state-of-the-art load balancing criteria relative to the optimal load balancing scenario in synthetic benchmarks and parallel N-body simulations. In the synthetic benchmarks, we observe that the proposed criterion outperforms the other automatic criteria. In the numerical experiments, we show that our new criterion is, on average, $4.9\%$ faster than state-of-the-art load balancing criteria and can outperform them by up to $17.6\%$. Moreover, we see in the numerical study that the state-of-the-art automatic criteria are at worst $47.4\%$ slower than the optimum and at best $16.5\%$ slower.


title: What does a typical metric space look like?

abstract: The collection $\mathcal{M}_n$ of all metric spaces on $n$ points whose diameter is at most $2$ can naturally be viewed as a compact convex subset of $\mathbb{R}^{\binom{n}{2}}$, known as the metric polytope. In this paper, we study the metric polytope for large $n$ and show that it is close to the cube $[1,2]^{\binom{n}{2}} \subseteq \mathcal{M}_n$ in the following two senses. First, the volume of the polytope is not much larger than that of the cube, with the following quantitative estimates: \[ \left(\tfrac{1}{6}+o(1)\right)n^{3/2} \le \log \mathrm{Vol}(\mathcal{M}_n)\le O(n^{3/2}). \] Second, when sampling a metric space from $\mathcal{M}_n$ uniformly at random, the minimum distance is at least $1 - n^{-c}$ with high probability, for some $c > 0$. Our proof is based on entropy techniques. We discuss alternative approaches to estimating the volume of $\mathcal{M}_n$ using exchangeability, Szemer\'edi's regularity lemma, the hypergraph container method, and the K\H{o}v\'ari--S\'os--Tur\'an theorem.


title: DRAGON: Determining Regulatory Associations using Graphical models on multi-Omic Networks

abstract: The increasing quantity of multi-omics data, such as methylomic and transcriptomic profiles, collected on the same specimen, or even on the same cell, provide a unique opportunity to explore the complex interactions that define cell phenotype and govern cellular responses to perturbations. We propose a network approach based on Gaussian Graphical Models (GGMs) that facilitates the joint analysis of paired omics data. This method, called DRAGON (Determining Regulatory Associations using Graphical models on multi-Omic Networks), calibrates its parameters to achieve an optimal trade-off between the network's complexity and estimation accuracy, while explicitly accounting for the characteristics of each of the assessed omics "layers." In simulation studies, we show that DRAGON adapts to edge density and feature size differences between omics layers, improving model inference and edge recovery compared to state-of-the-art methods. We further demonstrate in an analysis of joint transcriptome - methylome data from TCGA breast cancer specimens that DRAGON can identify key molecular mechanisms such as gene regulation via promoter methylation. In particular, we identify Transcription Factor AP-2 Beta (TFAP2B) as a potential multi-omic biomarker for basal-type breast cancer. DRAGON is available as open-source code in Python through the Network Zoo package (netZooPy v0.8; netzoo.github.io).


title: Terahertz Phonons coherently couple Ultrashort Solitons inside a Cavity

abstract: Ultrafast atomic vibrations mediate heat transport, serve as fingerprints for chemical bonds and drive phase transitions in condensed matter systems. Light pulses shorter than the atomic oscillation period can not only probe, but even stimulate and control collective excitations. In general, such interactions are performed with free-propagating pulses. Here, we demonstrate intra-cavity excitation and time-domain sampling of coherent optical phonons inside an active laser oscillator. Employing real-time spectral interferometry, we reveal that Terahertz beats of Raman-active optical phonons can bind temporal solitons to bound-states - termed "Soliton molecules" - and we resolve a coherent coupling mechanism of phonon and intra-cavity soliton motion. Concurring electronic and nuclear nonlinearities generate distinct soliton trajectories and, effectively, enhance the coherent Raman signal. As a result, we observe that the inter-soliton motion automatically performs highspeed time-domain Raman spectroscopy of the gain medium. In particular, our results pinpoint the impact of Raman-induced soliton interactions in crystalline laser media and microresonators, and offer unique perspectives towards ultrafast nonlinear phononics by exploiting the enhanced coupling of atomic motion and solitons inside a cavity.


title: Hasse Invariant for the Tame Brauer Group of a Higher Local Field

abstract: We generalize the Hasse invariant of local class field theory to the tame Brauer group of a higher dimensional local field, and use it to study the arithmetic of central simple algebras over such fields, which are given {\it a priori} as tensor products of standard cyclic algebras. We also compute the tame Brauer dimension (or {\it period-index bound}) and the cyclic length of a general henselian-valued field of finite rank and finite residue field.


title: Anosov Endomorphisms on the 2-torus: Regularity of foliations and rigidity

abstract: We provide sufficient conditions for smooth conjugacy between two Anosov endomorphisms on the 2-torus. From that, we also explore how the regularity of the stable and unstable foliations implies smooth conjugacy inside a class of endomorphisms including, for instance, the ones with constant Jacobian. As a consequence, we have in this class a characterization of smooth conjugacy between special Anosov endomorphisms and their linearizations.


title: Effective mapping class group dynamics II: Geometric intersection numbers

abstract: We show that the action of the mapping class group on the space of closed curves of a closed surface effectively tracks the corresponding action on Teichm\"uller space in the following sense: for all but quantitatively few mapping classes, the information of how a mapping class moves a given point of Teichm\"uller space determines, up to a power saving error term, how it changes the geometric intersection numbers of a given closed curve with respect to arbitrary geodesic currents. Applications include an effective estimate describing the speed of convergence of Teichm\"uller geodesic rays to the boundary at infinity of Teichm\"uller space, an effective estimate comparing the Teichm\"uller and Thurston metrics along mapping class group orbits of Teichm\"uller space, and, in the sequel, effective estimates for countings of filling closed geodesics on closed, negatively curved surfaces.


title: Detecting Initial System-Environment Correlations in Open Systems

abstract: Correlations between a system and its environment lead to errors in an open quantum system. Detecting those correlations would be valuable for avoiding and/or correcting those errors. Here we show that we can detect correlations by only measuring the system itself if we know the cause of the interaction between the two, for example in the case of a dipole-dipole interaction. We investigate the unitary $U$ which is associated with the exchange Hamiltonian and examine the ability to detect initial correlations between a system and its environment for various types of initial states. The states we select are motivated by realistic experimental conditions and we provide bounds for when we can state with certainty that there are initial system-environment correlations given experimental data.


title: Nanosecond resolved ro-vibrational excitation of CO$_2$

abstract: We report first ns-resolved absorption measurements of the ro-vibrational excitation of CO$_2$. The high temporal resolution of 8 ns is made possible by a fast detector (rise-time 5 ns), sensitive in the mid-infrared region. The resolution is achieved by a slow temperature scan of a quantum cascade laser and a segmented data capturing scheme. A repetitively pulsed ns discharge in 10% CO$_2$ + 90% He at 150 mbar and a repetition rate of 2 kHz is investigated. The evolution of the population densities of the different vibration modes as well as the associated vibrational and rotational temperatures within the discharge pulse of only 150 ns length are simultaneously determined and provide valuable insight into the CO$_2$ excitation dynamics. A preferential excitation in the asymmetric vibrational mode is observed in the discharge phase shortly after the breakdown.


title: A Context-Dependent Gated Module for Incorporating Symbolic Semantics into Event Coreference Resolution

abstract: Event coreference resolution is an important research problem with many applications. Despite the recent remarkable success of pretrained language models, we argue that it is still highly beneficial to utilize symbolic features for the task. However, as the input for coreference resolution typically comes from upstream components in the information extraction pipeline, the automatically extracted symbolic features can be noisy and contain errors. Also, depending on the specific context, some features can be more informative than others. Motivated by these observations, we propose a novel context-dependent gated module to adaptively control the information flows from the input symbolic features. Combined with a simple noisy training method, our best models achieve state-of-the-art results on two datasets: ACE 2005 and KBP 2016.


title: Details of soft particle clogging in two-dimensional hoppers

abstract: We study the outflow of soft particles through quasi-two-dimensional hoppers with both experiments and simulations. The experiments utilize spheres made with soft hydrogel, silicon rubber and glass. The hopper chamber has an adjustable exit width and tilt angle (the latter to control the magnitude of gravitational forcing). Our simulation mimics the experiments using purely two-dimensional soft particles with viscous interactions but no friction. Results from both simulations and experiments demonstrate that clogging is easier for reduced gravitational force or stiffer particles. For particles with low or no friction, the average number of particles in a clogging arch depends only on the ratio between hopper exit width and particle's diameter. In contrast for the silicon rubber particles with larger frictional interactions, arches are larger than the low friction case. Additionally, an analysis of the number of particles left in the hopper when clogging occurs provides evidence for a hydrostatic pressure effect that is relevant for the clogging of soft particles, but less so for the harder (glass) or frictional (silicon rubber) particles.


title: A Configurable BNN ASIC using a Network of Programmable Threshold Logic Standard Cells

abstract: This paper presents TULIP, a new architecture for a binary neural network (BNN) that uses an optimal schedule for executing the operations of an arbitrary BNN. It was constructed with the goal of maximizing energy efficiency per classification. At the top-level, TULIP consists of a collection of unique processing elements (TULIP-PEs) that are organized in a SIMD fashion. Each TULIP-PE consists of a small network of binary neurons, and a small amount of local memory per neuron. The unique aspect of the binary neuron is that it is implemented as a mixed-signal circuit that natively performs the inner-product and thresholding operation of an artificial binary neuron. Moreover, the binary neuron, which is implemented as a single CMOS standard cell, is reconfigurable, and with a change in a single parameter, can implement all standard operations involved in a BNN. We present novel algorithms for mapping arbitrary nodes of a BNN onto the TULIP-PEs. TULIP was implemented as an ASIC in TSMC 40nm-LP technology. To provide a fair comparison, a recently reported BNN that employs a conventional MAC-based arithmetic processor was also implemented in the same technology. The results show that TULIP is consistently 3X more energy-efficient than the conventional design, without any penalty in performance, area, or accuracy.


title: Uniform asymptotic expansions for Lommel, Anger-Weber and Struve functions

abstract: Using a differential equation approach asymptotic expansions are rigorously obtained for Lommel, Weber, Anger-Weber and Struve functions, as well as Neumann polynomials, each of which is a solution of an inhomogeneous Bessel equation. The approximations involve Airy and Scorer functions, and are uniformly valid for large real order $\nu$ and unbounded complex argument $z$. An interesting complication is the identification of the Lommel functions with the new asymptotic solutions, and in order to do so it is necessary to consider certain sectors of the complex plane, as well as introduce new forms of Lommel and Struve functions.


title: Neutrino energy reconstruction from semi-inclusive samples

abstract: We study neutrino-nucleus charged-current reactions on finite nuclei for the situation in which an outgoing muon and a proton are detected in coincidence, i.e., we focus on semi-inclusive cross sections. We limit our attention to one-body current interactions (quasielastic scattering) and assess the impact of different nuclear effects in the determination of the neutrino energy. We identify the regions in phase space where the neutrino energy can be reconstructed relatively well, and study whether the cross section in those regions is significant. Our results indicate that it is possible to filter more than 50% of all events according to the muon and proton kinematics, so that for the DUNE and T2K fluxes the neutrino energy can be determined with an uncertainty of less than 1% and 3%, respectively. Furthermore, we find that the reconstructed neutrino energy does not depend strongly on how one treats the final-state interactions and is not much affected by the description of the initial state. On the other hand, the estimations of the uncertainty on the neutrino energy show important sensitivity to the modeling of the initial state.


title: Necessary and sufficient conditions for the convergence of positive series

abstract: We provide new necessary and sufficient conditions for the convergence of positive series developing Bertran-De Morgan and Cauchy type tests given in [M. Martin, Bull. Amer. Math. Soc. 47(1941), 452-457] and [L. Bourchtein et al, Int. J. Math. Anal. 6(2012), 1847-1869]. The obtained result enables us to extend the known conditions for recurrence and transience of birth-and-death processes given in [V. M. Abramov, Amer. Math. Monthly 127(2020) 444-448].


title: FixMyPose: Pose Correctional Captioning and Retrieval

abstract: Interest in physical therapy and individual exercises such as yoga/dance has increased alongside the well-being trend. However, such exercises are hard to follow without expert guidance (which is impossible to scale for personalized feedback to every trainee remotely). Thus, automated pose correction systems are required more than ever, and we introduce a new captioning dataset named FixMyPose to address this need. We collect descriptions of correcting a "current" pose to look like a "target" pose (in both English and Hindi). The collected descriptions have interesting linguistic properties such as egocentric relations to environment objects, analogous references, etc., requiring an understanding of spatial relations and commonsense knowledge about postures. Further, to avoid ML biases, we maintain a balance across characters with diverse demographics, who perform a variety of movements in several interior environments (e.g., homes, offices). From our dataset, we introduce the pose-correctional-captioning task and its reverse target-pose-retrieval task. During the correctional-captioning task, models must generate descriptions of how to move from the current to target pose image, whereas in the retrieval task, models should select the correct target pose given the initial pose and correctional description. We present strong cross-attention baseline models (uni/multimodal, RL, multilingual) and also show that our baselines are competitive with other models when evaluated on other image-difference datasets. We also propose new task-specific metrics (object-match, body-part-match, direction-match) and conduct human evaluation for more reliable evaluation, and we demonstrate a large human-model performance gap suggesting room for promising future work. To verify the sim-to-real transfer of our FixMyPose dataset, we collect a set of real images and show promising performance on these images.


title: Safe Control Synthesis via Input Constrained Control Barrier Functions

abstract: This paper introduces the notion of an Input Constrained Control Barrier Function (ICCBF), as a method to synthesize safety-critical controllers for non-linear control affine systems with input constraints. The method identifies a subset of the safe set of states, and constructs a controller to render the subset forward invariant. The feedback controller is represented as the solution to a quadratic program, which can be solved efficiently for real-time implementation. Furthermore, we show that ICCBFs are a generalization of Higher Order Control Barrier Functions, and thus are applicable to systems of non-uniform relative degree. Simulation results are presented for the adaptive cruise control problem, and a spacecraft rendezvous problem.


title: Kinetic Electrostatic Waves and their Association with Current Structures in the Solar Wind

abstract: A variety of kinetic waves develop in the solar wind. The relationship between these waves and larger-scale structures, such as current sheets and ongoing turbulence remain a topic of investigation. Similarly, the instabilities producing ion-acoustic waves in the solar wind remains an open question. The goals of this paper are to investigate kinetic electrostatic Langmuir and ion-acoustic waves in the solar wind at 0.5 AU and determine whether current sheets and associated streaming instabilities can produce the observed waves. The relationship between these waves and currents is investigated statistically. Solar Orbiter's Radio and Plasma Waves instrument suite provides high-resolution snapshots of the fluctuating electric field. The Low Frequency Receiver resolves the waveforms of ion-acoustic waves and the Time Domain Sampler resolves the waveforms of both ion-acoustic and Langmuir waves. Using these waveform data we determine when these waves are observed in relation to current structures in the solar wind, estimated from the background magnetic field. Langmuir and ion-acoustic waves are frequently observed in the solar wind. Ion-acoustic waves are observed about 1% of the time at 0.5 AU. The waves are more likely to be observed in regions of enhanced currents. However, the waves typically do not occur at current structures themselves. The observed currents in the solar wind are too small to drive instability by the relative drift between single ion and electron populations. When multi-component ion and/or electron distributions are present the observed currents may be sufficient for instability. Ion beams are the most plausible source of ion-acoustic waves. The spacecraft potential is confirmed to be a reliable probe of the background electron density by comparing the peak frequencies of Langmuir waves with the plasma frequency calculated from the spacecraft potential.


title: Linear Quadratic Gaussian Synthesis for a Heated/Cooled Rod Using Point Actuation and Point Sensing

abstract: We consider a rod that is heated/cooled and sensed at multiple point locations. To stabilize it to a constant temperature we set up a Linear Quadratic Regulator that we explicitly solve by the method of completing the square to find the optimal linear state feedback for the point actuators. But we don't assume that the whole state is mesureable so we construct an infinite dimensional Kalman filter to estimate the whole state from a finite number of noisy point measurements. These two components yield a Linear Quadratic Gaussian (LQG) Synthesis for the heat equation under point actuation and point sensing.


title: Scalable algorithms for semiparametric accelerated failure time models in high dimensions

abstract: Semiparametric accelerated failure time (AFT) models are a useful alternative to Cox proportional hazards models, especially when the assumption of constant hazard ratios is untenable. However, rank-based criteria for fitting AFT models are often non-differentiable, which poses a computational challenge in high-dimensional settings. In this article, we propose a new alternating direction method of multipliers algorithm for fitting semiparametric AFT models by minimizing a penalized rank-based loss function. Our algorithm scales well in both the number of subjects and number of predictors; and can easily accommodate a wide range of popular penalties. To improve the selection of tuning parameters, we propose a new criterion which avoids some common problems in cross-validation with censored responses. Through extensive simulation studies, we show that our algorithm and software is much faster than existing methods (which can only be applied to special cases), and we show that estimators which minimize a penalized rank-based criterion often outperform alternative estimators which minimize penalized weighted least squares criteria. Application to nine cancer datasets further demonstrates that rank-based estimators of semiparametric AFT models are competitive with estimators assuming proportional hazards model in high-dimensional settings, whereas weighted least squares estimators are often not. A software package implementing the algorithm, along with a set of auxiliary functions, is available for download at github.com/ajmolstad/penAFT.


title: A unified framework for non-negative matrix and tensor factorisations with a smoothed Wasserstein loss

abstract: Non-negative matrix and tensor factorisations are a classical tool for finding low-dimensional representations of high-dimensional datasets. In applications such as imaging, datasets can be regarded as distributions supported on a space with metric structure. In such a setting, a loss function based on the Wasserstein distance of optimal transportation theory is a natural choice since it incorporates the underlying geometry of the data. We introduce a general mathematical framework for computing non-negative factorisations of both matrices and tensors with respect to an optimal transport loss. We derive an efficient computational method for its solution using a convex dual formulation, and demonstrate the applicability of this approach with several numerical illustrations with both matrix and tensor-valued data.


title: Constraint Programming to Discover One-Flip Local Optima of Quadratic Unconstrained Binary Optimization Problems

abstract: The broad applicability of Quadratic Unconstrained Binary Optimization (QUBO) constitutes a general-purpose modeling framework for combinatorial optimization problems and are a required format for gate array and quantum annealing computers. QUBO annealers as well as other solution approaches benefit from starting with a diverse set of solutions with local optimality an additional benefit. This paper presents a new method for generating a set of one-flip local optima leveraging constraint programming. Further, as demonstrated in experimental testing, analysis of the solution set allows the generation of soft constraints to help guide the optimization process.


title: On a solution to the Basel problem based on the fundamental theorem of calculus

abstract: We give a proof of the identity $\zeta(2)=\sum_{n=1}^\infty \frac{1}{n^2}=\frac{\pi^2}6$ using the fundamental theorem of calculus and differentiation under the integral sign.


title: Uniting Heterogeneity, Inductiveness, and Efficiency for Graph Representation Learning

abstract: With the ubiquitous graph-structured data in various applications, models that can learn compact but expressive vector representations of nodes have become highly desirable. Recently, bearing the message passing paradigm, graph neural networks (GNNs) have greatly advanced the performance of node representation learning on graphs. However, a majority class of GNNs are only designed for homogeneous graphs, leading to inferior adaptivity to the more informative heterogeneous graphs with various types of nodes and edges. Also, despite the necessity of inductively producing representations for completely new nodes (e.g., in streaming scenarios), few heterogeneous GNNs can bypass the transductive learning scheme where all nodes must be known during training. Furthermore, the training efficiency of most heterogeneous GNNs has been hindered by their sophisticated designs for extracting the semantics associated with each meta path or relation. In this paper, we propose WIde and DEep message passing Network (WIDEN) to cope with the aforementioned problems about heterogeneity, inductiveness, and efficiency that are rarely investigated together in graph representation learning. In WIDEN, we propose a novel inductive, meta path-free message passing scheme that packs up heterogeneous node features with their associated edges from both low- and high-order neighbor nodes. To further improve the training efficiency, we innovatively present an active downsampling strategy that drops unimportant neighbor nodes to facilitate faster information propagation. Experiments on three real-world heterogeneous graphs have further validated the efficacy of WIDEN on both transductive and inductive node representation learning, as well as the superior training efficiency against state-of-the-art baselines.


title: Understanding Equity, Diversity and Inclusion Challenges Within the Research Software Community

abstract: Research software -- specialist software used to support or undertake research -- is of huge importance to researchers. It contributes to significant advances in the wider world and requires collaboration between people with diverse skills and backgrounds. Analysis of recent survey data provides evidence for a lack of diversity in the Research Software Engineer community. We identify interventions which could address challenges in the wider research software community and highlight areas where the community is becoming more diverse. There are also lessons that are applicable, more generally, to the field of software development around recruitment from other disciplines and the importance of welcoming communities.


title: Identification of Nonlinear Dynamic Systems Using Type-2 Fuzzy Neural Networks -- A Novel Learning Algorithm and a Comparative Study

abstract: In order to achieve faster and more robust convergence (especially under noisy working environments), a sliding mode theory-based learning algorithm has been proposed to tune both the premise and consequent parts of type-2 fuzzy neural networks in this paper. Differently from recent studies, where sliding mode control theory-based rules are proposed for only the consequent part of the network, the developed algorithm applies fully sliding mode parameter update rules for both the premise and consequent parts of the type-2 fuzzy neural networks. In addition, the responsible parameter for sharing the contributions of the lower and upper parts of the type-2 fuzzy membership functions is also tuned. Moreover, the learning rate of the network is updated during the online training. The stability of the proposed learning algorithm has been proved by using an appropriate Lyapunov function. Several comparisons have been realized and shown that the proposed algorithm has faster convergence speed than the existing methods such as gradient-based and swarm intelligence-based methods. Moreover, the proposed learning algorithm has a closed form, and it is easier to implement than the other existing methods.


title: Detecting of multi-modality in probabilistic regression models

abstract: This paper focuses on building of models of stochastic systems with aleatoric uncertainty. The nature of the considered systems is such that the identical inputs can result in different outputs, i.e. the output is a random variable. The suggested in this paper algorithm targets an identification of multi-modal properties of the output distributions, even when they depend on the inputs and vary significantly throughout the dataset. This ability of the suggested method to recognise complex and not only bell-shaped distributions follows from its construction and is backed up by provided experimental results. In general, the suggested method belongs to the category of boosted ensemble learning techniques, where the single deterministic component can be an arbitrarily-chosen regression model. The algorithm does not require any special properties of the chosen regression model, other than having descriptive capabilities with some expected accuracy for the training data type.


title: The simultaneous asymmetric perturbation method for overdetermined free boundary problems

abstract: In this paper, we introduce a new method for applying the implicit function theorem to find nontrivial solutions to overdetermined problems with a fixed boundary (given) and a free boundary (to be determined). The novelty of this method lies in the kind of perturbations considered. Indeed, we work with perturbations that exhibit different levels of regularity on each boundary. This allows us to construct solutions that would have been out of reach otherwise. Another benefit of this method lies in the improvement of the regularity gap between the free boundary and the given one. Finally, some geometric properties of the solutions, such as symmetry and convexity, are also discussed.


title: Quaternion Factorization Machines: A Lightweight Solution to Intricate Feature Interaction Modelling

abstract: As a well-established approach, factorization machine (FM) is capable of automatically learning high-order interactions among features to make predictions without the need for manual feature engineering. With the prominent development of deep neural networks (DNNs), there is a recent and ongoing trend of enhancing the expressiveness of FM-based models with DNNs. However, though better results are obtained with DNN-based FM variants, such performance gain is paid off by an enormous amount (usually millions) of excessive model parameters on top of the plain FM. Consequently, the heavy parameterization impedes the real-life practicality of those deep models, especially efficient deployment on resource-constrained IoT and edge devices. In this paper, we move beyond the traditional real space where most deep FM-based models are defined, and seek solutions from quaternion representations within the hypercomplex space. Specifically, we propose the quaternion factorization machine (QFM) and quaternion neural factorization machine (QNFM), which are two novel lightweight and memory-efficient quaternion-valued models for sparse predictive analytics. By introducing a brand new take on FM-based models with the notion of quaternion algebra, our models not only enable expressive inter-component feature interactions, but also significantly reduce the parameter size due to lower degrees of freedom in the hypercomplex Hamilton product compared with real-valued matrix multiplication. Extensive experimental results on three large-scale datasets demonstrate that QFM achieves 4.36% performance improvement over the plain FM without introducing any extra parameters, while QNFM outperforms all baselines with up to two magnitudes' parameter size reduction in comparison to state-of-the-art peer methods.


title: Issue Auto-Assignment in Software Projects with Machine Learning Techniques

abstract: Usually, managers or technical leaders in software projects assign issues manually. This task may become more complex as more detailed is the issue description. This complexity can also make the process more prone to errors (misassignments) and time-consuming. In the literature, many studies aim to address this problem by using machine learning strategies. Although there is no specific solution that works for all companies, experience reports are useful to guide the choices in industrial auto-assignment projects. This paper presents an industrial initiative conducted in a global electronics company that aims to minimize the time spent and the errors that can arise in the issue assignment process. As main contributions, we present a literature review, an industrial report comparing different algorithms, and lessons learned during the project.


title: The birational geometry of $\overline{\mathcal{R}}_{g,2}$ and Prym-canonical divisorial strata

abstract: We prove that the moduli space of double covers ramified at two points $\mathcal{R}_{g,2}$ is uniruled for $3\leq g\leq 6$ and of general type for $g\geq 16$. Furthermore, we consider Prym-canonical divisorial strata in the moduli space $\overline{\mathcal{C}^n\mathcal{R}}_g$ parametrizing $n$-pointed Prym curves, and we compute their classes in $\mathrm{Pic}_\mathbb{Q}(\overline{\mathcal{C}^n\mathcal{R}}_g)$.


title: Recovery-based a posteriori error analysis for plate bending problems

abstract: We present two new recovery-based a posteriori error estimates for the Hellan--Herrmann--Johnson method in Kirchhoff--Love plate theory. The first error estimator uses a postprocessed deflection and controls the $L^2$ moment error and the discrete $H^2$ deflection error. The second one controls the $L^2\times H^1$ total error and utilizes superconvergent postprocessed moment field and deflection. The effectiveness of the theoretical results is numerically validated in several experiments.


title: Analyzing Flight Delay Prediction Under Concept Drift

abstract: Flight delays impose challenges that impact any flight transportation system. Predicting when they are going to occur is an important way to mitigate this issue. However, the behavior of the flight delay system varies through time. This phenomenon is known in predictive analytics as concept drift. This paper investigates the prediction performance of different drift handling strategies in aviation under different scales (models trained from flights related to a single airport or the entire flight system). Specifically, two research questions were proposed and answered: (i) How do drift handling strategies influence the prediction performance of delays? (ii) Do different scales change the results of drift handling strategies? In our analysis, drift handling strategies are relevant, and their impacts vary according to scale and machine learning models used.


title: Citrinet: Closing the Gap between Non-Autoregressive and Autoregressive End-to-End Models for Automatic Speech Recognition

abstract: We propose Citrinet - a new end-to-end convolutional Connectionist Temporal Classification (CTC) based automatic speech recognition (ASR) model. Citrinet is deep residual neural model which uses 1D time-channel separable convolutions combined with sub-word encoding and squeeze-and-excitation. The resulting architecture significantly reduces the gap between non-autoregressive and sequence-to-sequence and transducer models. We evaluate Citrinet on LibriSpeech, TED-LIUM2, AISHELL-1 and Multilingual LibriSpeech (MLS) English speech datasets. Citrinet accuracy on these datasets is close to the best autoregressive Transducer models.


title: Coherent Plasmonic Absorption in the Femtosecond Regime

abstract: Dissipation of electromagnetic energy through absorption is a fundamental process that underpins phenomena ranging from photovoltaics to photography, analytical spectroscopy, photosynthesis, and human vision. Absorption is also a dynamic process that depends on the duration of the optical illumination. Here we report on the resonant plasmonic absorption of a nanostructured metamaterial and the non-resonant absorption of an unstructured gold film at different optical pulse durations. By examining the absorption in travelling and standing waves, we observe a plasmonic relaxation time of 11 fs as the characteristic transition time. The metamaterial acts as a beam-splitter with low absorption for shorter pulses, while as a good absorber for longer pulses. The transient nature of the absorption puts a frequency limit of ~90 THz on the bandwidth of coherently-controlled, all-optical switching devices, which is still a thousand times faster than other leading switching technologies.


title: An Energy-efficient Aerial Backhaul System with Reconfigurable Intelligent Surface

abstract: In this paper, we propose a novel wireless architecture, mounted on a high-altitude aerial platform, which is enabled by reconfigurable intelligent surface (RIS). By installing RIS on the aerial platform, rich line-of-sight and full-area coverage can be achieved, thereby, overcoming the limitations of the conventional terrestrial RIS. We consider a scenario where a sudden increase in traffic in an urban area triggers authorities to rapidly deploy unmanned-aerial vehicle base stations (UAV-BSs) to serve the ground users. In this scenario, since the direct backhaul link from the ground source can be blocked due to several obstacles from the urban area, we propose reflecting the backhaul signal using aerial-RIS so that it successfully reaches the UAV-BSs. We jointly optimize the placement and array-partition strategies of aerial-RIS and the phases of RIS elements, which leads to an increase in energy-efficiency of every UAV-BS. We show that the complexity of our algorithm can be bounded by the quadratic order, thus implying high computational efficiency. We verify the performance of the proposed algorithm via extensive numerical evaluations and show that our method achieves an outstanding performance in terms of energy-efficiency compared to benchmark schemes.


title: Inference Time Style Control for Summarization

abstract: How to generate summaries of different styles without requiring corpora in the target styles, or training separate models? We present two novel methods that can be deployed during summary decoding on any pre-trained Transformer-based summarization model. (1) Decoder state adjustment instantly modifies decoder final states with externally trained style scorers, to iteratively refine the output against a target style. (2) Word unit prediction constrains the word usage to impose strong lexical control during generation. In experiments of summarizing with simplicity control, automatic evaluation and human judges both find our models producing outputs in simpler languages while still informative. We also generate news headlines with various ideological leanings, which can be distinguished by humans with a reasonable probability.


title: Graph Generative Models for Fast Detector Simulations in High Energy Physics

abstract: Accurate and fast simulation of particle physics processes is crucial for the high-energy physics community. Simulating particle interactions with detectors is both time consuming and computationally expensive. With the proton-proton collision energy of 13 TeV, the Large Hadron Collider is uniquely positioned to detect and measure the rare phenomena that can shape our knowledge of new interactions. The High-Luminosity Large Hadron Collider (HL-LHC) upgrade will put a significant strain on the computing infrastructure due to increased event rate and levels of pile-up. Simulation of high-energy physics collisions needs to be significantly faster without sacrificing the physics accuracy. Machine learning approaches can offer faster solutions, while maintaining a high level of fidelity. We discuss a graph generative model that provides effective reconstruction of LHC events, paving the way for full detector level fast simulation for HL-LHC.


title: A New Approach to Overgenerating and Scoring Abstractive Summaries

abstract: We propose a new approach to generate multiple variants of the target summary with diverse content and varying lengths, then score and select admissible ones according to users' needs. Abstractive summarizers trained on single reference summaries may struggle to produce outputs that achieve multiple desirable properties, i.e., capturing the most important information, being faithful to the original, grammatical and fluent. In this paper, we propose a two-staged strategy to generate a diverse set of candidate summaries from the source text in stage one, then score and select admissible ones in stage two. Importantly, our generator gives a precise control over the length of the summary, which is especially well-suited when space is limited. Our selectors are designed to predict the optimal summary length and put special emphasis on faithfulness to the original text. Both stages can be effectively trained, optimized and evaluated. Our experiments on benchmark summarization datasets suggest that this paradigm can achieve state-of-the-art performance.


title: DSRC-Enabled Train Safety Communication System at Unmanned Crossings

abstract: Although wireless technology is available for safety-critical applications, few applications have been used to improve train crossing safety. To prevent potential collisions between trains and vehicles, we present a Dedicated Short-Range Communication (DSRC)-enabled train safety communication system targeting to implement at unmanned crossings. Since our application's purpose is preventing collisions between trains and vehicles, we present a method to calculate the minimum required warning time for head-to-head collision at the train crossing. Furthermore, we define the best- and worst-case scenarios and provide practical measurements at six operating crossings in the U.S. with numerous system configurations such as modulation scheme, transmission power, antenna type, train speed, and vehicle braking distances. From our measurements, we find that the warning application coverage range is independent of the train speed, that the omnidirectional antenna with high transmission power is the best configuration for our system, and that the latency values are mostly less than 5 ms. We use the radio communication coverage to evaluate the time to avoid collision and introduce the safeness level metric. From the measured data, we observe that the DSRC-enabled train safety communication system is feasible for up to 35 mph train speeds which is providing more than 25-30 s time to avoid the collision for 25-65 mph vehicle speeds. Higher train speeds are expected to be safe, but more measurements beyond the 200 m mark with respect to a crossing considered here are needed for a definite conclusion.


title: Learning in Centralized Nonlinear Model Predictive Control: Application to an Autonomous Tractor-Trailer System

abstract: One of the most critical tasks in tractor operation is the accurate steering during field operations, e.g., accurate trajectory following during mechanical weeding or spraying, to avoid damaging the crop or planting when there is no crop yet. To automate the trajectory following problem of an autonomous tractor-trailer system and also increase its steering accuracy, a nonlinear model predictive control approach has been proposed in this paper. For the state and parameter estimation, moving horizon estimation has been chosen since it considers the state and the parameter estimation within the same problem and also constraints both on inputs and states can be incorporated. The experimental results show the accuracy and the efficiency of the proposed control scheme in which the mean values of the Euclidean error for the tractor and the trailer, respectively, are 6.44 and 3.61 cm for a straight line trajectory and 49.78 and 41.52 cm for a curved line trajectory.


title: Citations and gender diversity in reciprocal acknowledgement networks

abstract: Acknowledgements in scientific articles suggest not only gratitude, but also the interactions among scientists. In this study, we examine the acknowledgement interactions employing data from open-access journals (PLOS series). We built an acknowledgement network where the nodes represent authors and acknowledged people, while the links correspond to being mentioned in acknowledgements. Employing motif analysis, we showed how acknowledgement networks have developed, and how reciprocal relationships tend to emerge. To better understand these reciprocal relationships, we analysed the reciprocal sub-graphs of acknowledgement from two perspectives: citations and gender diversity. Firstly, we counted the number of citations, from both reciprocal and non-reciprocal authors. We found that reciprocal authors predominantly tend to cite other reciprocal authors rather than non-reciprocal ones. For gender diversity, we found that reciprocal pairs that include females tend to emerge more than male-male pairs of reciprocity in various fields, despite the fewer number of females.


title: Training Deep Neural Networks via Branch-and-Bound

abstract: In this paper, we propose BPGrad, a novel approximate algorithm for deep nueral network training, based on adaptive estimates of feasible region via branch-and-bound. The method is based on the assumption of Lipschitz continuity in objective function, and as a result, it can adaptively determine the step size for the current gradient given the history of previous updates. We prove that, by repeating such a branch-and-pruning procedure, it can achieve the optimal solution within finite iterations. A computationally efficient solver based on BPGrad has been proposed to train the deep neural networks. Empirical results demonstrate that BPGrad solver works well in practice and compares favorably to other stochastic optimization methods in the tasks of object recognition, detection, and segmentation. The code is available at \url{https://github.com/RyanCV/BPGrad}.


title: Some Deep and Original Questions about the "critical exponents" of Generalized Ballot Sequences

abstract: We numerically estimate the critical exponents of certain enumeration sequences that naturally generalize the famous Catalan and super-Catalan sequences, and raise deep and original questions about their exact values, and whether they are rational numbers. In this version we announce that our questions were brilliantly answered by Michael Wallner, and that the pledged donation to the OEIS, in his honor, was made.


title: Semantically Stealthy Adversarial Attacks against Segmentation Models

abstract: Segmentation models have been found to be vulnerable to targeted and non-targeted adversarial attacks. However, the resulting segmentation outputs are often so damaged that it is easy to spot an attack. In this paper, we propose semantically stealthy adversarial attacks which can manipulate targeted labels while preserving non-targeted labels at the same time. One challenge is making semantically meaningful manipulations across datasets and models. Another challenge is avoiding damaging non-targeted labels. To solve these challenges, we consider each input image as prior knowledge to generate perturbations. We also design a special regularizer to help extract features. To evaluate our model's performance, we design three basic attack types, namely `vanishing into the context,' `embedding fake labels,' and `displacing target objects.' Our experiments show that our stealthy adversarial model can attack segmentation models with a relatively high success rate on Cityscapes, Mapillary, and BDD100K. Our framework shows good empirical generalization across datasets and models.


title: Quotients of double vector bundles and multigraded bundles

abstract: We study quotients of multi-graded bundles, including double vector bundles. Among other things, we show that any such quotient fits into a tower of affine bundles. Applications of the theory include a construction of normal bundles for weighted submanifolds, as well as for pairs of submanifolds with clean intersection.


title: Opportunistic Screening of Osteoporosis Using Plain Film Chest X-ray

abstract: Osteoporosis is a common chronic metabolic bone disease that is often under-diagnosed and under-treated due to the limited access to bone mineral density (BMD) examinations, Dual-energy X-ray Absorptiometry (DXA). In this paper, we propose a method to predict BMD from Chest X-ray (CXR), one of the most common, accessible, and low-cost medical image examinations. Our method first automatically detects Regions of Interest (ROIs) of local and global bone structures from the CXR. Then a multi-ROI model is developed to exploit both local and global information in the chest X-ray image for accurate BMD estimation. Our method is evaluated on 329 CXR cases with ground truth BMD measured by DXA. The model predicted BMD has a strong correlation with the gold standard DXA BMD (Pearson correlation coefficient 0.840). When applied for osteoporosis screening, it achieves a high classification performance (AUC 0.936). As the first effort in the field to use CXR scans to predict the spine BMD, the proposed algorithm holds strong potential in enabling early osteoporosis screening through routine chest X-rays and contributing to the enhancement of public health.


title: A Dual-Critic Reinforcement Learning Framework for Frame-level Bit Allocation in HEVC/H.265

abstract: This paper introduces a dual-critic reinforcement learning (RL) framework to address the problem of frame-level bit allocation in HEVC/H.265. The objective is to minimize the distortion of a group of pictures (GOP) under a rate constraint. Previous RL-based methods tackle such a constrained optimization problem by maximizing a single reward function that often combines a distortion and a rate reward. However, the way how these rewards are combined is usually ad hoc and may not generalize well to various coding conditions and video sequences. To overcome this issue, we adapt the deep deterministic policy gradient (DDPG) reinforcement learning algorithm for use with two critics, with one learning to predict the distortion reward and the other the rate reward. In particular, the distortion critic works to update the agent when the rate constraint is satisfied. By contrast, the rate critic makes the rate constraint a priority when the agent goes over the bit budget. Experimental results on commonly used datasets show that our method outperforms the bit allocation scheme in x265 and the single-critic baseline by a significant margin in terms of rate-distortion performance while offering fairly precise rate control.


title: A Critique of Keum-Bae Cho's Proof that $\mathrm{P} \subsetneq \mathrm{NP}$

abstract: In this paper we critique Keum-Bae Cho's proof that $\mathrm{P} \subsetneq \mathrm{NP}$. This proof relates instances of 3-SAT to indistinguishable binomial decision trees and claims that no polynomial-time algorithm can solve 3-SAT instances represented by these trees. We argue that their proof fails to justify a crucial step, and so the proof does not establish that $\mathrm{P} \subsetneq \mathrm{NP}$.


title: Improvements and generalizations of two Hardy type inequalities and their applications to the Rellich type inequalities

abstract: We give improvements and generalizations of both the classical Hardy inequality and the geometric Hardy inequality based on the divergence theorem. Especially, our improved Hardy type inequality derives both two Hardy type inequalities with best constants. Besides, we improve two Rellich type inequalities by using the improved Hardy type inequality.


title: Efficient Computation of Metal Halide Perovskites Properties using the Extended Density Functional Tight Binding: GFN1-xTB Method

abstract: In recent years, metal halide perovskites (MHPs) for optoelectronic applications have attracted the attention of the scientific community due to their outstanding performance. The fundamental understanding of their physicochemical features is essential for improving their efficiency and stability. Atomistic and molecular simulations have played an essential role in the description of the optoelectronic properties and dynamical behaviour of MHPs, respectively. However, the complex interplay of the dynamical and optoelectronic properties in MHPs requires the simultaneous modelling of electrons and ions in relatively large systems, which entails a high computational cost, sometimes not affordable by the standard quantum mechanics methods, such as Density Functional Theory (DFT). Here, we explore the suitability of the recently developed Density Functional Tight Binding (DFTB) method, GFN1-xTB, for simulating MHPs with the aim of exploring an efficient alternative to DFT. The performance of GFN1-xTB for computing structural, vibrational and optoelectronic properties of several MHPs is benchmarked against experiments and DFT calculations. In general, this method produces accurate predictions for many of the properties of the studied MHPs, which are comparable to DFT and experiments. However, we also identify a few shortcomings, related to specific geometries and chemical compositions. Nevertheless, we believe that the tunability of GFN1-xTB is the key to resolving any observed issues and we propose specific targets, whose refinement will turn this method into a powerful computational tool for the study of MHPs and beyond.


title: Searching for an Intruder on Graphs and Their Subdivisions

abstract: In this paper we analyze a variant of the pursuit-evasion game on a graph $G$ where the intruder occupies a vertex, is allowed to move to adjacent vertices or remain in place, and is 'invisible' to the searcher, meaning that the searcher operates with no knowledge of the position of the intruder. On each stage, the searcher is allowed to inspect an arbitrary set of $k$ vertices. The minimum $k$ for which the searcher can guarantee the capture of the intruder is called the inspection number of $G$. We also introduce and study the topological inspection number, a quantity that captures the limiting behavior of the inspection number under subdivisions of $G$. Our central theorem provides a full classification of graphs with topological inspection number up to $3$.


title: Quantitative convergence rates for scaling limit of SPDEs with transport noise

abstract: We consider on the torus the scaling limit of stochastic 2D (inviscid) fluid dynamical equations with transport noise to deterministic viscous equations. Quantitative estimates on the convergence rates are provided by combining analytic and probabilistic arguments, especially heat kernel properties and maximal estimates for stochastic convolutions. Similar ideas are applied to the stochastic 2D Keller-Segel model, yielding explicit choice of noise to ensure that the blow-up probability is less than any given threshold. Our approach also gives rise to some mixing property for stochastic linear transport equations and dissipation enhancement in the viscous case.


title: Energy limit for linear-to-nonlinear femtosecond laser pulse focusing in air

abstract: Propagation of a tightly focused high-power ultrashort laser pulse in an optical medium is usually substantially influenced by the medium optical nonlinearity that can noticeably affect the laser pulse parameters around the nonlinear focus and lead to unavoidable and often undesirable spatial distortions of the focal waist. We present the results of our experimental study and numerical simulations on a femtosecond Ti-Sapphire laser pulse propagation in air under different spatial focusing. We concentrated our study on spectral-angular and spatial pulse transformations under different focusing regimes, from linear to nonlinear one, when pulse filamentation occurs. For the first time to the best of our knowledge, we found the laser pulse numerical apertures range,namely, from NA=0.002 to 0.005 (for laser pulse energy of 1 mJ), where the laser pulse distortions both in frequency-angular spectrum and pulse spatial shape are minimal. By means of the numerical simulations, we found the threshold pulse energy and peak power in a wide range of focusing conditions, within which a transition between the linear and strongly nonlinear laser pulse focusing in air takes place. This energy limit is shown to decrease with pulse numerical aperture enhancement. Our findings identify the laser pulse numerical apertures and energy adequate for getting a maximum laser intensity with a good beam quality around the focal point suitable for various laser micropatterning and micromachining technologies.


title: Explainability-aided Domain Generalization for Image Classification

abstract: Traditionally, for most machine learning settings, gaining some degree of explainability that tries to give users more insights into how and why the network arrives at its predictions, restricts the underlying model and hinders performance to a certain degree. For example, decision trees are thought of as being more explainable than deep neural networks but they lack performance on visual tasks. In this work, we empirically demonstrate that applying methods and architectures from the explainability literature can, in fact, achieve state-of-the-art performance for the challenging task of domain generalization while offering a framework for more insights into the prediction and training process. For that, we develop a set of novel algorithms including DivCAM, an approach where the network receives guidance during training via gradient based class activation maps to focus on a diverse set of discriminative features, as well as ProDrop and D-Transformers which apply prototypical networks to the domain generalization task, either with self-challenging or attention alignment. Since these methods offer competitive performance on top of explainability, we argue that the proposed methods can be used as a tool to improve the robustness of deep neural network architectures.


title: Constructing Higher-Dimensional Digital Chaotic Systems via Loop-State Contraction Algorithm

abstract: In recent years, the generation of rigorously provable chaos in finite precision digital domain has made a lot of progress in theory and practice, this article is a part of it. It aims to improve and expand the theoretical and application framework of higher-dimensional digital chaotic system (HDDCS). In this study, topological mixing for HDDCS is strictly proved theoretically at first. Topological mixing implies Devaney's definition of chaos in compact space, but not vise versa. Therefore, the proof of topological mixing improves and expands the theoretical framework of HDDCS. Then, a general design method for constructing HDDCS via loop-state contraction algorithm is given. The construction of the iterative function uncontrolled by random sequences (hereafter called iterative function) is the starting point of this research. On this basis, this article put forward a general design method to solve the problem of HDDCS construction, and a number of examples illustrate the effectiveness and feasibility of this method. The adjacency matrix corresponding to the designed HDDCS is used to construct the chaotic echo state network (ESN) for the Mackey-Glass time series prediction. The prediction accuracy is improved with the increase of the size of the reservoir and the dimension of HDDCS, indicating that higher-dimensional systems have better prediction performance than lower-dimensional systems.


title: UDO: Universal Database Optimization using Reinforcement Learning

abstract: UDO is a versatile tool for offline tuning of database systems for specific workloads. UDO can consider a variety of tuning choices, reaching from picking transaction code variants over index selections up to database system parameter tuning. UDO uses reinforcement learning to converge to near-optimal configurations, creating and evaluating different configurations via actual query executions (instead of relying on simplifying cost models). To cater to different parameter types, UDO distinguishes heavy parameters (which are expensive to change, e.g. physical design parameters) from light parameters. Specifically for optimizing heavy parameters, UDO uses reinforcement learning algorithms that allow delaying the point at which the reward feedback becomes available. This gives us the freedom to optimize the point in time and the order in which different configurations are created and evaluated (by benchmarking a workload sample). UDO uses a cost-based planner to minimize reconfiguration overheads. For instance, it aims to amortize the creation of expensive data structures by consecutively evaluating configurations using them. We evaluate UDO on Postgres as well as MySQL and on TPC-H as well as TPC-C, optimizing a variety of light and heavy parameters concurrently.


title: A Video Is Worth Three Views: Trigeminal Transformers for Video-based Person Re-identification

abstract: Video-based person re-identification (Re-ID) aims to retrieve video sequences of the same person under non-overlapping cameras. Previous methods usually focus on limited views, such as spatial, temporal or spatial-temporal view, which lack of the observations in different feature domains. To capture richer perceptions and extract more comprehensive video representations, in this paper we propose a novel framework named Trigeminal Transformers (TMT) for video-based person Re-ID. More specifically, we design a trigeminal feature extractor to jointly transform raw video data into spatial, temporal and spatial-temporal domain. Besides, inspired by the great success of vision transformer, we introduce the transformer structure for video-based person Re-ID. In our work, three self-view transformers are proposed to exploit the relationships between local features for information enhancement in spatial, temporal and spatial-temporal domains. Moreover, a cross-view transformer is proposed to aggregate the multi-view features for comprehensive video representations. The experimental results indicate that our approach can achieve better performance than other state-of-the-art approaches on public Re-ID benchmarks. We will release the code for model reproduction.


title: Appell-Carlitz numbers

abstract: In this paper, we introduce the concept of the (higher order) Appell-Carlitz numbers which unifies the definitions of several special numbers in positive characteristic, such as the Bernoulli-Carlitz numbers and the Cauchy-Carlitz numbers.Their generating function is usually named Hurwitz series in the function field arithmetic. By using Hasse-Teichm\"uller derivatives, we also obtain several properties of the (higher order) Appell-Carlitz numbers, including a recurrence formula, two closed forms expressions, and a determinant expression. The recurrence formula implies Carlitz's recurrence formula for Bernoulli-Carlitz numbers. Two closed from expressions implies the corresponding results for Bernoulli-Carlitz and Cauchy-Carlitz numbers . The determinant expression implies the corresponding results for Bernoulli-Carlitz and Cauchy-Carlitz numbers, which are analogues of the classical determinant expressions of Bernoulli and Cauchy numbers stated in an article by Glaisher in 1875.


title: Fast Design Space Exploration of Nonlinear Systems: Part I

abstract: System design tools are often only available as input-output blackboxes: for a given design as input they compute an output representing system behavior. Blackboxes are intended to be run in the forward direction. This paper presents a new method of solving the inverse design problem namely, given requirements or constraints on output, find an input that also optimizes an objective function. This problem is challenging for several reasons. First, blackboxes are not designed to be run in reverse. Second, inputs and outputs can be discrete and continuous. Third, finding designs concurrently satisfying a set of requirements is hard because designs satisfying individual requirements may conflict with each other. Fourth, blackbox evaluations can be expensive. Finally, blackboxes can sometimes fail to produce an output. This paper presents CNMA, a new method of solving the inverse problem that overcomes these challenges. CNMA tries to sample only the part of the design space relevant to solving the problem, leveraging the power of neural networks, Mixed Integer Linear Programs, and a new learning-from-failure feedback loop. The paper also presents a parallel version of CNMA that improves the efficiency and quality of solutions over the sequential version, and tries to steer it away from local optima. CNMA's performance is evaluated against conventional optimization methods for seven nonlinear design problems of 8 (two problems), 10, 15, 36 and 60 real-valued dimensions and one with 186 binary dimensions. Conventional methods evaluated are off-the-shelf implementations of Bayesian Optimization with Gaussian Processes, Nelder Mead and Random Search. The first two do not solve problems that are high-dimensional, have discrete and continuous variables or whose blackboxes can fail to return values. CNMA solves all problems, and surpasses the performance of conventional methods by up to 87%.


title: Unique continuation inequalities for the parabolic-elliptic chemotaxis system

abstract: This paper studies the quantitative unique continuation for a semi-linear parabolic-elliptic coupled system on a bounded domain. This system is a simplified version of the chemotaxis model introduced by Keller and Segel. With the aid of priori L^infty-estimates (for solutions of the system) built up in this paper, we treat the semi-linear parabolic equation in the system as a linear parabolic equation, and then use the frequency function method and the localization technique to build up two unique continuation inequalities for the system. As a consequence of the above-mentioned two inequalities, we have the following qualitative unique continuation property: if one component of a solution vanishes in a nonempty open subset at some time T>0, then the solution is identically zero.


title: On a simplified version of Hadamard's maximal determinant problem

abstract: Hadamard's maximal determinant problem consists in finding the maximal value of the determinant of a square $n\times n$ matrix whose entries are plus or minus ones. This is a difficult mathematical problem which is not yet solved. In the present paper a simplified version of the problem is considered and studied numerically.


title: Optimal Sampling Gaps for Adaptive Submodular Maximization

abstract: Running machine learning algorithms on large and rapidly growing volumes of data is often computationally expensive, one common trick to reduce the size of a data set, and thus reduce the computational cost of machine learning algorithms, is \emph{probability sampling}. It creates a sampled data set by including each data point from the original data set with a known probability. Although the benefit of running machine learning algorithms on the reduced data set is obvious, one major concern is that the performance of the solution obtained from samples might be much worse than that of the optimal solution when using the full data set. In this paper, we examine the performance loss caused by probability sampling in the context of adaptive submodular maximization. We consider a simple probability sampling method which selects each data point with probability at least $r\in[0,1]$. If we set $r=1$, our problem reduces to finding a solution based on the original full data set. We define sampling gap as the largest ratio between the optimal solution obtained from the full data set and the optimal solution obtained from the samples, over independence systems. Our main contribution is to show that if the sampling probability of each data point is at least $r$ and the utility function is policywise submodular, then the sampling gap is both upper bounded and lower bounded by $1/r$. We show that the property of policywise submodular can be found in a wide range of real-world applications, including pool-based active learning and adaptive viral marketing.


title: Inflation in mimetic $f(R,T)$ gravity

abstract: In this paper, we employ mimetic $f(R,T)$ gravity coupled with Lagrange multiplier and mimetic potential to yield viable inflationary cosmological solutions consistent with latest Planck and BICEP2/Keck Array data. We present here three viable inflationary solutions of the Hubble parameter ($H$) represented by $H(N)=\left(A \exp \beta N+B \alpha ^N\right)^{\gamma }$, $H(N)=\left(A \alpha ^N+B \log N\right)^{\gamma }$, and $H(N)=\left(A e^{\beta N}+B \log N\right)^{\gamma }$, where $A$, $\beta$, $B$, $\alpha$, $\gamma$ are free parameters, and $N$ represents the number of e-foldings. We carry out the analysis with the simplest minimal $f(R,T)$ function of the form $f(R,T)= R + \chi T$, where $\chi$ is the model parameter. We report that for the chosen $f(R,T)$ gravity model, viable cosmologies are obtained compatible with observations by conveniently setting the Lagrange multiplier and the mimetic potential.


title: Study of the $Y(4660)$ from a light-quark perspective

abstract: In this paper, we try to reveal the structure of the $Y(4660)$ from the light-quark perspective. We study the dipion invariant mass spectrum and the helicity angular distributions of the $e^+ e^- \to Y(4660) \to \psi(2S) \pi^+\pi^-$ process. In particular, we consider the effects of different light-quark SU(3) eigenstates inside the $Y(4660)$. The strong pion-pion final-state interactions as well as the $K\bar{K}$ coupled channel in the $S$-wave are taken into account model independently by using dispersion theory. We find that the light-quark SU(3) octet state plays a significant role in this transition, implying that the $Y(4660)$ contains a large light-quark component and thus might not be a pure conventional charmonium state. In the fit scheme considering both the SU(3) singlet and SU(3) octet states, two solutions are found, and both solutions reproduce the $\pi\pi$ invariant mass spectra well. New measurement data with higher statistics in the future will be helpful to better distinguish these two solutions.


title: Perceptual Indistinguishability-Net (PI-Net): Facial Image Obfuscation with Manipulable Semantics

abstract: With the growing use of camera devices, the industry has many image datasets that provide more opportunities for collaboration between the machine learning community and industry. However, the sensitive information in the datasets discourages data owners from releasing these datasets. Despite recent research devoted to removing sensitive information from images, they provide neither meaningful privacy-utility trade-off nor provable privacy guarantees. In this study, with the consideration of the perceptual similarity, we propose perceptual indistinguishability (PI) as a formal privacy notion particularly for images. We also propose PI-Net, a privacy-preserving mechanism that achieves image obfuscation with PI guarantee. Our study shows that PI-Net achieves significantly better privacy utility trade-off through public image data.


title: Potential Convolution: Embedding Point Clouds into Potential Fields

abstract: Recently, various convolutions based on continuous or discrete kernels for point cloud processing have been widely studied, and achieve impressive performance in many applications, such as shape classification, scene segmentation and so on. However, they still suffer from some drawbacks. For continuous kernels, the inaccurate estimation of the kernel weights constitutes a bottleneck for further improving the performance; while for discrete ones, the kernels represented as the points located in the 3D space are lack of rich geometry information. In this work, rather than defining a continuous or discrete kernel, we directly embed convolutional kernels into the learnable potential fields, giving rise to potential convolution. It is convenient for us to define various potential functions for potential convolution which can generalize well to a wide range of tasks. Specifically, we provide two simple yet effective potential functions via point-wise convolution operations. Comprehensive experiments demonstrate the effectiveness of our method, which achieves superior performance on the popular 3D shape classification and scene segmentation benchmarks compared with other state-of-the-art point convolution methods.


title: Temporal Deep Unfolding for Nonlinear Maximum Hands-off Control

abstract: This paper proposes a computational technique based on "deep unfolding" to solving the finite-time maximum hands-off control problem for discrete-time nonlinear stochastic systems. In particular, we seek a sparse control input sequence that stabilizes the system such that the expected value of the square of the final states is small by training a deep neural network. The proposed technique is demonstrated by a numerical experiment.


title: SARAS 3 CD/EoR Radiometer: Design and Performance of the Receiver

abstract: SARAS is an ongoing experiment aiming to detect the redshifted global 21-cm signal expected from Cosmic Dawn (CD) and the Epoch of Reionization (EoR). Standard cosmological models predict the signal to be present in the redshift range $z \sim $6--35, corresponding to a frequency range 40--200~MHz, as a spectral distortion of amplitude 20--200~mK in the 3~K cosmic microwave background. Since the signal might span multiple octaves in frequency, and this frequency range is dominated by strong terrestrial Radio Frequency Interference (RFI) and astrophysical foregrounds of Galactic and Extragalactic origin that are several orders of magnitude greater in brightness temperature, design of a radiometer for measurement of this faint signal is a challenging task. It is critical that the instrumental systematics do not result in additive or multiplicative confusing spectral structures in the measured sky spectrum and thus preclude detection of the weak 21-cm signal. Here we present the system design of the SARAS~3 version of the receiver. New features in the evolved design include Dicke switching, double differencing and optical isolation for improved accuracy in calibration and rejection of additive and multiplicative systematics. We derive and present the measurement equations for the SARAS~3 receiver configuration and calibration scheme, and provide results of laboratory tests performed using various precision terminations that qualify the performance of the radiometer receiver for the science goal.