title: JAM small-$x$ helicity phenomenology

abstract: We present the first-ever description the world data on the $g_1^{p,n}$ structure function at small Bjorken $x$ using evolution equations in $x$ derived from first principles QCD. This is a Monte-Carlo analysis within the JAM global framework that allows us to fit all existing polarized DIS data below $x<0.1$ as well as predict future measurements of small $x$ $g_1^{p,n}$ at the EIC. This is a necessary step in determining the quark helicity PDFs and, ultimately, the quark contribution to the proton spin.


title: Phase-Field Modelling of Transformation Pathways and Microstructural Evolution in Multi-Principal Element Alloys

abstract: The recently developed refractory multi-principle element alloy (MPEA), AlMo$_{0.5}$NbTa$_{0.5}$TiZr, shows an interesting microstructure with cuboidal precipitates of a disordered phase (${\beta}$, bcc) coherently embedded in an ordered phase (${\beta}'$, B2) matrix, unlike the conventional Ni-based superalloys where the ordered phase (${\gamma}'$, L12) is the precipitate phase and the disordered phase (${\gamma}$, fcc) is the matrix phase. It becomes critical to understand the phase transformation pathway (PTP) leading to this microstructure in order to tailor the microstructure for specific engineering applications. In this study, we first propose a possible PTP leading to the microstructure and employ the phase-field method to simulate microstructural evolution along the PTP. We then explore possible PTPs and materials parameters that lead to an inverted microstructure with the ordered phase being the precipitate phase and the disordered phase being the matrix phase, a microstructure similar to those observed in Ni-based superalloys. We find that in order to maintain the precipitates as highly discrete particles along these PTPs, the volume fraction of the precipitate phase needs to be smaller than that of the matrix phase and the elastic stiffness of the precipitate phase should be higher than that of the matrix phase.


title: Stochastic Subgradient Descent Escapes Active Strict Saddles on Weakly Convex Functions

abstract: In non-smooth stochastic optimization, we establish the non-convergence of the stochastic subgradient descent (SGD) to the critical points recently called active strict saddles by Davis and Drusvyatskiy. Such points lie on a manifold $M$ where the function $f$ has a direction of second-order negative curvature. Off this manifold, the norm of the Clarke subdifferential of $f$ is lower-bounded. We require two conditions on $f$. The first assumption is a Verdier stratification condition, which is a refinement of the popular Whitney stratification. It allows us to establish a reinforced version of the projection formula of Bolte \emph{et.al.} for Whitney stratifiable functions, and which is of independent interest. The second assumption, termed the angle condition, allows to control the distance of the iterates to $M$. When $f$ is weakly convex, our assumptions are generic. Consequently, generically in the class of definable weakly convex functions, the SGD converges to a local minimizer.


title: Efficient Hardware Realizations of Feedforward Artificial Neural Networks

abstract: This article presents design techniques proposed for efficient hardware implementation of feedforward artificial neural networks (ANNs) under parallel and time-multiplexed architectures. To reduce their design complexity, after the weights of ANN are determined in a training phase, we introduce a technique to find the minimum quantization value used to convert the floating-point weight values to integers. For each design architecture, we also propose an algorithm that tunes the integer weights to reduce the hardware complexity avoiding a loss in the hardware accuracy. Furthermore, the multiplications of constant weights by input variables are implemented under the shift-adds architecture using the fewest number of addition/subtraction operations found by prominent previously proposed algorithms. Finally, we introduce a computer-aided design (CAD) tool, called SIMURG, that can describe an ANN design in hardware automatically based on the ANN structure and the solutions of proposed design techniques and algorithms. Experimental results indicate that the tuning techniques can significantly reduce the ANN hardware complexity under a design architecture and the multiplierless design of ANN can lead to a significant reduction in area and energy consumption, increasing the latency slightly.


title: Multi-Round Parsing-based Multiword Rules for Scientific OpenIE

abstract: Information extraction (IE) in scientific literature has facilitated many down-stream tasks. OpenIE, which does not require any relation schema but identifies a relational phrase to describe the relationship between a subject and an object, is being a trending topic of IE in sciences. The subjects, objects, and relations are often multiword expressions, which brings challenges for methods to identify the boundaries of the expressions given very limited or even no training data. In this work, we present a set of rules for extracting structured information based on dependency parsing that can be applied to any scientific dataset requiring no expert's annotation. Results on novel datasets show the effectiveness of the proposed method. We discuss negative results as well.


title: Liouville theorems for fractional parabolic equations

abstract: In this paper, we establish several Liouville type theorems for entire solutions to fractional parabolic equations. We first obtain the key ingredients needed in the proof of Liouville theorems, such as narrow region principles and maximum principles for antisymmetric functions in unbounded domains, in which we remarkably weaken the usual decay condition $u \to 0$ at infinity with respect to the spacial variables to a polynomial growth on $u$ by constructing auxiliary functions.Then we derive monotonicity for the solutions in a half space $\mathbb{R}_+^n \times \mathbb{R}$ and obtain some new connections between the nonexistence of solutions in a half space $\mathbb{R}_+^n \times \mathbb{R}$ and in the whole space $\mathbb{R}^{n-1} \times \mathbb{R}$ and therefore prove the corresponding Liouville type theorems. To overcome the difficulty caused by the non-locality of the fractional Laplacian, we introduce several new ideas which will become useful tools in investigating qualitative properties of solutions for a variety of non-local parabolic problems.


title: The Potential of Using Vision Videos for CrowdRE: Video Comments as a Source of Feedback

abstract: Vision videos are established for soliciting feedback and stimulating discussions in requirements engineering (RE) practices, such as focus groups. Different researchers motivated the transfer of these benefits into crowd-based RE (CrowdRE) by using vision videos on social media platforms. So far, however, little research explored the potential of using vision videos for CrowdRE in detail. In this paper, we analyze and assess this potential, in particular, focusing on video comments as a source of feedback. In a case study, we analyzed 4505 comments on a vision video from YouTube. We found that the video solicited 2770 comments from 2660 viewers in four days. This is more than 50% of all comments the video received in four years. Even though only a certain fraction of these comments are relevant to RE, the relevant comments address typical intentions and topics of user feedback, such as feature request or problem report. Besides the typical user feedback categories, we found more than 300 comments that address the topic safety, which has not appeared in previous analyses of user feedback. In an automated analysis, we compared the performance of three machine learning algorithms on classifying the video comments. Despite certain differences, the algorithms classified the video comments well. Based on these findings, we conclude that the use of vision videos for CrowdRE has a large potential. Despite the preliminary nature of the case study, we are optimistic that vision videos can motivate stakeholders to actively participate in a crowd and solicit numerous of video comments as a valuable source of feedback.


title: Entropy-based Active Learning of Graph Neural Network Surrogate Models for Materials Properties

abstract: Graph neural networks, trained on experimental or calculated data are becoming an increasingly important tool in computational materials science. Networks, once trained, are able to make highly accurate predictions at a fraction of the cost of experiments or first-principles calculations of comparable accuracy. However these networks typically rely on large databases of labelled experiments to train the model. In scenarios where data is scarce or expensive to obtain this can be prohibitive. By building a neural network that provides a confidence on the predicted properties, we are able to develop an active learning scheme that can reduce the amount of labelled data required, by identifying the areas of chemical space where the model is most uncertain. We present a scheme for coupling a graph neural network with a Gaussian process to featurise solid-state materials and predict properties \textit{including} a measure of confidence in the prediction. We then demonstrate that this scheme can be used in an active learning context to speed up the training of the model, by selecting the optimal next experiment for obtaining a data label. Our active learning scheme can double the rate at which the performance of the model on a test data set improves with additional data compared to choosing the next sample at random. This type of uncertainty quantification and active learning has the potential to open up new areas of materials science, where data are scarce and expensive to obtain, to the transformative power of graph neural networks.


title: Reduction annealing effects on the crystal structure of $T^{\prime}$-type La$_{1.8}$Eu$_{0.2}$CuO$_{4+\alpha-\delta}$

abstract: We performed neutron powder diffraction measurements on the as-sintered (AS) and oxygen-reduced (OR) La$_{1.8}$Eu$_{0.2}$CuO$_{4+\alpha-\delta}$ (LECO). The structural parameters for oxygens in AS and OR samples refined by the Rietveld analysis are almost identical to those of the reference system, Pr$_{2}$CuO$_{4+\alpha-\delta}$. Thus, the two systems are comparable in terms of the structural changes in oxygens due to the annealing, although superconductivity appears only in LECO.


title: Towards Demonstrating Fault Tolerance in Small Circuits Using Bacon-Shor Codes

abstract: Quantum error correction is necessary to perform large-scale quantum computations in the presence of noise and decoherence. As a result, several aspects of quantum error correction have already been explored. These have been primarily studies of quantum memory[1, 2], an important first step towards quantum computation, where the objective is to increase the lifetime of the encoded quantum information. Additionally, several works have explored the implementation of logical gates[3-5]. In this work we study a next step - fault-tolerantly implementing quantum circuits. We choose the $[[4, 1, 2]]$ Bacon-Shor subsystem code, which has a particularly simple error-detection circuit. Through both numerics and site-counting arguments, we compute pseudo-thresholds for the Pauli error rate $p$ in a depolarizing noise model, below which the encoded circuits outperform the unencoded circuits. These pseudo-threshold values are shown to be as high as $p=3\%$ for short circuits, and $p=0.6\%$ for circuits of moderate depth. Additionally, we see that multiple rounds of stabilizer measurements give an improvement over performing a single round at the end. This provides a concrete suggestion for a small-scale fault-tolerant demonstration of a quantum algorithm that could be accessible with existing hardware.


title: Hybrid continuum-discrete simulation of granular impact dynamics

abstract: Granular impact -- the dynamic intrusion of solid objects into granular media -- is widespread across scientific and engineering applications including geotechnics. Existing approaches for simulating granular impact dynamics have relied on either a pure discrete method or a pure continuum method. Neither of these methods, however, is deemed optimal from the computational perspective. Here, we introduce a hybrid continuum-discrete approach, built on the coupled material-point and discrete-element method (MP-DEM), for simulating granular impact dynamics with unparalleled efficiency. To accommodate highly complex solid-granular interactions, we enhance the existing MP-DEM formulation with three new ingredients: (i) a robust contact algorithm that couples the continuum and discrete parts without any interpenetration under extreme impact loads, (ii) large deformation kinematics employing multiplicative elastoplasticity, and (iii) a trans-phase constitutive relation capturing gasification of granular media. For validation, we also generate experimental data through laboratory measurement of the impact dynamics of solid spheres dropped onto dry sand. Simulation of the experiments shows that the proposed approach can well reproduce granular impact dynamics in terms of impact forces, intrusion depths, and splash patterns. Further, through parameter studies on material properties, model formulations, and numerical schemes, we identify key factors for successful continuum-discrete simulation of granular impact dynamics.


title: Current-induced breakdown of the quantum anomalous Hall effect

abstract: The quantum anomalous Hall effect (QAHE) realizes dissipationless longitudinal resistivity and quantized Hall resistance without the need of an external magnetic field. However, when reducing the device dimensions or increasing the current density, an abrupt breakdown of the dissipationless state occurs with a relatively small critical current, limiting the applications of the QAHE. We investigate the mechanism of this breakdown by studying multi-terminal devices and identified that the electric field created between opposing chiral edge states lies at the origin. We propose that electric-field-driven percolation of two-dimensional charge puddles in the gapped surface states of compensated topological-insulator films is the most likely cause of the breakdown.


title: Bayesian forecast combination using time-varying features

abstract: In this work, we propose a novel framework for density forecast combination by constructing time-varying weights based on time series features, which is called Feature-based Bayesian Forecasting Model Averaging (FEBAMA). Our framework estimates weights in the forecast combination via Bayesian log predictive scores, in which the optimal forecasting combination is determined by time series features from historical information. In particular, we use an automatic Bayesian variable selection method to add weight to the importance of different features. To this end, our approach has better interpretability compared to other black-box forecasting combination schemes. We apply our framework to stock market data and M3 competition data. Based on our structure, a simple maximum-a-posteriori scheme outperforms benchmark methods, and Bayesian variable selection can further enhance the accuracy for both point and density forecasts.


title: Auto-encoder based Model for High-dimensional Imbalanced Industrial Data

abstract: With the proliferation of IoT devices, the distributed control systems are now capturing and processing more sensors at higher frequency than ever before. These new data, due to their volume and novelty, cannot be effectively consumed without the help of data-driven techniques. Deep learning is emerging as a promising technique to analyze these data, particularly in soft sensor modeling. The strong representational capabilities of complex data and the flexibility it offers from an architectural perspective make it a topic of active applied research in industrial settings. However, the successful applications of deep learning in soft sensing are still not widely integrated in factory control systems, because most of the research on soft sensing do not have access to large scale industrial data which are varied, noisy and incomplete. The results published in most research papers are therefore not easily reproduced when applied to the variety of data in industrial settings. Here we provide manufacturing data sets that are much larger and more complex than public open soft sensor data. Moreover, the data sets are from Seagate factories on active service with only necessary anonymization, so that they reflect the complex and noisy nature of real-world data. We introduce a variance weighted multi-headed auto-encoder classification model that fits well into the high-dimensional and highly imbalanced data. Besides the use of weighting or sampling methods to handle the highly imbalanced data, the model also simultaneously predicts multiple outputs by exploiting output-supervised representation learning and multi-task weighting.


title: Real-World Trajectory Sharing with Local Differential Privacy

abstract: Sharing trajectories is beneficial for many real-world applications, such as managing disease spread through contact tracing and tailoring public services to a population's travel patterns. However, public concern over privacy and data protection has limited the extent to which this data is shared. Local differential privacy enables data sharing in which users share a perturbed version of their data, but existing mechanisms fail to incorporate user-independent public knowledge (e.g., business locations and opening times, public transport schedules, geo-located tweets). This limitation makes mechanisms too restrictive, gives unrealistic outputs, and ultimately leads to low practical utility. To address these concerns, we propose a local differentially private mechanism that is based on perturbing hierarchically-structured, overlapping $n$-grams (i.e., contiguous subsequences of length $n$) of trajectory data. Our mechanism uses a multi-dimensional hierarchy over publicly available external knowledge of real-world places of interest to improve the realism and utility of the perturbed, shared trajectories. Importantly, including real-world public data does not negatively affect privacy or efficiency. Our experiments, using real-world data and a range of queries, each with real-world application analogues, demonstrate the superiority of our approach over a range of alternative methods.


title: Multi-wavelength study of Mrk 421 during a TeV flare

abstract: The blazar Mrk 421 shows frequent, short flares in the TeV energy regime. Due to the fast nature of such episodes, we often fail to obtain sufficient simultaneous information about flux variations in several energy bands. To overcome this lack of multi-wavelength (MWL) coverage, especially for the pre- and post-flare periods, we have set up a monitoring program with the FACT telescope (TeV energies) and the Neil Gehrels Swift Observatory (X-rays). On 2019 June 9, Mrk 421 showed a TeV outburst reaching a flux level of more than two times the flux of the Crab Nebula at TeV energies. We acquired simultaneous data in the X-rays with additional observations by XMM-Newton and INTEGRAL. For the first time, we can study a TeV blazar in outburst taking advantage of highly sensitive X-ray data from XMM-Newton and INTEGRAL combined. Our dataset is complemented by pointed radio observations by Effelsberg at GHz frequencies. We present our first results, including the {\gamma}-ray and X-ray light curves, a timing analysis of the X-ray data obtained with XMM-Newton , as well as the radio spectra before, during and after the flare.


title: More Arithmetic Fundamental Lemma conjectures: the case of Bessel subgroups

abstract: We define some formal moduli space of quasi-isogenies of isoclinic $p$-divisible groups with a non-reductive group as the "structure group". We then formulate new Arithmetic Fundamental Lemma conjectures for Bessel subgroups in the context of the arithmetic Gan-Gross-Prasad conjectures. Some (very limited) evidence is presented.


title: Weil Classes and Decomposable Abelian Fourfolds

abstract: We determine which codimension two Hodge classes on $J\times J$, where $J$ is a general abelian surface, deform to Hodge classes on a family of abelian fourfolds of Weil type. If a Hodge class deforms, there is in general a unique such family. We show how to determine the imaginary quadratic field acting on the fourfolds of Weil type in this family as well as their polarization. There are Hodge classes that may deform to more than one family. We relate these to Markman's Cayley classes.


title: Soft-photon radiative corrections to the $e^- p \to e^- p l^- l^+$ process

abstract: We calculate the leading-order QED radiative corrections to the process $e^- p\rightarrow e^- p l^- l^+ $ in the soft-photon approximation, in two different energy regimes which are of relevance to extract nucleon structure information. In the low-energy region, this process is studied to better constrain the hadronic corrections to precision muonic Hydrogen spectroscopy. In the high-energy region, the beam-spin asymmetry for double virtual Compton scattering allows to directly access the Generalized Parton Distributions. We find that the soft-photon radiative corrections have a large impact on the cross sections and are therefore of paramount importance to extract the nucleon structure information from this process. For the forward-backward asymmetry the radiative corrections are found to affect the asymmetry only around or below the 1\% level, whereas the beam-spin asymmetry is not affected at all in the soft-photon approximation, which makes them gold-plated observables to extract nucleon structure information in both the low- and high-energy regimes.


title: Privacy-Preserving Synthetic Location Data in the Real World

abstract: Sharing sensitive data is vital in enabling many modern data analysis and machine learning tasks. However, current methods for data release are insufficiently accurate or granular to provide meaningful utility, and they carry a high risk of deanonymization or membership inference attacks. In this paper, we propose a differentially private synthetic data generation solution with a focus on the compelling domain of location data. We present two methods with high practical utility for generating synthetic location data from real locations, both of which protect the existence and true location of each individual in the original dataset. Our first, partitioning-based approach introduces a novel method for privately generating point data using kernel density estimation, in addition to employing private adaptations of classic statistical techniques, such as clustering, for private partitioning. Our second, network-based approach incorporates public geographic information, such as the road network of a city, to constrain the bounds of synthetic data points and hence improve the accuracy of the synthetic data. Both methods satisfy the requirements of differential privacy, while also enabling accurate generation of synthetic data that aims to preserve the distribution of the real locations. We conduct experiments using three large-scale location datasets to show that the proposed solutions generate synthetic location data with high utility and strong similarity to the real datasets. We highlight some practical applications for our work by applying our synthetic data to a range of location analytics queries, and we demonstrate that our synthetic data produces near-identical answers to the same queries compared to when real data is used. Our results show that the proposed approaches are practical solutions for sharing and analyzing sensitive location data privately.


title: Nonlinear fluid damping of elastically mounted pitching wings in quiescent water

abstract: We experimentally study the nonlinear fluid damping of a rigid but elastically mounted pitching wing in the absence of a freestream flow. The dynamics of the elastic mount are simulated using a cyber-physical system. We perturb the wing and measure the fluid damping coefficient from damped oscillations over a large range of pitching frequencies, pitching amplitudes, pivot locations and sweep angles. A universal fluid damping scaling is proposed to incorporate all these parameters. Flow fields obtained using particle image velocimetry are analyzed to explain the nonlinear behaviors of the fluid damping.


title: Which Bridges Are Weak Ties? Algebraic Topological Insights on Network Structure and Tie Strength

abstract: Bridging relationships between individuals situated in different parts of a social network are important conduits for information and resources in social and organizational settings. Dyadic tie strength has often been used as an indicator for whether a relationship is bridging, under the assumption that bridging ties are always weak ties. However, recent empirical evidence suggests that bridging ties are often strong, forcing us to rethink the relationship between social network structure and dyadic tie strength. Here, we provide an analysis based on algebraic topology which clarifies this relationship between network structure and dyadic tie strength. Rather than model the network as a graph, we use a simplicial complex which can explicitly encode group interactions between three or more individuals. First, we show theoretically and empirically that Edge PageRank, an algebraic topological measure originally defined as an extension of the classical PageRank measure, is a valid continuous measure of how well a relationship acts as a bridge. Second, we use the tool of Hodge Decomposition, which allows us to decompose any flow in a simplicial complex into three orthogonal components, to clarify the relationship between dyadic tie strength and network structure. We find that individuals invest less in relationships associated with topological holes in the network, replicating and explaining recent empirical results that bridging relationships spanning short network distances tend to be weak, whereas those spanning longer distances are strong. Our results are validated on 15 large scale datasets and suggest the value of algebraic topological methods in empirical network analysis.


title: Online Knowledge Distillation for Efficient Pose Estimation

abstract: Existing state-of-the-art human pose estimation methods require heavy computational resources for accurate predictions. One promising technique to obtain an accurate yet lightweight pose estimator is knowledge distillation, which distills the pose knowledge from a powerful teacher model to a less-parameterized student model. However, existing pose distillation works rely on a heavy pre-trained estimator to perform knowledge transfer and require a complex two-stage learning procedure. In this work, we investigate a novel Online Knowledge Distillation framework by distilling Human Pose structure knowledge in a one-stage manner to guarantee the distillation efficiency, termed OKDHP. Specifically, OKDHP trains a single multi-branch network and acquires the predicted heatmaps from each, which are then assembled by a Feature Aggregation Unit (FAU) as the target heatmaps to teach each branch in reverse. Instead of simply averaging the heatmaps, FAU which consists of multiple parallel transformations with different receptive fields, leverages the multi-scale information, thus obtains target heatmaps with higher-quality. Specifically, the pixel-wise Kullback-Leibler (KL) divergence is utilized to minimize the discrepancy between the target heatmaps and the predicted ones, which enables the student network to learn the implicit keypoint relationship. Besides, an unbalanced OKDHP scheme is introduced to customize the student networks with different compression rates. The effectiveness of our approach is demonstrated by extensive experiments on two common benchmark datasets, MPII and COCO.


title: Free Lunch for Co-Saliency Detection: Context Adjustment

abstract: We unveil a long-standing problem in the prevailing co-saliency detection systems: there is indeed inconsistency between training and testing. Constructing a high-quality co-saliency detection dataset involves time-consuming and labor-intensive pixel-level labeling, which has forced most recent works to rely instead on semantic segmentation or saliency detection datasets for training. However, the lack of proper co-saliency and the absence of multiple foreground objects in these datasets can lead to spurious variations and inherent biases learned by models. To tackle this, we introduce the idea of counterfactual training through context adjustment and propose a "cost-free" group-cut-paste (GCP) procedure to leverage off-the-shelf images and synthesize new samples. Following GCP, we collect a novel dataset called Context Adjustment Training (CAT). CAT consists of 33,500 images, which is four times larger than the current co-saliency detection datasets. All samples are automatically annotated with high-quality mask annotations, object categories, and edge maps. Extensive experiments on recent benchmarks are conducted, show that CAT can improve various state-of-the-art models by a large margin (5% ~ 25%). We hope that the scale, diversity, and quality of our dataset can benefit researchers in this area and beyond. Our dataset will be publicly accessible through our project page.


title: Relation between Constitutions, Socioeconomics and The Rule of Law: a quantitative thermodynamic approach

abstract: Based on what we know about thermodynamics of synergy, we explored the relationship between countries socio-cultural order (negentropy), estimated through their constitutions, indicators of Rule of Law and their academic development; with countries indicators of Free Energy (amount of useful work, productivity, socioeconomic health). The analysis of 219 indicators unveiled strong correlations between estimates of the Rule of Law and the number of Academic Publications, with the socioeconomic health indicators: GDP, Human Development Index and Infant Mortality. In contrast, correlations with the length of constitutions (number of words and of articles), suggest that the proliferation of legal rules hinders the rule of law and socioeconomic development, or that under-development and/or the lack of the rule of law foments the proliferation of legal rules. These findings suggest that not any order favors productivity (Free Energy) and that excess regulations and state tutelage increase social entropy decreasing socioeconomic health.


title: Human-In-The-Loop Document Layout Analysis

abstract: Document layout analysis (DLA) aims to divide a document image into different types of regions. DLA plays an important role in the document content understanding and information extraction systems. Exploring a method that can use less data for effective training contributes to the development of DLA. We consider a Human-in-the-loop (HITL) collaborative intelligence in the DLA. Our approach was inspired by the fact that the HITL push the model to learn from the unknown problems by adding a small amount of data based on knowledge. The HITL select key samples by using confidence. However, using confidence to find key samples is not suitable for DLA tasks. We propose the Key Samples Selection (KSS) method to find key samples in high-level tasks (semantic segmentation) more accurately through agent collaboration, effectively reducing costs. Once selected, these key samples are passed to human beings for active labeling, then the model will be updated with the labeled samples. Hence, we revisited the learning system from reinforcement learning and designed a sample-based agent update strategy, which effectively improves the agent's ability to accept new samples. It achieves significant improvement results in two benchmarks (DSSE-200 (from 77.1% to 86.3%) and CS-150 (from 88.0% to 95.6%)) by using 10% of labeled data.


abstract: Reasoning about the future -- understanding how decisions in the present time affect outcomes in the future -- is one of the central challenges for reinforcement learning (RL), especially in highly-stochastic or partially observable environments. While predicting the future directly is hard, in this work we introduce a method that allows an agent to "look into the future" without explicitly predicting it. Namely, we propose to allow an agent, during its training on past experience, to observe what \emph{actually} happened in the future at that time, while enforcing an information bottleneck to avoid the agent overly relying on this privileged information. This gives our agent the opportunity to utilize rich and useful information about the future trajectory dynamics in addition to the present. Our method, Policy Gradients Incorporating the Future (PGIF), is easy to implement and versatile, being applicable to virtually any policy gradient algorithm. We apply our proposed method to a number of off-the-shelf RL algorithms and show that PGIF is able to achieve higher reward faster in a variety of online and offline RL domains, as well as sparse-reward and partially observable environments.


title: Shaping the topology of light with a moving Rabi-oscillating vortex

abstract: Quantum vortices are the analogue of classical vortices in optics, Bose-Einstein condensates, superfluids and superconductors, where they provide the elementary mode of rotation and orbital angular momentum. While they mediate important pair interactions and phase transitions in nonlinear fluids, their linear dynamics is useful for the shaping of complex light, as well as for topological entities in multi-component systems, such as full Bloch beams. Here, setting a quantum vortex into directional motion in an open-dissipative fluid of microcavity polaritons, we observe the self-splitting of the packet, leading to the trembling movement of its center of mass, whereas the vortex core undergoes ultrafast spiraling along diverging and converging circles, in a sub-picosecond precessing fashion. This singular dynamics is accompanied by vortex-antivortex pairs creation and annihilation, and a periodically changing topological charge. The spiraling and branching mechanics represent a direct manifestation of the underlying Bloch pseudospin space, whose mapping is shown to be rotating and splitting itself. Its reshaping is due to three simultaneous drives along the distinct directions of momentum and complex frequency, by means of the differential group velocities, Rabi frequency and dissipation rates, which are natural assets in coupled fields such as polaritons. This state, displaying linear momentum dressed with oscillating angular momentum, confirms the richness of multi-component and open quantum fluids and their innate potentiality to implement sophisticated and dynamical topological textures of light.


title: On the drag and lift coefficients of ellipsoidal particles under rarefied flow conditions

abstract: The capability to simulate a two-way coupled interaction between a rarefied gas and an arbitrary-shaped colloidal particle is important for many practical applications, such as aerospace engineering, lung drug deliver and semiconductor manufacturing. By means of numerical simulations based on the Direct Simulation Monte Carlo (DSMC) method, we investigate the influence of the orientation of the particle and rarefaction on the drag and lift coefficients, in the case of prolate and oblate ellipsoidal particles immersed in a uniform ambient flow. This is done by modelling the solid particles using a cut-cell algorithm embedded within our DSMC solver. In this approach, the surface of the particle is described by its analytical expression and the microscopic gas-solid interactions are computed exactly using a ray-tracing technique. The measured drag and lift coefficients are used to extend the correlations available in the continuum regime to the rarefied regime, focusing on the transitional and free-molecular regimes. The functional forms for the correlations for the ellipsoidal particles are chosen as a generalisation from the spherical case. We show that the fits over the data from numerical simulations can be extended to regimes outside the simulated range of $Kn$ by testing the obtained predictive model on values of $Kn$ that where not included in the fitting process, allowing to achieve an higher precision when compared with existing predictive models from literature. Finally, we underline the importance of this work in providing new correlations for non-spherical particles that can be used for point-particle Euler-Lagrangian simulations to address the problem of contamination from finite-size particles in high-tech mechanical systems.


title: 2QAN: A quantum compiler for 2-local qubit Hamiltonian simulation algorithms

abstract: Simulating quantum systems is one of the most important potential applications of quantum computers. The high-level circuit defining the simulation needs to be compiled into one that complies with hardware limitations such as qubit architecture (connectivity) and instruction (gate) set. General-purpose quantum compilers work at the gate level and have little knowledge of the mathematical properties of quantum applications, missing further optimization opportunities. Existing application-specific compilers only apply advanced optimizations in the scheduling procedure and are restricted to the CNOT or CZ gate set. In this work, we develop a compiler, named 2QAN, to optimize quantum circuits for 2-local qubit Hamiltonian simulation problems, a framework which includes the important quantum approximate optimization algorithm (QAOA). In particular, we exploit the flexibility of permuting different operators in the Hamiltonian (no matter whether they commute) and propose permutation-aware techniques for qubit routing, gate optimization and scheduling to minimize compilation overhead. 2QAN can target different qubit topologies and different hardware gate sets. Compilation results on four applications (up to 50 qubits) and three quantum computers (namely, Google Sycamore, IBMQ Montreal and Rigetti Aspen) show that 2QAN outperforms state-of-the-art general-purpose compilers and application-specific compilers. Specifically, 2QAN can reduce the number of inserted SWAP gates by 11.5X, reduce overhead in hardware gate count by 68.5X, and reduce overhead in circuit depth by 21X. Experimental results on the Montreal device demonstrate that benchmarks compiled by 2QAN achieve the highest fidelity.


title: Blockchain-empowered Edge Intelligence for Internet of Medical Things Against COVID-19

abstract: We have witnessed an unprecedented public health crisis caused by the new coronavirus disease (COVID-19), which has severely affected medical institutions, our common lives, and social-economic activities. This crisis also reveals the brittleness of existing medical services, such as over-centralization of medical resources, the hysteresis of medical services digitalization, and weak security and privacy protection of medical data. The integration of the Internet of Medical Things (IoMT) and blockchain is expected to be a panacea to COVID-19 attributed to the ubiquitous presence and the perception of IoMT as well as the enhanced security and immutability of the blockchain. However, the synergy of IoMT and blockchain is also faced with challenges in privacy, latency, and context-absence. The emerging edge intelligence technologies bring opportunities to tackle these issues. In this article, we present a blockchain-empowered edge intelligence for IoMT in addressing the COVID-19 crisis. We first review IoMT, edge intelligence, and blockchain in addressing the COVID-19 pandemic. We then present an architecture of blockchain-empowered edge intelligence for IoMT after discussing the opportunities of integrating blockchain and edge intelligence. We next offer solutions to COVID-19 brought by blockchain-empowered edge intelligence from 1) monitoring and tracing COVID-19 pandemic origin, 2) traceable supply chain of injectable medicines and COVID-19 vaccines, and 3) telemedicine and remote healthcare services. Moreover, we also discuss the challenges and open issues in blockchain-empowered edge intelligence.


title: Concentration inequalities from monotone couplings for graphs, walks, trees and branching processes

abstract: Generalized gamma distributions arise as limits in many settings involving random graphs, walks, trees, and branching processes. Pek\"oz, R\"ollin, and Ross (2016, arXiv:1309.4183 [math.PR]) exploited characterizing distributional fixed point equations to obtain uniform error bounds for generalized gamma approximations using Stein's method. Here we show how monotone couplings arising with these fixed point equations can be used to obtain sharper tail bounds that, in many cases, outperform competing moment-based bounds and the uniform bounds obtainable with Stein's method. Applications are given to concentration inequalities for preferential attachment random graphs, branching processes, random walk local time statistics and the size of random subtrees of uniformly random binary rooted plane trees.


title: ErrorCompensatedX: error compensation for variance reduced algorithms

abstract: Communication cost is one major bottleneck for the scalability for distributed learning. One approach to reduce the communication cost is to compress the gradient during communication. However, directly compressing the gradient decelerates the convergence speed, and the resulting algorithm may diverge for biased compression. Recent work addressed this problem for stochastic gradient descent by adding back the compression error from the previous step. This idea was further extended to one class of variance reduced algorithms, where the variance of the stochastic gradient is reduced by taking a moving average over all history gradients. However, our analysis shows that just adding the previous step's compression error, as done in existing work, does not fully compensate the compression error. So, we propose ErrorCompensatedX, which uses the compression error from the previous two steps. We show that ErrorCompensatedX can achieve the same asymptotic convergence rate with the training without compression. Moreover, we provide a unified theoretical analysis framework for this class of variance reduced algorithms, with or without error compensation.


title: Extreme events and instantons in Lagrangian passive scalar turbulence models

abstract: The advection and mixing of a scalar quantity by fluid flow is an important problem in engineering and natural sciences. If the fluid is turbulent, the statistics of the passive scalar exhibit complex behavior. This paper is concerned with two Lagrangian scalar turbulence models based on the recent fluid deformation model that can be shown to reproduce the statistics of passive scalar turbulence for a range of Reynolds numbers. For these models, we demonstrate how events of extreme passive scalar gradients can be recovered by computing the instanton, i.e., the saddle-point configuration of the associated stochastic field theory. It allows us to both reproduce the heavy-tailed statistics associated with passive scalar turbulence, and recover the most likely mechanism leading to such extreme events. We further demonstrate that events of large negative strain in these models undergo spontaneous symmetry breaking.


title: Point Discriminative Learning for Data-efficient 3D Point Cloud Analysis

abstract: 3D point cloud analysis has drawn a lot of research attention due to its wide applications. However, collecting massive labelled 3D point cloud data is both time-consuming and labor-intensive. This calls for data-efficient learning methods. In this work we propose PointDisc, a point discriminative learning method to leverage self-supervisions for data-efficient 3D point cloud classification and segmentation. PointDisc imposes a novel point discrimination loss on the middle and global level features produced by the backbone network. This point discrimination loss enforces learned features to be consistent with points belonging to the corresponding local shape region and inconsistent with randomly sampled noisy points. We conduct extensive experiments on 3D object classification, 3D semantic and part segmentation, showing the benefits of PointDisc for data-efficient learning. Detailed analysis demonstrate that PointDisc learns unsupervised features that well capture local and global geometry.


title: Characterisation of spatial charge sensitivity in a multi-mode superconducting qubit

abstract: Understanding and suppressing sources of decoherence is a leading challenge in building practical quantum computers. In superconducting qubits, low frequency charge noise is a well-known decoherence mechanism that is effectively suppressed in the transmon qubit. Devices with multiple charge-sensitive modes can exhibit more complex behaviours, which can be exploited to study charge fluctuations in superconducting qubits. Here we characterise charge-sensitivity in a superconducting qubit with two transmon-like modes, each of which is sensitive to multiple charge-parity configurations and charge-offset biases. Using Ramsey interferometry, we observe sensitivity to four charge-parity configurations and track two independent charge-offset drifts over hour timescales. We provide a predictive theory for charge sensitivity in such multi-mode qubits which agrees with our results. Finally, we demonstrate the utility of a multi-mode qubit as a charge detector by spatially tracking local-charge drift.


title: Magnitudes, Scalable Monoids and Quantity Spaces

abstract: In ancient Greek mathematics, magnitudes such as lengths were strictly distinguished from numbers. In modern quantity calculus, a distinction is made between quantities and scalars that serve as measures of quantities. It can be argued that quantities should play a more prominent, independent role in modern mathematics, as magnitudes earlier. The introduction includes a sketch of the development and structure of the pre-modern theory of magnitudes and numbers. Then, a scalable monoid over a ring is defined and its basic properties are described. Congruence relations on scalable monoids, direct and tensor products of scalable monoids, subalgebras and homomorphic images of scalable monoids, and unit elements of scalable monoids are also defined and analyzed. A quantity space is defined as a commutative scalable monoid over a field, admitting a finite basis similar to a basis for a free abelian group. The mathematical theory of quantity spaces forms the basis of a rigorous quantity calculus and is developed with a view to applications in metrology and foundations of physics.


title: Photometric variability of the pre-main sequence stars towards the Sh 2-190 region

abstract: We present the results from our time-series imaging data taken with the 1.3m Devasthal fast optical telescope and 0.81m Tenagara telescope in $V$, $R_{c}$, $I_{c}$ bands covering an area of $\sim18^\prime.4\times 18^\prime.4$ towards the star-forming region Sh 2-190. This photometric data helped us to explore the nature of the variability of pre-main sequence (PMS) stars. We have identified 85 PMS variables, i.e., 37 Class II and 48 Class III sources. Forty-five of the PMS variables are showing periodicity in their light curves. We show that the stars with thicker discs and envelopes rotate slower and exhibit larger photometric variations compared to their disc-less counterparts. This result suggests that rotation of the PMS stars is regulated by the presence of circumstellar discs. We also found that the period of the stars show a decreasing trend with increasing mass in the range of $\sim$0.5-2.5 M$_\odot$. Our result indicates that most of the variability in Class II sources is ascribed to the presence of thick disc, while the presence of cool spots on the stellar surface causes the brightness variation in Class III sources. X-ray activities in the PMS stars were found to be at the saturation level reported for the main sequence (MS) stars. The younger counterparts of the PMS variables are showing less X-ray activity hinting towards a less significant role of a stellar disc in X-ray generation.


title: The pseudogap in hole-doped cuprates: possible insights from the Kondo effect

abstract: The "states-non-conserving" fermion density of states (DOS), deduced from the specific heat of hole-doped cuprates, could arise from a Kondo or heavy fermion-like DOS being suppressed by anti-ferromagnetic spin fluctuations. The large Fermi surface predicted by band theory and observed experimentally, is still expected for zero pseudogap, but with an effective mass corresponding to a Kondo temperature ~ 800 K. A finite pseudogap could divide it into Fermi arcs. Theoretical results for the asymmetric Anderson model can account for the experimental Wilson ratio.


title: Server Cloud Scheduling

abstract: Consider a set of jobs connected to a directed acyclic task graph with a fixed source and sink. The edges of this graph model precedence constraints and the jobs have to be scheduled with respect to those. We introduce the Server Cloud Scheduling problem, in which the jobs have to be processed either on a single local machine or on one of many cloud machines. Both the source and the sink have to be scheduled on the local machine. For each job, processing times both on the server and in the cloud are given. Furthermore, for each edge in the task graph, a communication delay is included in the input and has to be taken into account if one of the two jobs is scheduled on the server, the other in the cloud. The server can process jobs sequentially, whereas the cloud can serve as many as needed in parallel, but induces costs. We consider both makespan and cost minimization. The main results are an FPTAS with respect for the makespan objective for a fairly general case and strong hardness for the case with unit processing times and delays.


title: Recursive Fusion and Deformable Spatiotemporal Attention for Video Compression Artifact Reduction

abstract: A number of deep learning based algorithms have been proposed to recover high-quality videos from low-quality compressed ones. Among them, some restore the missing details of each frame via exploring the spatiotemporal information of neighboring frames. However, these methods usually suffer from a narrow temporal scope, thus may miss some useful details from some frames outside the neighboring ones. In this paper, to boost artifact removal, on the one hand, we propose a Recursive Fusion (RF) module to model the temporal dependency within a long temporal range. Specifically, RF utilizes both the current reference frames and the preceding hidden state to conduct better spatiotemporal compensation. On the other hand, we design an efficient and effective Deformable Spatiotemporal Attention (DSTA) module such that the model can pay more effort on restoring the artifact-rich areas like the boundary area of a moving object. Extensive experiments show that our method outperforms the existing ones on the MFQE 2.0 dataset in terms of both fidelity and perceptual effect. Code is available at https://github.com/zhaominyiz/RFDA-PyTorch.


title: Algebraicity of critical values of triple product $L$-functions in the balanced case

abstract: The algebraicity of critical values of triple product $L$-functions in the balanced case was proved by Garrett and Harris, under the assumption that the critical points are on the right and away from center of the critical strip. The missing right-half critical points correspond to certain holomorphic Eisenstein series outside the range of absolute convergence. The remaining difficulties are construction of these holomorphic Eisenstein series and verification of the non-vanishing of the corresponding non-archimedean local zeta integrals. In this paper, we address these problems and complement the result of Garrett and Harris to all critical points. As a consequence, we obtain new cases of Deligne's conjecture for symmetric cube $L$-functions of Hilbert modular forms.


title: Cross-helicity and transition from magnetohydrodynamics to kinetics in space plasmas

abstract: Cross-helicity dominated distributed chaos (CHDC) for magnetohydrodynamic (large-scale) and kinetic (small-scale) ranges of space plasmas has been studied using results of direct numerical simulations and of measurements made in the Earth's magnetosheath and in free solar wind by the instruments onboard of the Magnetospheric Multiscale Mission and CLUSTER spacecrafts. Existence of two generic types of transition from the magnetohydrodynamic (MHD) to kinetic range has been shown: 1) from the Kolmogorov-like (scaling) MHD turbulence to the kinetic CHDC and 2) from the magnetohydrodynamic CHDC to the kinetic CHDC. Results of measurements in the magnetosheath of some other planets: Saturn (Cassini observations), Jupiter (Galileo observations), and Mercury (Messenger observations), have been briefly discussed in this contest.


title: Hyperparameter-free and Explainable Whole Graph Embedding

abstract: Graphs can be used to describe complex systems. Recently, whole graph embedding (graph representation learning) can compress a graph into a compact lower-dimension vector while preserving intrinsic properties, earning much attention. However, most graph embedding methods have problems such as tedious parameter tuning or poor explanation. This paper presents a simple and hyperparameter-free whole graph embedding method based on the DHC (Degree, H-index, and Coreness) theorem and Shannon Entropy (E), abbreviated as DHC-E. The DHC-E can provide a trade-off between simplicity and quality for supervised classification learning tasks involving molecular, social, and brain networks. Moreover, it performs well in lower-dimensional graph visualization. Overall, the DHC-E is simple, hyperparameter-free, and explainable for whole graph embedding with promising potential for exploring graph classification and lower-dimensional graph visualization.


title: Feature Curves and Surfaces of 3D Asymmetric Tensor Fields

abstract: 3D asymmetric tensor fields have found many applications in science and engineering domains, such as fluid dynamics and solid mechanics. 3D asymmetric tensors can have complex eigenvalues, which makes their analysis and visualization more challenging than 3D symmetric tensors. Existing research in tensor field visualization focuses on 2D asymmetric tensor fields and 3D symmetric tensor fields. In this paper, we address the analysis and visualization of 3D asymmetric tensor fields. We introduce six topological surfaces and one topological curve, which lead to an eigenvalue space based on the tensor mode that we define. In addition, we identify several non-topological feature surfaces that are nonetheless physically important. Included in our analysis are the realizations that triple degenerate tensors are structurally stable and form curves, unlike the case for 3D symmetric tensors fields. Furthermore, there are two different ways of measuring the relative strengths of rotation and angular deformation in the tensor fields, unlike the case for 2D asymmetric tensor fields. We extract these feature surfaces using the A-patches algorithm. However, since three of our feature surfaces are quadratic, we develop a method to extract quadratic surfaces at any given accuracy. To facilitate the analysis of eigenvector fields, we visualize a hyperstreamline as a tree stem with the other two eigenvectors represented as thorns in the real domain or the dual-eigenvectors as leaves in the complex domain. To demonstrate the effectiveness of our analysis and visualization, we apply our approach to datasets from solid mechanics and fluid dynamics.


title: A flexible smoother adapted to censored data with outliers and its application to SARS-CoV-2 monitoring in wastewater

abstract: A sentinel network, Ob\'epine, has been designed to monitor SARS-CoV-2 viral load in wastewaters arriving at wastewater treatment plants (WWTPs) in France as an indirect macro-epidemiological parameter. The sources of uncertainty in such monitoring system are numerous and the concentration measurements it provides are left-censored and contain outliers, which biases the results of usual smoothing methods. Hence the need for an adapted pre-processing in order to evaluate the real daily amount of virus arriving to each WWTP. We propose a method based on an auto-regressive model adapted to censored data with outliers. Inference and prediction are produced via a discretised smoother which makes it a very flexible tool. This method is both validated on simulations and on real data from Ob\'epine. The resulting smoothed signal shows a good correlation with other epidemiological indicators and is currently used by Ob\'epine to provide an estimate of virus circulation over the watersheds corresponding to about 200 WWTPs.


title: Unexpected Electron Transport Suppression in a Heterostructures Graphene MoS2 Multiple Field-Effect Transistor Architecture

abstract: We demonstrate a graphene-MoS2 architecture integrating multiple field-effect transistors and we independently probe and correlate the conducting properties of van der Waals coupled graphene-MoS2 contacts with the ones of the MoS2 channels. Devices are fabricated starting from high-quality single-crystal monolayers grown by chemical vapor deposition and characterized by scanning Raman and photoluminescence spectroscopies. Transconductance curves of MoS2 are compared with the current-voltage characteristics of graphene contact stripes, revealing a significant suppression of transport on the n-side of the transconductance curve. Based on ab-initio modeling, the effect is understood in terms of trapping by sulfur vacancies, which counter-intuitively depends on the field-effect, even though the graphene contact layer is positioned between the backgate and the MoS2 channel.


title: FedJAX: Federated learning simulation with JAX

abstract: Federated learning is a machine learning technique that enables training across decentralized data. Recently, federated learning has become an active area of research due to an increased focus on privacy and security. In light of this, a variety of open source federated learning libraries have been developed and released. We introduce FedJAX, a JAX-based open source library for federated learning simulations that emphasizes ease-of-use in research. With its simple primitives for implementing federated learning algorithms, prepackaged datasets, models and algorithms, and fast simulation speed, FedJAX aims to make developing and evaluating federated algorithms faster and easier for researchers. Our benchmark results show that FedJAX can be used to train models with federated averaging on the EMNIST dataset in a few minutes and the Stack Overflow dataset in roughly an hour with standard hyperparameters using TPUs.


title: The volume-of-tube method for Gaussian random fields with inhomogeneous variance

abstract: The tube method or the volume-of-tube method approximates the tail probability of the maximum of a smooth Gaussian random field with zero mean and unit variance. This method evaluates the volume of a spherical tube about the index set, and then transforms it to the tail probability. In this study, we generalize the tube method to a case in which the variance is not constant. We provide the volume formula for a spherical tube with a non-constant radius in terms of curvature tensors, and the tail probability formula of the maximum of a Gaussian random field with inhomogeneous variance, as well as its Laplace approximation. In particular, the critical radius of the tube is generalized for evaluation of the asymptotic approximation error. As an example, we discuss the approximation of the largest eigenvalue distribution of the Wishart matrix with a non-identity matrix parameter. The Bonferroni method is the tube method when the index set is a finite set. We provide the formula for the asymptotic approximation error for the Bonferroni method when the variance is not constant.


title: Low-complexity Scaling Methods for DCT-II Approximations

abstract: This paper introduces a collection of scaling methods for generating $2N$-point DCT-II approximations based on $N$-point low-complexity transformations. Such scaling is based on the Hou recursive matrix factorization of the exact $2N$-point DCT-II matrix. Encompassing the widely employed Jridi-Alfalou-Meher scaling method, the proposed techniques are shown to produce DCT-II approximations that outperform the transforms resulting from the JAM scaling method according to total error energy and mean squared error. Orthogonality conditions are derived and an extensive error analysis based on statistical simulation demonstrates the good performance of the introduced scaling methods. A hardware implementation is also provided demonstrating the competitiveness of the proposed methods when compared to the JAM scaling method.


title: Statistical Analysis of Wasserstein Distributionally Robust Estimators

abstract: We consider statistical methods which invoke a min-max distributionally robust formulation to extract good out-of-sample performance in data-driven optimization and learning problems. Acknowledging the distributional uncertainty in learning from limited samples, the min-max formulations introduce an adversarial inner player to explore unseen covariate data. The resulting Distributionally Robust Optimization (DRO) formulations, which include Wasserstein DRO formulations (our main focus), are specified using optimal transportation phenomena. Upon describing how these infinite-dimensional min-max problems can be approached via a finite-dimensional dual reformulation, the tutorial moves into its main component, namely, explaining a generic recipe for optimally selecting the size of the adversary's budget. This is achieved by studying the limit behavior of an optimal transport projection formulation arising from an inquiry on the smallest confidence region that includes the unknown population risk minimizer. Incidentally, this systematic prescription coincides with those in specific examples in high-dimensional statistics and results in error bounds that are free from the curse of dimensions. Equipped with this prescription, we present a central limit theorem for the DRO estimator and provide a recipe for constructing compatible confidence regions that are useful for uncertainty quantification. The rest of the tutorial is devoted to insights into the nature of the optimizers selected by the min-max formulations and additional applications of optimal transport projections.


title: Deep Portrait Lighting Enhancement with 3D Guidance

abstract: Despite recent breakthroughs in deep learning methods for image lighting enhancement, they are inferior when applied to portraits because 3D facial information is ignored in their models. To address this, we present a novel deep learning framework for portrait lighting enhancement based on 3D facial guidance. Our framework consists of two stages. In the first stage, corrected lighting parameters are predicted by a network from the input bad lighting image, with the assistance of a 3D morphable model and a differentiable renderer. Given the predicted lighting parameter, the differentiable renderer renders a face image with corrected shading and texture, which serves as the 3D guidance for learning image lighting enhancement in the second stage. To better exploit the long-range correlations between the input and the guidance, in the second stage, we design an image-to-image translation network with a novel transformer architecture, which automatically produces a lighting-enhanced result. Experimental results on the FFHQ dataset and in-the-wild images show that the proposed method outperforms state-of-the-art methods in terms of both quantitative metrics and visual quality. We will publish our dataset along with more results on https://cassiepython.github.io/egsr/index.html.


title: Semi-weakly Supervised Contrastive Representation Learning for Retinal Fundus Images

abstract: We explore the value of weak labels in learning transferable representations for medical images. Compared to hand-labeled datasets, weak or inexact labels can be acquired in large quantities at significantly lower cost and can provide useful training signals for data-hungry models such as deep neural networks. We consider weak labels in the form of pseudo-labels and propose a semi-weakly supervised contrastive learning (SWCL) framework for representation learning using semi-weakly annotated images. Specifically, we train a semi-supervised model to propagate labels from a small dataset consisting of diverse image-level annotations to a large unlabeled dataset. Using the propagated labels, we generate a patch-level dataset for pretraining and formulate a multi-label contrastive learning objective to capture position-specific features encoded in each patch. We empirically validate the transfer learning performance of SWCL on seven public retinal fundus datasets, covering three disease classification tasks and two anatomical structure segmentation tasks. Our experiment results suggest that, under very low data regime, large-scale ImageNet pretraining on improved architecture remains a very strong baseline, and recently proposed self-supervised methods falter in segmentation tasks, possibly due to the strong invariant constraint imposed. Our method surpasses all prior self-supervised methods and standard cross-entropy training, while closing the gaps with ImageNet pretraining.


title: Stable commutator length on big mapping class groups

abstract: We study stable commutator length on mapping class groups of certain infinite-type surfaces. In particular, we show that stable commutator length defines a continuous function on the commutator subgroups of such infinite-type mapping class groups. We furthermore show that the commutator subgroups are open and closed subgroups and that the abelianizations are finitely generated in many cases. Our results apply to many popular infinite-type surfaces with locally coarsely bounded mapping class groups.


title: Energy-momentum tensor and duality symmetry of linearized gravity in the Fierz formalism

abstract: A formulation of linearized gravity in flat background, based on the Fierz tensor as a counterpart of the electromagnetic field strength, is discussed in detail and used to study fundamental properties of the linearized gravitational field. In particular, the linearized Einstein equations are written as first order partial differential equations in terms of the Fierz tensor, in analogy with the first order Maxwell equations. An energy-momentum tensor ($T_{\mathrm{lg}}^{ab}$) with favourable properties and exhibiting remarkable similarity to the standard energy-momentum tensor of the electromagnetic field is found for the linearized gravitational field. $T_{\mathrm{lg}}^{ab}$ is quadratic in the Fierz tensor (which is constructed from the first derivatives of the linearized metric), traceless, and satisfies the dominant energy condition in a gauge that contains the transverse traceless gauge. It is further shown that in suitable gauges, including the transverse traceless gauge, linearized gravity in the absence of matter has a duality symmetry that maps the Fierz tensor, which is antisymmetric in its first two indices, into its dual. Conserved currents associated with the gauge and duality symmetries of linearized gravity are also determined. These currents show good analogy with the corresponding currents in electrodynamics.


title: Charmonium in electromagnetic and vortical fields

abstract: Due to larger mass and earlier production, heavy quark(quarkonium) can be sensitive probes to investigate the fast decaying electromagnetic and vortical fields produced in heavy-ion collisions. The non-relativistic Schroedinger-like equation for heavy quarks under strong electromagnetic fields in the rotating frame is deduced and used to construct the two-body equation for the charmonium system. The effective potential between charm and anti-charm becomes anisotropic in electromagnetic and vortical fields, especially along the direction of the Lorentz force. The vorticity will affect this asymmetry property largely and catalyze the transition from strong interaction dominant bound state to electromagnetic and vortical interaction controlled anisotropic bound state. It is possible to be realized in high-energy nuclear collisions.


title: I Will Have Order! Optimizing Orders for Fair Reviewer Assignment

abstract: We present fast, fair, flexible, and welfare efficient algorithms for assigning reviewers to submitted conference papers. Our approaches extend picking sequence mechanisms, standard tools from the fair allocation literature to ensure approximate envy-freeness (typically envy-freeness up to one item, or EF1). However, fairness often comes at the cost of decreased efficiency. To overcome this challenge, we carefully select approximately optimal picking sequence orders. Applying a relaxation of submodularity, $\gamma$-weak submodularity, we show our Greedy Reviewer Round Robin (GRRR) approach is EF1 and yields a ${(1+\gamma)}$-approximation to the maximum welfare attainable by a round-robin picking sequence mechanism under any order. We present a weighted picking sequence mechanism called FairSequence that targets the Weighted EF1 criterion to offer fairness in a more general setting. Using data from three conferences, we show that FairSequence runs an order of magnitude faster and provides approximate envy-freeness guarantees that are violated by existing approaches. Its simple design also makes it very flexible to new assignment constraints. FairSequence is available in the OpenReview conference management platform, giving conference organizers access to faster reviewer assignment with high welfare and envy-freeness guarantees.


title: Comprehensive study of amorphous metal oxide and Ta$_2$O$_5$-based mixed oxide coatings for gravitational-wave detectors

abstract: High finesse optical cavities of current interferometric gravitational-wave detectors are significantly limited in sensitivity by laser quantum noise and coating thermal noise. The thermal noise is associated with internal energy dissipation in the materials that compose the test masses of the interferometer. Our understanding of how the internal friction is linked to the amorphous material structure is limited due to the complexity of the problem and the lack of studies that span over a large range of materials. We present a systematic investigation of amorphous metal oxide and Ta$_2$O$_5$-based mixed oxide coatings to evaluate their suitability for low Brownian noise experiments. It is shown that the mechanical loss of metal oxides is correlated to their amorphous morphology, with continuous random network materials such as SiO$_2$ and GeO$_2$ featuring the lowest loss angles. We evaluated different Ta$_2$O$_5$-based mixed oxide thin films and studied the influence of the dopant in the optical and elastic properties of the coating. We estimated the thermal noise associated with high-reflectance multilayer stacks that employ each of the mixed oxides as the high index material. We concluded that the current high index material of TiO$_2$-doped Ta$_2$O$_5$ is the optimal choice for reduced thermal noise among Ta$_2$O$_5$-based mixed oxide coatings with low dopant concentrations.


title: Parallelized Reverse Curriculum Generation

abstract: For reinforcement learning (RL), it is challenging for an agent to master a task that requires a specific series of actions due to sparse rewards. To solve this problem, reverse curriculum generation (RCG) provides a reverse expansion approach that automatically generates a curriculum for the agent to learn. More specifically, RCG adapts the initial state distribution from the neighborhood of a goal to a distance as training proceeds. However, the initial state distribution generated for each iteration might be biased, thus making the policy overfit or slowing down the reverse expansion rate. While training RCG for actor-critic (AC) based RL algorithms, this poor generalization and slow convergence might be induced by the tight coupling between an AC pair. Therefore, we propose a parallelized approach that simultaneously trains multiple AC pairs and periodically exchanges their critics. We empirically demonstrate that this proposed approach can improve RCG in performance and convergence, and it can also be applied to other AC based RL algorithms with adapted initial state distribution.


title: Convergence results of a nested decentralized gradient method for non-strongly convex problems

abstract: We are concerned with the convergence of NEAR-DGD$^+$ (Nested Exact Alternating Recursion Distributed Gradient Descent) method introduced to solve the distributed optimization problems. Under the assumption of the strong convexity of local objective functions and the Lipschitz continuity of their gradients, the linear convergence is established in \cite{BBKW - Near DGD}. In this paper, we investigate the convergence property of NEAR-DGD$^+$ in the absence of strong convexity. More precisely, we establish the convergence results in the following two cases: (1) When only the convexity is assumed on the objective function. (2) When the objective function is represented as a composite function of a strongly convex function and a rank deficient matrix, which falls into the class of convex and quasi-strongly convex functions. Numerical results are provided to support the convergence results.


title: Uplink Energy Efficiency of Cell-Free Massive MIMO With Transmit Power Control in Measured Propagation Channels

abstract: Cell-free massive MIMO (CF-mMIMO) is expected to provide reliable wireless services for a large number of user equipments (UEs) using access points (APs) distributed across a wide area. When the UEs are battery-powered, uplink energy efficiency (EE) becomes an important performance metric for CF-mMIMO systems. Therefore, if the "target" spectral efficiency (SE) is met, it is important to optimize the uplink EE when setting the transmit powers of the UEs. Also, such transmit power control (TPC) method must be tested on channel data from real-world measurements to prove its effectiveness. In this paper, we compare three different TPC algorithms using zero-forcing reception by applying them to 3.5 GHz channel measurement data featuring ~30,000 possible AP locations and 8 UE locations in a 200mx200m area. We show that the max-min EE algorithm is highly effective in improving the uplink EE at a target SE, especially if the number of single-antenna APs is large, circuit power consumption is low, and the maximum allowed transmit power of the UEs is high.


title: Self-propulsion and self-navigation: Activity is a precursor to jamming

abstract: Traffic jams are an everyday hindrance to transport, and typically arise when many vehicles have the same or a similar destination. We show, however, that even when uniformly distributed in space and uncorrelated, targets have a crucial effect on transport. At modest densities an instability arises leading to jams with emergent correlations between the targets. By considering limiting cases of the dynamics which map onto active Brownian particles, we argue that motility induced phase separation is the precursor to jams. That is, jams are MIPS seeds that undergo an extra instability due to target accumulation. This provides a quantitative prediction of the onset density for jamming, and suggests how jamming might be delayed or prevented. We study the transition between jammed and flowing phase, and find that transport is most efficient on the cusp of jamming.


title: A unified framework for distributed optimization algorithms over time-varying directed graphs

abstract: In this paper, we propose a framework under which the decentralized optimization algorithms suggested in \cite{JKJJ,MA, NO,NO2} can be treated in a unified manner. More precisely, we show that the distributed subgradient descent algorithms \cite{JKJJ, NO}, the subgradient-push algorithm \cite{NO2}, and the distributed algorithm with row-stochastic matrix \cite{MA} can be derived by making suitable choices of consensus matrices, step-size and subgradient from the decentralized subgradient descent proposed in \cite{NO}. As a result of such unified understanding, we provide a convergence proof that covers the algorithms in \cite{JKJJ,MA, NO,NO2} under a novel algebraic condition that is strictly weaker than the conventional graph-theoretic condition in \cite{NO}. This unification also enables us to derive a new distributed optimization scheme.


title: The Impact of Traceability on Software Maintenance and Evolution: A Mapping Study

abstract: Software traceability plays a critical role in software maintenance and evolution. We conducted a systematic mapping study with six research questions to understand the benefits, costs, and challenges of using traceability in maintenance and evolution. We systematically selected, analyzed, and synthesized 63 studies published between January 2000 and May 2020, and the results show that: traceability supports 11 maintenance and evolution activities, among which change management is the most frequently supported activity; strong empirical evidence from industry is needed to validate the impact of traceability on maintenance and evolution; easing the process of change management is the main benefit of deploying traceability practices; establishing and maintaining traceability links is the main cost of deploying traceability practices; 13 approaches and 32 tools that support traceability in maintenance and evolution were identified; improving the quality of traceability links, the performance of using traceability approaches and tools are the main traceability challenges in maintenance and evolution. The findings of this study provide a comprehensive understanding of deploying traceability practices in software maintenance and evolution phase, and can be used by researchers for future directions and practitioners for making informed decisions while using traceability in maintenance and evolution.


title: A strong equivariant deformation retraction from the homeomorphism group of the projective plane to the special orthogonal group

abstract: This is the third paper in a series on oriented matroids and Grassmannians. We construct a $(\mathrm{O}_3\times\mathbb{Z}_2)$-equivariant strong deformation retraction from the homeomorphism group of the 2-sphere to $\mathrm{O}_3$, where the action of $\mathbb{Z}_2$ is generated by antipodal reflection acting on the right, and $\mathrm{O}_3$ acts on the left by isometry. Quotienting by the antipodal map induces a $\mathrm{SO}_3$-equivariant strong deformation retraction from the homeomorphism group of the projective plane to $\mathrm{SO}_3$. The same holds for subgroups of homeomorphisms that preserve the system of null sets. This confirms a conjecture of Mary-Elizabeth Hamstrom.


title: Rigidity and almost rigidity of Sobolev inequalities on compact spaces with lower Ricci curvature bounds

abstract: We prove that if $M$ is a closed $n$-dimensional Riemannian manifold, $n \ge 3$, with ${\rm Ric}\ge n-1$ and for which the optimal constant in the critical Sobolev inequality equals the one of the $n$-dimensional sphere $\mathbb{S}^n$, then $M$ is isometric to $\mathbb{S}^n$. An almost-rigidity result is also established, saying that if equality is almost achieved, then $M$ is close in the measure Gromov-Hausdorff sense to a spherical suspension. These statements are obtained in the ${\rm RCD}$-setting of (possibly non-smooth) metric measure spaces satisfying synthetic lower Ricci curvature bounds. An independent result of our analysis is the characterization of the best constant in the Sobolev inequality on any compact ${\rm CD}$ space, extending to the non-smooth setting a classical result by Aubin. Our arguments are based on a new concentration compactness result for mGH-converging sequences of ${\rm RCD}$ spaces and on a Polya-Szego inequality of Euclidean-type in ${\rm CD}$ spaces. As an application of the technical tools developed we prove both an existence result for the Yamabe equation and the continuity of the generalized Yamabe constant under measure Gromov-Hausdorff convergence, in the ${\rm RCD}$-setting.


title: Randomized Local Fast Rerouting for Datacenter Networks with Almost Optimal Congestion

abstract: To ensure high availability, datacenter networks must rely on local fast rerouting mechanisms that allow routers to quickly react to link failures, in a fully decentralized manner. However, configuring these mechanisms to provide a high resilience against multiple failures while avoiding congestion along failover routes is algorithmically challenging, as the rerouting rules can only depend on local failure information and must be defined ahead of time. This paper presents a randomized local fast rerouting algorithm for Clos networks, the predominant datacenter topologies. Given a graph $G=(V,E)$ describing a Clos topology, our algorithm defines local routing rules for each node $v\in V$, which only depend on the packet's destination and are conditioned on the incident link failures. We prove that as long as number of failures at each node does not exceed a certain bound, our algorithm achieves an asymptotically minimal congestion up to polyloglog factors along failover paths. Our lower bounds are developed under some natural routing assumptions.


title: Under the Radar -- Auditing Fairness in ML for Humanitarian Mapping

abstract: Humanitarian mapping from space with machine learning helps policy-makers to timely and accurately identify people in need. However, recent concerns around fairness and transparency of algorithmic decision-making are a significant obstacle for applying these methods in practice. In this paper, we study if humanitarian mapping approaches from space are prone to bias in their predictions. We map village-level poverty and electricity rates in India based on nighttime lights (NTLs) with linear regression and random forest and analyze if the predictions systematically show prejudice against scheduled caste or tribe communities. To achieve this, we design a causal approach to measure counterfactual fairness based on propensity score matching. This allows to compare villages within a community of interest to synthetic counterfactuals. Our findings indicate that poverty is systematically overestimated and electricity systematically underestimated for scheduled tribes in comparison to a synthetic counterfactual group of villages. The effects have the opposite direction for scheduled castes where poverty is underestimated and electrification overestimated. These results are a warning sign for a variety of applications in humanitarian mapping where fairness issues would compromise policy goals.


title: Predicting Music Relistening Behavior Using the ACT-R Framework

abstract: Providing suitable recommendations is of vital importance to improve the user satisfaction of music recommender systems. Here, users often listen to the same track repeatedly and appreciate recommendations of the same song multiple times. Thus, accounting for users' relistening behavior is critical for music recommender systems. In this paper, we describe a psychology-informed approach to model and predict music relistening behavior that is inspired by studies in music psychology, which relate music preferences to human memory. We adopt a well-established psychological theory of human cognition that models the operations of human memory, i.e., Adaptive Control of Thought-Rational (ACT-R). In contrast to prior work, which uses only the base-level component of ACT-R, we utilize five components of ACT-R, i.e., base-level, spreading, partial matching, valuation, and noise, to investigate the effect of five factors on music relistening behavior: (i) recency and frequency of prior exposure to tracks, (ii) co-occurrence of tracks, (iii) the similarity between tracks, (iv) familiarity with tracks, and (v) randomness in behavior. On a dataset of 1.7 million listening events from Last.fm, we evaluate the performance of our approach by sequentially predicting the next track(s) in user sessions. We find that recency and frequency of prior exposure to tracks is an effective predictor of relistening behavior. Besides, considering the co-occurrence of tracks and familiarity with tracks further improves performance in terms of R-precision. We hope that our work inspires future research on the merits of considering cognitive aspects of memory retrieval to model and predict complex user behavior.


title: A generalization of the Kobayashi-Oshima uniformly bounded multiplicity theorem

abstract: Let $P$ be a minimal parabolic subgroup of a real reductive Lie group $G$ and $H$ a closed subgroup of $G$. Then it is proved by T. Kobayashi and T. Oshima that the regular representation $C^{\infty}(G/H)$ contains each irreducible representation of $G$ at most finitely many times if the number of $H$-orbits on $G/P$ is finite. Moreover, they also proved that the multiplicities are uniformly bounded if the number of $H_{\mathbb C}$-orbits on $G_{\mathbb C}/B$ is finite, where $G_{\mathbb C}, H_{\mathbb C}$ are complexifications of $G, H$, respectively, and $B$ is a Borel subgroup of $G_{\mathbb C}$. In this article, we prove that the multiplicities of the representations of $G$ induced from a parabolic subgroup $Q$ in the regular representation on $G/H$ are uniformly bounded if the number of $H_{\mathbb C}$-orbits on $G_{\mathbb C}/Q_{\mathbb C}$ is finite. For the proof of this claim, we also show the uniform boundedness of the dimensions of the spaces of group invariant hyperfunctions using the theory of holonomic ${\mathcal D}_{X}$-modules.


title: Linear regression under model uncertainty

abstract: We reexamine the classical linear regression model when the model is subject to two types of uncertainty: (i) some of covariates are either missing or completely inaccessible, and (ii) the variance of the measurement error is undetermined and changing according to a mechanism unknown to the statistician. By following the recent theory of sublinear expectation, we propose to characterize such mean and variance uncertainty in the response variable by two specific nonlinear random variables, which encompass an infinite family of probability distributions for the response variable in the sense of (linear) classical probability theory. The approach enables a family of estimators under various loss functions for the regression parameter and the parameters related to model uncertainty. The consistency of the estimators is established under mild conditions on the data generation process. Three applications are introduced to assess the quality of the approach including a forecasting model for the S\&P Index.


title: The power of flexible lattice in Ca3Ru2O7: Exquisite control of the electrical transport via anisotropic magnetostriction

abstract: Ca3Ru2O7 is a correlated and spin-orbit-coupled system with an extraordinary anisotropy. It is both interesting and unique largely because this material exhibits conflicting phenomena that are often utterly inconsistent with traditional precedents, particularly, the quantum oscillations in the nonmetallic state and colossal magnetoresistivity achieved by avoiding a fully spin-polarized state. This work focuses on the relationship between the lattice and transport properties along each crystalline axis and reveals that application of magnetic field, H, along different crystalline axes readily stretches or shrinks the lattice in a uniaxial manner, resulting in distinct electronic states. Furthermore, application of modest pressure drastically amplifies the anisotropic magnetoelastic effect, leading to either an occurrence of a robust metallic state at H || hard axis or a reentrance of the nonmetallic state at H || easy axis. Ca3Ru2O7 presents a rare lattice-dependent magnetotransport mechanism, in which the extraordinary lattice flexibility enables an exquisite control of the electronic state via magnetically stretching or shrinking the crystalline axes, and the spin polarization plays an unconventional role unfavorable for maximizing conductivity. At the heart of the intriguing physics is the anisotropic magnetostriction that leads to exotic states.


title: J2102+6015: a young radio source at z = 4.575

abstract: Jets of high-redshift active galactic nuclei (AGNs) can be used to directly probe the activity of the black holes in the early Universe. Radio sources with jets misaligned with respect to the line of sight are expected to dominate the high-redshift AGN population. In this paper, we present the high-resolution imaging results of a z=4.57 AGN J2102+6015 by analyzing its multi-epoch dual-frequency very long baseline interferometry (VLBI) data. The 8.4-GHz VLBI images reveal two major features along the east-west direction separated by $\sim$ 10 milli-arcsec (mas). From the spectral index map, both features show flat/inverted spectra. The separation between the two features remains almost unchanged over an observation period of $\sim$ 13 years, placing an upper limit of the separation speed as about 0.04 mas year$^{-1}$. Previous studies have classified the source as a GHz-peaked spectrum quasar. Our results indicate that J2102+6015 is most likely a young, compact symmetric object rather than a blazar-type core-jet source.


title: Dimension reduction for integrative survival analysis

abstract: We propose a constrained maximum partial likelihood estimator for dimension reduction in integrative (e.g., pan-cancer) survival analysis with high-dimensional covariates. We assume that for each population in the study, the hazard function follows a distinct Cox proportional hazards model. To borrow information across populations, we assume that all of the hazard functions depend only on a small number of linear combinations of the predictors. We estimate these linear combinations using an algorithm based on "distance-to-set" penalties. This allows us to impose both low-rankness and sparsity. We derive asymptotic results which reveal that our regression coefficient estimator is more efficient than fitting a separate proportional hazards model for each population. Numerical experiments suggest that our method outperforms related competitors under various data generating models. We use our method to perform a pan-cancer survival analysis relating protein expression to survival across 18 distinct cancer types. Our approach identifies six linear combinations, depending on only 20 proteins, which explain survival across the cancer types. Finally, we validate our fitted model on four external datasets and show that our estimated coefficients can lead to better prediction than popular competitors.


title: No-regret distributed learning in subnetwork zero-sum games

abstract: In this paper, we consider a distributed learning problem in a subnetwork zero-sum game, where agents are competing in different subnetworks. These agents are connected through time-varying graphs where each agent has its own cost function and can receive information from its neighbors. We propose a distributed mirror descent algorithm for computing a Nash equilibrium and establish a sublinear regret bound on the sequence of iterates when the graphs are uniformly strongly connected and the cost functions are convex-concave. Moreover, we prove its convergence with suitably selected diminishing stepsizes for a strictly convex-concave cost function. We also consider a constant step-size variant of the algorithm and establish an asymptotic error bound between the cost function values of running average actions and a Nash equilibrium. In addition, we apply the algorithm to compute a mixed-strategy Nash equilibrium in subnetwork zero-sum finite-strategy games, which have merely convex-concave (to be specific, multilinear) cost functions, and obtain a final-iteration convergence result and an ergodic convergence result, respectively, under different assumptions.


title: Ultra-Compact accurate wave functions for He-like and Li-like iso-electronic sequences and variational calculus. II. Spin-singlet (excited) and spin-triplet (lowest) states of the Helium sequence

abstract: As a continuation of Part I \cite{Part-1:2020} (Int. Journal of Quantum Chem. 2021; 121: qua.26586), dedicated to the ground state of He-like and Li-like isoelectronic sequences for nuclear charges $Z \leq 20$, a few ultra-compact wave functions in the form of generalized Hylleraas-Kinoshita functions are constructed, which describe the domain of applicability of the Quantum Mechanics of Coulomb Charges (QMCC) for the energies (4-5 significant digits (s.d.)) of two excited states of He-like ions: the spin-singlet (first) excited state $2^1 S$ and the lowest spin-triplet $1^3 S$ state. For both states it provides absolute accuracy for energy $\sim 10^{-3}$\,a.u., exact values for cusp parameters and also for 6 expectation values the relative accuracy $\sim 10^{-2}$. The Bressanini-Reynolds observation about the special form of the nodal surface of the $2^1 S$ state of Helium is confirmed and extended to He-like ions with $Z > 2$. Critical charges $Z=Z_B$, where ultra-compact trial functions lose their square-integrability, are estimated: $Z_B(1^1 S)\approx Z_B(2^1 S)\sim 0.905$ and $Z_B(1^3 S)\sim 0.902$. For both states the Majorana formula - the energy as a second degree polynomial in $Z$ - provides accurately 4-5 significant digits for $Z \leq 20$.


title: Proton image and momentum distributions from light-front dynamics

abstract: We apply a dynamical three-constituent quark light-front model to study the proton. The dynamics is based on the notion of a diquark (bound or virtual) as the dominant interaction channel, which paramaterizes a contact interaction between the quarks in order to build the three-body Faddeev Bethe-Salpeter equations for the valence state, and we focus on the totally symmetric part of the wave function. The Dirac electromagnetic form factor is used to fix the model parameters, and the valence wave function is obtained. From that we investigate its Ioffe-time image, non-polarized longitudinal and transverse momentum distributions, and the double momentum distribution.


title: Optimizing Latency for Online Video CaptioningUsing Audio-Visual Transformers

abstract: Video captioning is an essential technology to understand scenes and describe events in natural language. To apply it to real-time monitoring, a system needs not only to describe events accurately but also to produce the captions as soon as possible. Low-latency captioning is needed to realize such functionality, but this research area for online video captioning has not been pursued yet. This paper proposes a novel approach to optimize each caption's output timing based on a trade-off between latency and caption quality. An audio-visual Trans-former is trained to generate ground-truth captions using only a small portion of all video frames, and to mimic outputs of a pre-trained Transformer to which all the frames are given. A CNN-based timing detector is also trained to detect a proper output timing, where the captions generated by the two Trans-formers become sufficiently close to each other. With the jointly trained Transformer and timing detector, a caption can be generated in the early stages of an event-triggered video clip, as soon as an event happens or when it can be forecasted. Experiments with the ActivityNet Captions dataset show that our approach achieves 94% of the caption quality of the upper bound given by the pre-trained Transformer using the entire video clips, using only 28% of frames from the beginning.


title: Pervasive Hand Gesture Recognition for Smartphones using Non-audible Sound and Deep Learning

abstract: Due to the mass advancement in ubiquitous technologies nowadays, new pervasive methods have come into the practice to provide new innovative features and stimulate the research on new human-computer interactions. This paper presents a hand gesture recognition method that utilizes the smartphone's built-in speakers and microphones. The proposed system emits an ultrasonic sonar-based signal (inaudible sound) from the smartphone's stereo speakers, which is then received by the smartphone's microphone and processed via a Convolutional Neural Network (CNN) for Hand Gesture Recognition. Data augmentation techniques are proposed to improve the detection accuracy and three dual-channel input fusion methods are compared. The first method merges the dual-channel audio as a single input spectrogram image. The second method adopts early fusion by concatenating the dual-channel spectrograms. The third method adopts late fusion by having two convectional input branches processing each of the dual-channel spectrograms and then the outputs are merged by the last layers. Our experimental results demonstrate a promising detection accuracy for the six gestures presented in our publicly available dataset with an accuracy of 93.58\% as a baseline.


title: The changing face of AU Mic b: stellar spots, spin-orbit commensurability, and Transit Timing Variations as seen by CHEOPS and TESS

abstract: AU Mic is a young planetary system with a resolved debris disc showing signs of planet formation and two transiting warm Neptunes near mean-motion resonances. Here we analyse three transits of AU Mic b observed with the CHaracterising ExOPlanet Satellite (CHEOPS), supplemented with sector 1 and 27 Transiting Exoplanet Survey Satellite (TESS) photometry, and the All-Sky Automated Survey (ASAS) from the ground. The refined orbital period of AU Mic b is 8.462995 \pm 0.000003 d, whereas the stellar rotational period is P_{rot}=4.8367 \pm 0.0006 d. The two periods indicate a 7:4 spin--orbit commensurability at a precision of 0.1%. Therefore, all transits are observed in front of one of the four possible stellar central longitudes. This is strongly supported by the observation that the same complex star-spot pattern is seen in the second and third CHEOPS visits that were separated by four orbits (and seven stellar rotations). Using a bootstrap analysis we find that flares and star spots reduce the accuracy of transit parameters by up to 10% in the planet-to-star radius ratio and the accuracy on transit time by 3-4 minutes. Nevertheless, occulted stellar spot features independently confirm the presence of transit timing variations (TTVs) with an amplitude of at least 4 minutes. We find that the outer companion, AU Mic c may cause the observed TTVs.