title: Hierarchical Onsager symmetries in adiabatically driven linear irreversible heat engines

abstract: In existing linear response theories for adiabatically driven cyclic heat engines, Onsager symmetry is identified only phenomenologically, and a relation between global and local Onsager coefficients, defined over one cycle and at any instant of a cycle, respectively, is not derived. To address this limitation, we develop a linear response theory for the speed of adiabatically changing parameters and temperature differences in generic Gaussian heat engines obeying Fokker--Planck dynamics. We establish a hierarchical relationship between the global linear response relations, defined over one cycle of the heat engines, and the local ones, defined at any instant of the cycle. This yields a detailed expression for the global Onsager coefficients in terms of the local Onsager coefficients. Moreover, we derive an efficiency bound, which is tighter than the Carnot bound, for adiabatically driven linear irreversible heat engines based on the detailed global Onsager coefficients. Finally, we demonstrate the application of the theory using the simplest stochastic Brownian heat engine model.


title: New Directions in Science Emerge from Disconnection and Discord

abstract: Science is built on the scholarly consensus that shifts with time. This raises the question of how new and revolutionary ideas are evaluated and become accepted into the canon of science. Using two recently proposed metrics, we identify papers with high atypicality, which models how research draws upon novel combinations of prior research, and evaluate disruption, which captures the degree to which a study creates a new direction by eclipsing its intellectual forebears. Atypical papers are nearly two times more likely to disrupt science than conventional papers, but this is a slow process taking ten years or longer for disruption scores to converge. We provide the first computational model reformulating atypicality as the distance across latent knowledge spaces learned by neural networks. The evolution of this knowledge space characterizes how yesterday's novelty forms today's scientific conventions, which condition the novelty--and surprise--of tomorrow's breakthroughs.


title: Representation Matters: Assessing the Importance of Subgroup Allocations in Training Data

abstract: Collecting more diverse and representative training data is often touted as a remedy for the disparate performance of machine learning predictors across subpopulations. However, a precise framework for understanding how dataset properties like diversity affect learning outcomes is largely lacking. By casting data collection as part of the learning process, we demonstrate that diverse representation in training data is key not only to increasing subgroup performances, but also to achieving population level objectives. Our analysis and experiments describe how dataset compositions influence performance and provide constructive results for using trends in existing data, alongside domain knowledge, to help guide intentional, objective-aware dataset design.


title: Progress Report on a Proposed Theory for Software Development

abstract: There is growing acknowledgement within the software engineering community that a theory of software development is needed to integrate the myriad methodologies that are currently popular, some of which are based on opposing perspectives. We have been developing such a theory for a number of years. In this position paper, we overview our theory along with progress made thus far. We suggest that, once fully developed, this theory, or one similar to it, may be applied to support situated software development, by providing an overarching model within which software initiatives might be categorised and understood. Such understanding would inevitably lead to greater predictability with respect to outcomes.


title: Modified equilibrium distributions for Cooper--Frye particlization

abstract: We introduce a positive definite single-particle distribution that is suitable for describing the transition from a macroscopic hydrodynamic to a microscopic kinetic description during the late stages of heavy-ion collisions in the presence of moderately large viscous corrections. The modified equilibrium distribution function can be constructed with hydrodynamic input from either relativistic viscous fluid dynamics or anisotropic fluid dynamics. We test the modified equilibrium distribution's hydrodynamic output for a stationary hadron resonance gas subject to either shear stress, bulk pressure, or baryon diffusion current at a given freeze-out temperature and baryon chemical potential. While it does not reproduce all components of the net baryon current and energy-momentum tensor exactly, it significantly improves upon the customary linearized approximations for the non-equilibrium correction $\delta f_n$ which typically lead to unphysical negative distribution functions at large particle momenta. A comparison of particle spectra and $p_T$-differential elliptic flow coefficients from the Cooper-Frye formula computed with the modified equilibrium distribution and with linearized $\delta f_n$ corrections is presented, for two different (2+1)-dimensional hypersurfaces corresponding to central and non-central Pb+Pb collisions at the Large Hadron Collider (LHC).


title: On realizations of the Lie groups $ G_{2,\boldmath\scriptstyle{H}},F_{4,\boldmath\scriptstyle{H}},E_{6,\boldmath\scriptstyle{H}},E_{7,\boldmath\scriptstyle{H}},E_{8,\boldmath\scriptstyle{H}} $, second edition

abstract: In order to define the exceptional compact Lie groups $G_2,F_4,E_6,E_7,E_8$, we usually use the Cayley algebra $\mathfrak{C}$ or its complexification $\mathfrak{C}^C$. In the present article, we consider replacing the Cayley algebra $\mathfrak{C}$ with the field of quaternion numbers $\boldmath{H}$ in the definition of the groups above, and these groups are denoted as in title above. Our aim is to determine the structure of these groups. We call realization to determine the structure of the groups.


title: Mechanism Design under Approximate Incentive Compatibility

abstract: A fundamental assumption in classical mechanism design is that buyers are perfect optimizers. However, in practice, buyers may be limited by their computational capabilities or a lack of information, and may not be able to perfectly optimize. This has motivated the introduction of approximate incentive compatibility (IC) as an appealing solution concept for practical mechanism design. While most of the literature focuses on the analysis of particular approximate IC mechanisms, this paper is the first to study the design of optimal mechanisms in the space of approximate IC mechanisms and to explore how much revenue can be garnered by moving from exact to approximate incentive constraints. We study the problem of a seller facing one buyer with private values and analyze optimal selling mechanisms under $\varepsilon$-incentive compatibility. We establish that the gains that can be garnered depend on the local curvature of the seller's revenue function around the optimal posted price when the buyer is a perfect optimizer. If the revenue function behaves locally like an $\alpha$-power for $\alpha \in (1,\infty)$, then no mechanism can garner gains higher than order $\varepsilon^{\alpha/(2\alpha-1)}$. This improves upon state-of-the-art results which imply maximum gains of $\varepsilon^{1/2}$ by providing the first parametric bounds that capture the impact of revenue function's curvature on revenue gains. Furthermore, we establish that an optimal mechanism needs to randomize as soon as $\varepsilon>0$ and construct a randomized mechanism that is guaranteed to achieve order $\varepsilon^{\alpha/(2\alpha-1)}$ additional revenues, leading to a tight characterization of the revenue implications of approximate IC constraints. Our work brings forward the need to optimize not only over allocations and payments but also over best responses, and we develop a new framework to address this challenge.


title: Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depth

abstract: Attention-based architectures have become ubiquitous in machine learning, yet our understanding of the reasons for their effectiveness remains limited. This work proposes a new way to understand self-attention networks: we show that their output can be decomposed into a sum of smaller terms, each involving the operation of a sequence of attention heads across layers. Using this decomposition, we prove that self-attention possesses a strong inductive bias towards "token uniformity". Specifically, without skip connections or multi-layer perceptrons (MLPs), the output converges doubly exponentially to a rank-1 matrix. On the other hand, skip connections and MLPs stop the output from degeneration. Our experiments verify the identified convergence phenomena on different variants of standard transformer architectures.


title: Learning in Matrix Games can be Arbitrarily Complex

abstract: A growing number of machine learning architectures, such as Generative Adversarial Networks, rely on the design of games which implement a desired functionality via a Nash equilibrium. In practice these games have an implicit complexity (e.g. from underlying datasets and the deep networks used) that makes directly computing a Nash equilibrium impractical or impossible. For this reason, numerous learning algorithms have been developed with the goal of iteratively converging to a Nash equilibrium. Unfortunately, the dynamics generated by the learning process can be very intricate and instances of training failure hard to interpret. In this paper we show that, in a strong sense, this dynamic complexity is inherent to games. Specifically, we prove that replicator dynamics, the continuous-time analogue of Multiplicative Weights Update, even when applied in a very restricted class of games -- known as finite matrix games -- is rich enough to be able to approximate arbitrary dynamical systems. Our results are positive in the sense that they show the nearly boundless dynamic modelling capabilities of current machine learning practices, but also negative in implying that these capabilities may come at the cost of interpretability. As a concrete example, we show how replicator dynamics can effectively reproduce the well-known strange attractor of Lonrenz dynamics (the "butterfly effect") while achieving no regret.


title: Insight into liquid polymorphism from the complex phase behaviour of a simple model

abstract: We systematically explored the phase behavior of the hard-core two-scale ramp model suggested by Jagla[E. A. Jagla, Phys. Rev. E 63, 061501 (2001)] using a combination of the nested sampling and free energy methods. The sampling revealed that the phase diagram of the Jagla potential is significantly richer than previously anticipated, and we identified a family of new crystalline structures, which is stable over vast regions in the phase diagram. We showed that the new melting line is located at considerably higher temperature than the boundary between the low- and high-density liquid phases, which was previously suggested to lie in a thermodynamically stable region. The newly identified crystalline phases show unexpectedly complex structural features, some of which are shared with the high-pressure ice VI phase.


title: Multilevel quasi-Monte Carlo for random elliptic eigenvalue problems II: Efficient algorithms and numerical results

abstract: Stochastic PDE eigenvalue problems often arise in the field of uncertainty quantification, whereby one seeks to quantify the uncertainty in an eigenvalue, or its eigenfunction. In this paper we present an efficient multilevel quasi-Monte Carlo (MLQMC) algorithm for computing the expectation of the smallest eigenvalue of an elliptic eigenvalue problem with stochastic coefficients. Each sample evaluation requires the solution of a PDE eigenvalue problem, and so tackling this problem in practice is notoriously computationally difficult. We speed up the approximation of this expectation in four ways: we use a multilevel variance reduction scheme to spread the work over a hierarchy of FE meshes and truncation dimensions; we use QMC methods to efficiently compute the expectations on each level; we exploit the smoothness in parameter space and reuse the eigenvector from a nearby QMC point to reduce the number of iterations of the eigensolver; and we utilise a two-grid discretisation scheme to obtain the eigenvalue on the fine mesh with a single linear solve. The full error analysis of a basic MLQMC algorithm is given in the companion paper [Gilbert and Scheichl, 2022], and so in this paper we focus on how to further improve the efficiency and provide theoretical justification for using nearby QMC points and two-grid methods. Numerical results are presented that show the efficiency of our algorithm, and also show that the four strategies we employ are complementary.


title: The curvature-induced gauge potential and the geometric momentum for a particle on a hypersphere

abstract: A particle that is constrained to freely move on a hyperspherical surface in an $N\left( \geq 2\right) $ dimensional flat space experiences a curvature-induced gauge potential, whose form was given long ago (J. Math. Phys. \textbf{34}(1993)2827). We demonstrate that the momentum for the particle on the hypersphere is the geometric one including the gauge potential and its components obey the commutation relations $\left[ p_{i},p_{j}\right] =-i\hbar J_{ij}/r^{2}$, in which $\hbar $ is the Planck's constant, and $p_{i}$ ($i,j=1,2,3,...N$) denotes the $i-$th component of the geometric momentum, and $J_{ij}$ specifies the $ij-$th component of the generalized\textit{\ angular momentum} containing both the orbital part and the coupling of the generators of continuous rotational symmetry group $% SO(N-1)$ and curvature, and $r$ denotes the radius of the $N-1$ dimensional hypersphere.


title: A General Method to Find Highly Coordinating Communities in Social Media through Inferred Interaction Links

abstract: Political misinformation, astroturfing and organised trolling are online malicious behaviours with significant real-world effects. Many previous approaches examining these phenomena have focused on broad campaigns rather than the small groups responsible for instigating or sustaining them. To reveal latent (i.e., hidden) networks of cooperating accounts, we propose a novel temporal window approach that relies on account interactions and metadata alone. It detects groups of accounts engaging in various behaviours that, in concert, come to execute different goal-based strategies, a number of which we describe. The approach relies upon a pipeline that extracts relevant elements from social media posts, infers connections between accounts based on criteria matching the coordination strategies to build an undirected weighted network of accounts, which is then mined for communities exhibiting high levels of evidence of coordination using a novel community extraction method. We address the temporal aspect of the data by using a windowing mechanism, which may be suitable for near real-time application. We further highlight consistent coordination with a sliding frame across multiple windows and application of a decay factor. Our approach is compared with other recent similar processing approaches and community detection methods and is validated against two relevant datasets with ground truth data, using content, temporal, and network analyses, as well as with the design, training and application of three one-class classifiers built using the ground truth; its utility is furthermore demonstrated in two case studies of contentious online discussions.


title: Time fractional parabolic equations with measurable coefficients and embeddings for fractional parabolic Sobolev spaces

abstract: We consider time fractional parabolic equations in both divergence and non-divergence form when the leading coefficients $a^{ij}$ are measurable functions of $(t,x_1)$ except for $a^{11}$ which is a measurable function of either $t$ or $x_1$. We obtain the solvability in Sobolev spaces of the equations in the whole space, on a half space, or on a partially bounded domain. The proofs use a level set argument, a scaling argument, and embeddings in fractional parabolic Sobolev spaces for which we give a direct and elementary proof.


title: Efficient Encrypted Inference on Ensembles of Decision Trees

abstract: Data privacy concerns often prevent the use of cloud-based machine learning services for sensitive personal data. While homomorphic encryption (HE) offers a potential solution by enabling computations on encrypted data, the challenge is to obtain accurate machine learning models that work within the multiplicative depth constraints of a leveled HE scheme. Existing approaches for encrypted inference either make ad-hoc simplifications to a pre-trained model (e.g., replace hard comparisons in a decision tree with soft comparators) at the cost of accuracy or directly train a new depth-constrained model using the original training set. In this work, we propose a framework to transfer knowledge extracted by complex decision tree ensembles to shallow neural networks (referred to as DTNets) that are highly conducive to encrypted inference. Our approach minimizes the accuracy loss by searching for the best DTNet architecture that operates within the given depth constraints and training this DTNet using only synthetic data sampled from the training data distribution. Extensive experiments on real-world datasets demonstrate that these characteristics are critical in ensuring that DTNet accuracy approaches that of the original tree ensemble. Our system is highly scalable and can perform efficient inference on batched encrypted (134 bits of security) data with amortized time in milliseconds. This is approximately three orders of magnitude faster than the standard approach of applying soft comparison at the internal nodes of the ensemble trees.


title: Learning to Schedule DAG Tasks

abstract: Scheduling computational tasks represented by directed acyclic graphs (DAGs) is challenging because of its complexity. Conventional scheduling algorithms rely heavily on simple heuristics such as shortest job first (SJF) and critical path (CP), and are often lacking in scheduling quality. In this paper, we present a novel learning-based approach to scheduling DAG tasks. The algorithm employs a reinforcement learning agent to iteratively add directed edges to the DAG, one at a time, to enforce ordering (i.e., priorities of execution and resource allocation) of "tricky" job nodes. By doing so, the original DAG scheduling problem is dramatically reduced to a much simpler proxy problem, on which heuristic scheduling algorithms such as SJF and CP can be efficiently improved. Our approach can be easily applied to any existing heuristic scheduling algorithms. On the benchmark dataset of TPC-H, we show that our learning based approach can significantly improve over popular heuristic algorithms and consistently achieves the best performance among several methods under a variety of settings.


title: Routing algorithms as tools for integrating social distancing with emergency evacuation

abstract: One of the lessons from the COVID-19 pandemic is the importance of social distancing, even in challenging circumstances such as pre-hurricane evacuation. To explore the implications of integrating social distancing with evacuation operations, we describe this evacuation process as a Capacitated Vehicle Routing Problem (CVRP) and solve it using a DNN (Deep Neural Network)-based solution (Deep Reinforcement Learning) and a non-DNN solution (Sweep Algorithm). A central question is whether Deep Reinforcement Learning provides sufficient extra routing efficiency to accommodate increased social distancing in a time-constrained evacuation operation. We found that, in comparison to the Sweep Algorithm, Deep Reinforcement Learning can provide decision-makers with more efficient routing. However, the evacuation time saved by Deep Reinforcement Learning does not come close to compensating for the extra time required for social distancing, and its advantage disappears as the emergency vehicle capacity approaches the number of people per household.


title: Unified Robust Training for Graph NeuralNetworks against Label Noise

abstract: Graph neural networks (GNNs) have achieved state-of-the-art performance for node classification on graphs. The vast majority of existing works assume that genuine node labels are always provided for training. However, there has been very little research effort on how to improve the robustness of GNNs in the presence of label noise. Learning with label noise has been primarily studied in the context of image classification, but these techniques cannot be directly applied to graph-structured data, due to two major challenges -- label sparsity and label dependency -- faced by learning on graphs. In this paper, we propose a new framework, UnionNET, for learning with noisy labels on graphs under a semi-supervised setting. Our approach provides a unified solution for robustly training GNNs and performing label correction simultaneously. The key idea is to perform label aggregation to estimate node-level class probability distributions, which are used to guide sample reweighting and label correction. Compared with existing works, UnionNET has two appealing advantages. First, it requires no extra clean supervision, or explicit estimation of the noise transition matrix. Second, a unified learning framework is proposed to robustly train GNNs in an end-to-end manner. Experimental results show that our proposed approach: (1) is effective in improving model robustness against different types and levels of label noise; (2) yields significant improvements over state-of-the-art baselines.


title: Fermi-LAT Detection of GeV Gamma-Ray Emission from The Highly Asymmetric Shell Supernova Remnant: SNR G317.3-0.2

abstract: In this paper, we report the first extended GeV $\gamma$-ray emission, at a significant level of $\sim$ 8.13$\sigma$, from the region of the supernova remnant (SNR) SNR G317.3-0.2 by analyzing $\sim$ 12.2 years of Fermi Large Area Telescope (Fermi-LAT) Pass 8 data in the work. The best-fit position of the new $\gamma$-ray source matches that of the 843 MHz radio energy band of SNR G317.3-0.2, and there is no significant variability of the photon flux of the corresponding light curve (LC) in the data for the 12.2 year period; therefore, by excluding other known $\gamma$-ray sources or candidates within a 2$\sigma$ error radius from the best-fit position of SNR G317.3-0.2, we suggest that the $\gamma$-ray source is likely to be a GeV counterpart of SNR G317.3-0.2.


title: Efficient Four-Component Dirac-Coulomb-Gaunt Hartree--Fock in Pauli Spinor Representation

abstract: Four-component Dirac Hartree--Fock is an accurate mean-field method for treating molecular systems where relativistic effects are important. However, the computational cost and complexity of the two-electron interaction makes this method less common, even though we can consider the Dirac Hartree--Fock Hamiltonian the "ground truth" of electronic structure, barring explicit quantum-electrodynamical effects. Being able to calculate these effects is then vital to the design of lower scaling methods for accurate predictions in computational spectroscopy and properties of heavy element complexes that must include relativistic effects for even qualitative accuracy. In this work, we present a Pauli quaternion formalism of maximal component- and spin-separation for computing the Dirac-Coulomb-Gaunt Hartree--Fock ground state, with a minimal floating-point-operation count algorithm. This approach also allows one to explicitly separate different spin physics from the two-body interactions, such as spin-free, spin-orbit, and the spin-spin contributions. Additionally, we use this formalism to examine relativistic trends in the periodic table, and analyze the basis set dependence of atomic gold and gold dimer systems.


title: Measuring Model Biases in the Absence of Ground Truth

abstract: The measurement of bias in machine learning often focuses on model performance across identity subgroups (such as man and woman) with respect to groundtruth labels. However, these methods do not directly measure the associations that a model may have learned, for example between labels and identity subgroups. Further, measuring a model's bias requires a fully annotated evaluation dataset which may not be easily available in practice. We present an elegant mathematical solution that tackles both issues simultaneously, using image classification as a working example. By treating a classification model's predictions for a given image as a set of labels analogous to a bag of words, we rank the biases that a model has learned with respect to different identity labels. We use (man, woman) as a concrete example of an identity label set (although this set need not be binary), and present rankings for the labels that are most biased towards one identity or the other. We demonstrate how the statistical properties of different association metrics can lead to different rankings of the most "gender biased" labels, and conclude that normalized pointwise mutual information (nPMI) is most useful in practice. Finally, we announce an open-sourced nPMI visualization tool using TensorBoard.


title: Stable matching: an integer programming approach

abstract: This paper develops an integer programming approach to two-sided many-to-one matching by investigating stable integral matchings of a fictitious market where each worker is divisible. We show that stable matchings exist in a discrete matching market when firms' preference profile satisfies a total unimodularity condition that is compatible with various forms of complementarities. We provide a class of firms' preference profiles that satisfy this condition.


title: Direct observation of photon bunching in thermal light in quantum Fourier transform spectroscopy

abstract: In quantum mechanics, photons are bosons -- there is no restriction on the number of them that occupy the same quantum state, so many of them can bunch together, and this is well known as photon bunching effect. However, photon bunching and multiphoton interference of bunched photons have never been directly observed from a broadband thermal chaotic light source. Nevertheless, it has been known that the interference intensity of a number N of bunched photons oscillates with a wavelength of N times shorter than the wavelength of the constituent single photons, which should be observable in Fourier transform spectroscopy. A quantum Fourier transform spectrometer was made based on a Michelson interferometer and a diffraction spectrometer to observe the photon bunching from multiphoton interference of the bunched photons in thermal light. The results demonstrates 2 to 12 bunched photons were observed simultaneously from thousands of wavelengths in the light of a tungsten halogen lamp. The experiment discloses some interesting properties of the bunched photons. The results will provide new insights for advancing the theories of quantum optics, and the new technology opens the way for new precise measurement of photon bunching and multiphoton interference of bunched photons that are in all kinds of light sources or that are generated with quantum entangled photons.


title: Scanning force sensing at $\mu$m-distances from a conductive surface with nanospheres in an optical lattice

abstract: The center-of-mass motion of optically trapped dielectric nanoparticles in vacuum is extremely well-decoupled from its environment, making a powerful tool for measurements of feeble sub-attonewton forces. We demonstrate a method to trap and manuever nanoparticles in an optical standing wave potential formed by retro-reflecting a laser beam from a metallic mirror surface. We can reliably position a $\sim 170$ nm diameter silica nanoparticle at distances of a few hundred nanometers to tens of microns from the surface of a gold-coated silicon mirror by transferring it from a single-beam tweezer trap into the standing wave potential. We can further scan the two dimensional space parallel to the mirror surface by using a piezo-driven mirror. This method enables three-dimensional scanning force sensing near surfaces using optically trapped nanoparticles, promising for high-sensitivity scanning force microscopy, tests of the Casimir effect, and tests of the gravitational inverse square law at micron scales.


title: Laser Compression via fast-extending plasma gratings

abstract: It is proposed a new method of compressing laser pulse by fast extending plasma gratings(FEPG), which is created by ionizing the hypersound wave generated by stimulated Brillouin scattering(SBS) in the background gas. Ionized by a short laser pulse, the phonon forms a light-velocity FEPG to fully reflect a resonant pump laser. As the reflecting surface moves with a light velocity, the reflected pulse is temporally overlapped and compressed. This regime is supported by the simulation results of a fully kinetic particle-in-cell(PIC) code Opic with a laser wavelength of 1um, displaying a pump pulse is compressed from 13ps to a few cycles(7.2fs), with an efficiency close to 80%. It is a promising method to produce critical laser powers due to several features: high efficiency without a linear stage, robustness to plasma instabilities, no seed and a wide range of pump intensity.


title: Compact pneumatic clutch with integrated stiffness variation and position feedback

abstract: Stiffness variation and real-time position feedback are critical for any robotic system but most importantly for active and wearable devices to interact with the user and environment. Currently, for compact sizes, there is a lack of solutions bringing high-fidelity feedback and maintaining design and functional integrity. In this work, we propose a novel minimal clutch with integrated stiffness variation and real-time position feedback whose performance surpasses conventional jamming solutions. We introduce integrated design, modeling, and verification of the clutch in detail. Preliminary experimental results show the change in impedance force of the clutch is close to 24-fold at the maximum force density of 15.64 N/cm2. We validated the clutch experimentally in (1) enhancing the bending stiffness of a soft actuator to increase a soft manipulator's gripping force by 73%; (2) enabling a soft cylindrical actuator to execute omnidirectional movement; (3) providing real-time position feedback for hand posture detection and impedance force for kinesthetic haptic feedback. This manuscript presents the functional components with a focus on the integrated design methodology, which will have an impact on the development of soft robots and wearable devices.


title: Constrained Contrastive Distribution Learning for Unsupervised Anomaly Detection and Localisation in Medical Images

abstract: Unsupervised anomaly detection (UAD) learns one-class classifiers exclusively with normal (i.e., healthy) images to detect any abnormal (i.e., unhealthy) samples that do not conform to the expected normal patterns. UAD has two main advantages over its fully supervised counterpart. Firstly, it is able to directly leverage large datasets available from health screening programs that contain mostly normal image samples, avoiding the costly manual labelling of abnormal samples and the subsequent issues involved in training with extremely class-imbalanced data. Further, UAD approaches can potentially detect and localise any type of lesions that deviate from the normal patterns. One significant challenge faced by UAD methods is how to learn effective low-dimensional image representations to detect and localise subtle abnormalities, generally consisting of small lesions. To address this challenge, we propose a novel self-supervised representation learning method, called Constrained Contrastive Distribution learning for anomaly detection (CCD), which learns fine-grained feature representations by simultaneously predicting the distribution of augmented data and image contexts using contrastive learning with pretext constraints. The learned representations can be leveraged to train more anomaly-sensitive detection models. Extensive experiment results show that our method outperforms current state-of-the-art UAD approaches on three different colonoscopy and fundus screening datasets. Our code is available at https://github.com/tianyu0207/CCD.


title: Exploring the effect of streamed social media data variations on social network analysis

abstract: To study the effects of Online Social Network (OSN) activity on real-world offline events, researchers need access to OSN data, the reliability of which has particular implications for social network analysis. This relates not only to the completeness of any collected dataset, but also to constructing meaningful social and information networks from them. In this multidisciplinary study, we consider the question of constructing traditional social networks from OSN data and then present several measurement case studies showing how variations in collected OSN data affects social network analyses. To this end we developed a systematic com parison methodology, which we applied to five pairs of parallel datasets collected from Twitter in four case studies. We found considerable differences in several of the datasets collected with different tools and that these variations significantly alter the results of subsequent analyses. Our results lead to a set of guidelines for researchers planning to collect online data streams to infer social networks.


title: Miscibility and stability of dipolar bosonic mixtures

abstract: Combining two Bose-Einstein condensates (BECs) may result in a miscible or immiscible mixture, or even a violent implosion. We theoretically demonstrate that dipolar two-component BECs produce far richer physics than their nondipolar counterparts. Intriguingly, when both components have equivalent dipoles, the transition to immiscibility is largely unaffected by dipolar physics, yet the dipoles maximally affect stability. Conversely, antiparallel dipoles strongly affect miscibility but have little effect on stability. By performing three-dimensional calculations of the ground states and their excitations, we find strong dependencies on the confinement geometry. We explore and elucidate the various phononic and rotonic phase transitions, as well as symmetry preserving crossovers.


title: Target Localization using Bistatic and Multistatic Radar with 5G NR Waveform

abstract: Joint communication and sensing allows the utilization of common spectral resources for communication and localization, reducing the cost of deployment. By using fifth generation (5G) New Radio (NR) (i.e., the 3rd Generation Partnership Project Radio Access Network for 5G) reference signals, conventionally used for communication, this paper shows sub-meter precision localization is possible at millimeter wave frequencies. We derive the geometric dilution of precision of a bistatic radar configuration, a theoretical metric that characterizes how the target location estimation error varies as a function of the bistatic geometry and measurement errors. We develop a 5G NR compliant software test bench to characterize the measurement errors when estimating the time difference of arrival and angle of arrival with 5G NR waveforms. The test bench is further utilized to demonstrate the accuracy of target localization and velocity estimation in several indoor and outdoor bistatic and multistatic configurations and to show that on average, the bistatic configuration can achieve a location accuracy of 10.0 cm over a bistatic range of 25 m, which can be further improved by deploying a multistatic radar configuration.


title: Quantum Non-demolition Measurements in the Relativistic Dirac Oscillator

abstract: We investigate the feasibility of performing quantum non-demolition (QND) measurements in relativistic quantum systems, using the one-dimensional Dirac oscillator as a specific example. We derive general expressions for its QND observables and find that they are intricate combinations of the position, momentum, and spin operators, which makes them challenging to realize experimentally in general. However, the situation is considerably simplified in both the weakly and strongly relativistic limits, where their experimental realization will be possible.


title: Self-compression of stimulated Raman backscattering by flying focus

abstract: A novel regime of self-compression is proposed for plasma-based backward Raman amplification(BRA) upon flying focus. By using a pumping focus moving with a speed equal to the group velocity of stimulated Raman backscattering(SRBS), only a short part of SRBS which does always synchronize with the flying focus can be amplified. Due to the asymmetrical amplification, the pulse can be directly compressed in the linear stage of BRA. Therefore, instead of a short pulse, the Raman spontaneous or a long pulse can seed the BRA amplifiers. The regime is supported by the 2D particle-in-cell(PIC) simulation without a seed, presenting that the pump pulse is compressed from 26ps to 116fs, with an output amplitude comparable with the case of a well-synchronized short seed. This method provides a significant way to simplify the Raman amplifiers and overcome the issue of synchronization jitter between the pump and the seed.


title: Human-Understandable Decision Making for Visual Recognition

abstract: The widespread use of deep neural networks has achieved substantial success in many tasks. However, there still exists a huge gap between the operating mechanism of deep learning models and human-understandable decision making, so that humans cannot fully trust the predictions made by these models. To date, little work has been done on how to align the behaviors of deep learning models with human perception in order to train a human-understandable model. To fill this gap, we propose a new framework to train a deep neural network by incorporating the prior of human perception into the model learning process. Our proposed model mimics the process of perceiving conceptual parts from images and assessing their relative contributions towards the final recognition. The effectiveness of our proposed model is evaluated on two classical visual recognition tasks. The experimental results and analysis confirm our model is able to provide interpretable explanations for its predictions, but also maintain competitive recognition accuracy.


title: A minimal reaction-diffusion neural model generates $\textit{C. elegans}$ undulation

abstract: The small (1 mm) nematode $\textit{Caenorhabditis elegans}$ (Corsi [1], wormbook.org) has become widely used as a model organism; in particular, the $\textit{C. elegans}$ connectome has been completely mapped, and $\textit{C. elegans}$ locomotion has been widely studied. We describe a minimal reaction-diffusion model for the locomotion of $\textit{C. elegans}$, using as a framework a simplified, stylized "descending pathway" of neurons as central pattern generator (CPG) (Xu et al., Proceedings of the National Academy of Sciences 115, 2018). Finally, we realize a model of the required oscillations and coupling with a network of coupled Keener (IEEE Transactions on Systems, Man, and Cybernetics SMC-13, 1983 [3]) analog neurons. Note that Olivares et al. (BioRxiv 710566, 2020 [4]) present a likely more realistic model more distributed CPG. We use the simpler simulation to show that a small network of FitzHugh-Nagumo neurons (one of the simplest neuronal models) can generate key features of $\textit{C. elegans}$ undulation, and thus locomotion, yielding a minimal, biomimetic model as a building block for further exploring $\textit{C. elegans}$ locomotion.


title: High Altitude Platform Stations (HAPS): Architecture and System Performance

abstract: High Altitude Platform Station (HAPS) has the potential to provide global wireless connectivity and data services such as high-speed wireless backhaul, industrial Internet of things (IoT), and public safety for large areas not served by terrestrial networks. A unified HAPS design is desired to support various use cases and a wide range of requirements. In this paper, we present two architecture designs of the HAPS system: i) repeater based HAPS, and ii) base station based HAPS, which are both viable technical solutions. The energy efficiency is analyzed and compared between the two architectures using consumption factor theory. The system performance of these two architectures is evaluated through Monte Carlo simulations and is characterized in metrics of spectral efficiency using LTE band 1 for both single-cell and multi-cell cases. Both designs can provide good downlink spectral efficiency and coverage, while the uplink coverage is significantly limited by UE transmit power and antenna gain. Using directional antennas at the UEs can improve the system performance for both downlink and uplink.


title: Network Consensus with Privacy: A Secret Sharing Method

abstract: In this work, inspired by secret sharing schemes, we introduce a privacy-preserving approach for network consensus, by which all nodes in a network can reach an agreement on their states without exposing the individual state to neighbors. With the privacy degree defined for the agents, the proposed method makes the network resistant to the collusion of any given number of neighbors, and protects the consensus procedure from communication eavesdropping. Unlike existing works, the proposed privacy-preserving algorithm is resilient to node failures. When a node fails, the method offers the possibility of rebuilding the lost node via the information kept in its neighbors, even though none of the neighbors knows the exact state of the failing node. Moreover, it is shown that the proposed method can achieve consensus and average consensus almost surely, when the agents have arbitrary privacy degrees and a common privacy degree, respectively. To illustrate the theory, two numerical examples are presented.


title: Goal-Oriented Gaze Estimation for Zero-Shot Learning

abstract: Zero-shot learning (ZSL) aims to recognize novel classes by transferring semantic knowledge from seen classes to unseen classes. Since semantic knowledge is built on attributes shared between different classes, which are highly local, strong prior for localization of object attribute is beneficial for visual-semantic embedding. Interestingly, when recognizing unseen images, human would also automatically gaze at regions with certain semantic clue. Therefore, we introduce a novel goal-oriented gaze estimation module (GEM) to improve the discriminative attribute localization based on the class-level attributes for ZSL. We aim to predict the actual human gaze location to get the visual attention regions for recognizing a novel object guided by attribute description. Specifically, the task-dependent attention is learned with the goal-oriented GEM, and the global image features are simultaneously optimized with the regression of local attribute features. Experiments on three ZSL benchmarks, i.e., CUB, SUN and AWA2, show the superiority or competitiveness of our proposed method against the state-of-the-art ZSL methods. The ablation analysis on real gaze data CUB-VWSW also validates the benefits and accuracy of our gaze estimation module. This work implies the promising benefits of collecting human gaze dataset and automatic gaze estimation algorithms on high-level computer vision tasks. The code is available at https://github.com/osierboy/GEM-ZSL.


title: Performance Impact Analysis of Beam Switching in Millimeter Wave Vehicular Communications

abstract: Millimeter wave wireless spectrum deployments will allow vehicular communications to share high data rate vehicular sensor data in real-time. The highly directional nature of wireless links in millimeter spectral bands will require continuous channel measurements to ensure the transmitter (TX) and receiver (RX) beams are aligned to provide the best channel. Using real-world vehicular mmWave measurement data at 28 GHz, we determine the optimal beam sweeping period, i.e. the frequency of the channel measurements, to align the RX beams to the best channel directions for maximizing the vehicle-to-infrastructure (V2I) throughput. We show that in a realistic vehicular traffic environment in Austin, TX, for a vehicle traveling at an average speed of 10.5 mph, a beam sweeping period of 300 ms in future V2I communication standards would maximize the V2I throughput, using a system of four RX phased arrays that scanned the channel 360 degrees in the azimuth and 30 degrees above and below the boresight. We also investigate the impact of the number of active RX chains controlling the steerable phased arrays on V2I throughput. Reducing the number of RX chains controlling the phased arrays helps reduce the cost of the vehicular mmWave hardware while multiple RX chains, although more expensive, provide more robustness to beam direction changes at the vehicle, allowing near maximum throughput over a wide range of beam sweep periods. We show that the overhead of utilizing one RX chain instead of four leads to a 10% drop in mean V2I throughput over six non-line-of-sight runs in real traffic conditions, with each run being 10 to 20 seconds long over a distance of 40 to 90 meters.


title: Implicit Integration of Superpixel Segmentation into Fully Convolutional Networks

abstract: Superpixels are a useful representation to reduce the complexity of image data. However, to combine superpixels with convolutional neural networks (CNNs) in an end-to-end fashion, one requires extra models to generate superpixels and special operations such as graph convolution. In this paper, we propose a way to implicitly integrate a superpixel scheme into CNNs, which makes it easy to use superpixels with CNNs in an end-to-end fashion. Our proposed method hierarchically groups pixels at downsampling layers and generates superpixels. Our method can be plugged into many existing architectures without a change in their feed-forward path because our method does not use superpixels in the feed-forward path but use them to recover the lost resolution instead of bilinear upsampling. As a result, our method preserves detailed information such as object boundaries in the form of superpixels even when the model contains downsampling layers. We evaluate our method on several tasks such as semantic segmentation, superpixel segmentation, and monocular depth estimation, and confirm that it speeds up modern architectures and/or improves their prediction accuracy in these tasks.


title: MD-MTL: An Ensemble Med-Multi-Task Learning Package for DiseaseScores Prediction and Multi-Level Risk Factor Analysis

abstract: While many machine learning methods have been used for medical prediction and risk factor analysis on healthcare data, most prior research has involved single-task learning (STL) methods. However, healthcare research often involves multiple related tasks. For instance, implementation of disease scores prediction and risk factor analysis in multiple subgroups of patients simultaneously and risk factor analysis at multi-levels synchronously. In this paper, we developed a new ensemble machine learning Python package based on multi-task learning (MTL), referred to as the Med-Multi-Task Learning (MD-MTL) package and applied it in predicting disease scores of patients, and in carrying out risk factor analysis on multiple subgroups of patients simultaneously. Our experimental results on two datasets demonstrate the utility of the MD-MTL package, and show the advantage of MTL (vs. STL), when analyzing data that is organized into different categories (tasks, which can be various age groups, different levels of disease severity, etc.).


title: Estimation of Partially Conditional Average Treatment Effect by Hybrid Kernel-covariate Balancing

abstract: We study nonparametric estimation for the partially conditional average treatment effect, defined as the treatment effect function over an interested subset of confounders. We propose a hybrid kernel weighting estimator where the weights aim to control the balancing error of any function of the confounders from a reproducing kernel Hilbert space after kernel smoothing over the subset of interested variables. In addition, we present an augmented version of our estimator which can incorporate estimations of outcome mean functions. Based on the representer theorem, gradient-based algorithms can be applied for solving the corresponding infinite-dimensional optimization problem. Asymptotic properties are studied without any smoothness assumptions for propensity score function or the need of data splitting, relaxing certain existing stringent assumptions. The numerical performance of the proposed estimator is demonstrated by a simulation study and an application to the effect of a mother's smoking on a baby's birth weight conditioned on the mother's age.


title: Towards Evaluating the Robustness of Deep Diagnostic Models by Adversarial Attack

abstract: Deep learning models (with neural networks) have been widely used in challenging tasks such as computer-aided disease diagnosis based on medical images. Recent studies have shown deep diagnostic models may not be robust in the inference process and may pose severe security concerns in clinical practice. Among all the factors that make the model not robust, the most serious one is adversarial examples. The so-called "adversarial example" is a well-designed perturbation that is not easily perceived by humans but results in a false output of deep diagnostic models with high confidence. In this paper, we evaluate the robustness of deep diagnostic models by adversarial attack. Specifically, we have performed two types of adversarial attacks to three deep diagnostic models in both single-label and multi-label classification tasks, and found that these models are not reliable when attacked by adversarial example. We have further explored how adversarial examples attack the models, by analyzing their quantitative classification results, intermediate features, discriminability of features and correlation of estimated labels for both original/clean images and those adversarial ones. We have also designed two new defense methods to handle adversarial examples in deep diagnostic models, i.e., Multi-Perturbations Adversarial Training (MPAdvT) and Misclassification-Aware Adversarial Training (MAAdvT). The experimental results have shown that the use of defense methods can significantly improve the robustness of deep diagnostic models against adversarial attacks.


title: Intersective Polynomials Arising from Sums of Powers

abstract: Given a natural number $n \geq 2$, an integer $k$ and for a judiciously chosen $l = l(n)$ we give necessary and sufficient conditions for the polynomial $f_{n,k} = \big( \sum_{i=1}^{l} x_{i}^{n} \big) - k$ to have roots modulo every positive integer.


title: The Constraint of H0from Galaxy clusters and Hubble parameter data

abstract: Using comoving distance $d_c$ and angular diameter distance $d_A$, we recalculate parameters describing kinematical state of the universe, still combining the kinematical model of universe but not relying on dynamical equations for gravity. Comoving distance $d_c$ comes from Hubble data H(z) and is more reliable. Angular diameter distance $d_A$ comes from SZE (Sunyaev-Zel dovich Effect) and X-ray data, and needs calibration. In low redshift case, we use expansion of relation between luminosity distance and redshift about redshift $z$; in high redshift case, we take variable substitution $y=1/(1+z)$, and expand the relation between luminosity distance and redshift about variable $y$ in order to reduce computational errors. Finally we get the more precise value of Hubble parameter $H_0=69.13\pm 0.24{\kern 1pt} km{\kern 1pt} \cdot {s^{ - 1}} \cdot Mp{c^{ - 1}}$, corresponding to 0.4\% uncertainty in $68.3\%$ confidence region, also deceleration factor $q_0=-0.57\pm0.04 $ and acceleration rate $j_0=1.28\pm0.33$, and their statistical values and probability graph. We compare the values of ${H_0}$, ${q_0}$, ${j_0}$ with those obtained from other observation data and model.


title: Implications of the Environments of Radio-detected AGN in a Complex Protostructure at z$\sim$3.3

abstract: Radio Active Galactic Nuclei (RAGNs) are mainly found in dense structures (i.e., clusters/groups) at redshifts of z$<$2 and are commonly used to detect protoclusters at higher redshift. Here, we attempt to study the host and environmental properties of two relatively faint ($\mathrm L_\mathrm{1.4GHz} \sim10^{25}$ W Hz$^{-1}$) RAGNs in a known protocluster at z=3.3 in the PCl J0227-0421 field, detected using the latest radio observation obtained as part of the Observations of Redshift Evolution in Large-Scale Environments (ORELSE) Survey. Using new spectroscopic observations obtained from Keck/MOSFIRE as part of the Charting Cluster Construction with the VIMOS Ultra-Deep Survey (VUDS) and ORELSE (C3VO) survey and previous spectroscopic data obtained as part of the VIMOS-VLT Deep Survey (VVDS) and VUDS, we revise the three-dimensional overdensity field around this protocluster. The protocluster is embedded in a large scale overdensity protostructure. This protostructure has an estimated total mass of $\sim$2.6$\times10^{15} M_\odot$ and contains several overdensity peaks. Both RAGNs are hosted by very bright and massive galaxies, while their hosts show extreme differences color, indicating that they have different ages and are in different evolutionary stages. Furthermore, we find that they are not in the most locally dense parts of the protostructure, but are fairly close to the centers of their parent overdensity peaks. We propose a scenario where merging might already have happened in both cases, which lowered the local density of their surrounding area and boosted their stellar mass. This work is the first time that two RAGNs at low luminosity have been found and studied within a high redshift protostructure.


title: Sector coupling via hydrogen to lower the cost of energy system decarbonization

abstract: There is growing interest in hydrogen (H$_2$) use for long-duration energy storage in a future electric grid dominated by variable renewable energy (VRE) resources. Modelling the role of H$_2$ as grid-scale energy storage, often referred as "power-to-gas-to-power (P2G2P)" overlooks the cost-sharing and emission benefits from using the deployed H$_2$ production and storage assets to also supply H$_2$ for decarbonizing other end-use sectors where direct electrification may be challenged. Here, we develop a generalized modelling framework for co-optimizing energy infrastructure investment and operation across power and transportation sectors and the supply chains of electricity and H$_2$, while accounting for spatio-temporal variations in energy demand and supply. Applying this sector-coupling framework to the U.S. Northeast under a range of technology cost and carbon price scenarios, we find a greater value of power-to-H$_2$ (P2G) versus P2G2P routes. P2G provides flexible demand response, while the extra cost and efficiency penalties of P2G2P routes make the solution less attractive for grid balancing. The effects of sector-coupling are significant, boosting VRE generation by 12-55% with both increased capacities and reduced curtailments and reducing the total system cost (or levelized costs of energy) by 6-14% under 96% decarbonization scenarios. Both the cost savings and emission reductions from sector coupling increase with H$_2$ demand for other end-uses, more than doubling for a 96% decarbonization scenario as H$_2$ demand quadraples. Moreover, we found that the deployment of carbon capture and storage is more cost-effective in the H$_2$ sector because of the lower cost and higher utilization rate. These findings highlight the importance of using an integrated multi-sector energy system framework with multiple energy vectors in planning energy system decarbonization pathways.


title: Lord of the Ring(s): Side Channel Attacks on the CPU On-Chip Ring Interconnect Are Practical

abstract: We introduce the first microarchitectural side channel attacks that leverage contention on the CPU ring interconnect. There are two challenges that make it uniquely difficult to exploit this channel. First, little is known about the ring interconnect's functioning and architecture. Second, information that can be learned by an attacker through ring contention is noisy by nature and has coarse spatial granularity. To address the first challenge, we perform a thorough reverse engineering of the sophisticated protocols that handle communication on the ring interconnect. With this knowledge, we build a cross-core covert channel over the ring interconnect with a capacity of over 4 Mbps from a single thread, the largest to date for a cross-core channel not relying on shared memory. To address the second challenge, we leverage the fine-grained temporal patterns of ring contention to infer a victim program's secrets. We demonstrate our attack by extracting key bits from vulnerable EdDSA and RSA implementations, as well as inferring the precise timing of keystrokes typed by a victim user.


title: Optimization of User Selection and Bandwidth Allocation for Federated Learning in VLC/RF Systems

abstract: Limited radio frequency (RF) resources restrict the number of users that can participate in federated learning (FL) thus affecting FL convergence speed and performance. In this paper, we first introduce visible light communication (VLC) as a supplement to RF in FL and build a hybrid VLC/RF communication system, in which each indoor user can use both VLC and RF to transmit its FL model parameters. Then, the problem of user selection and bandwidth allocation is studied for FL implemented over a hybrid VLC/RF system aiming to optimize the FL performance. The problem is first separated into two subproblems. The first subproblem is a user selection problem with a given bandwidth allocation, which is solved by a traversal algorithm. The second subproblem is a bandwidth allocation problem with a given user selection, which is solved by a numerical method. The final user selection and bandwidth allocation are obtained by iteratively solving these two subproblems. Simulation results show that the proposed FL algorithm that efficiently uses VLC and RF for FL model transmission can improve the prediction accuracy by up to 10% compared with a conventional FL system using only RF.


title: Density ratio model with data-adaptive basis function

abstract: In many applications, we collect independent samples from interconnected populations. These population distributions share some latent structure, so it is advantageous to jointly analyze the samples. One effective way to connect the distributions is the semiparametric density ratio model (DRM). A key ingredient in the DRM is that the log density ratios are linear combinations of prespecified functions; the vector formed by these functions is called the basis function. A sensible basis function can often be chosen based on knowledge of the context, and DRM-based inference is effective even if the basis function is imperfect. However, a data-adaptive approach to the choice of basis function remains an interesting and important research problem. We propose an approach based on the classical functional principal component analysis (FPCA). Under some conditions, we show that this approach leads to consistent basis function estimation. Our simulation results show that the proposed adaptive choice leads to an efficiency gain. We use a real-data example to demonstrate the efficiency gain and the ease of our approach.


title: Enhanced Aspect-Based Sentiment Analysis Models with Progressive Self-supervised Attention Learning

abstract: In aspect-based sentiment analysis (ABSA), many neural models are equipped with an attention mechanism to quantify the contribution of each context word to sentiment prediction. However, such a mechanism suffers from one drawback: only a few frequent words with sentiment polarities are tended to be taken into consideration for final sentiment decision while abundant infrequent sentiment words are ignored by models. To deal with this issue, we propose a progressive self-supervised attention learning approach for attentional ABSA models. In this approach, we iteratively perform sentiment prediction on all training instances, and continually learn useful attention supervision information in the meantime. During training, at each iteration, context words with the highest impact on sentiment prediction, identified based on their attention weights or gradients, are extracted as words with active/misleading influence on the correct/incorrect prediction for each instance. Words extracted in this way are masked for subsequent iterations. To exploit these extracted words for refining ABSA models, we augment the conventional training objective with a regularization term that encourages ABSA models to not only take full advantage of the extracted active context words but also decrease the weights of those misleading words. We integrate the proposed approach into three state-of-the-art neural ABSA models. Experiment results and in-depth analyses show that our approach yields better attention results and significantly enhances the performance of all three models. We release the source code and trained models at https://github.com/DeepLearnXMU/PSSAttention.


title: User-Centric Cooperative MEC Service Offloading

abstract: Mobile edge computing provides users with a cloud environment close to the edge of the wireless network, supporting the computing intensive applications that have low latency requirements. The combination of offloading with the wireless communication brings new challenges. This paper investigates the service caching problem during the long-term service offloading in the user-centric wireless network. To meet the time-varying service demands of a typical user, a cooperative service caching strategy in the unit of the base station (BS) cluster is proposed. We formulate the caching problem as a time-averaged completion delay minimization problem and transform it into time-decoupled instantaneous problems with a virtual caching cost queue at first. Then we propose a distributed algorithm which is based on the consensus-sharing alternating direction method of multipliers to solve each instantaneous problem. The simulations validate that the proposed online distributed service caching algorithm can achieve the optimal time-averaged completion delay of offloading tasks with the smallest caching cost in the unit of a BS cluster.


title: Syntactic and Semantic-driven Learning for Open Information Extraction

abstract: One of the biggest bottlenecks in building accurate, high coverage neural open IE systems is the need for large labelled corpora. The diversity of open domain corpora and the variety of natural language expressions further exacerbate this problem. In this paper, we propose a syntactic and semantic-driven learning approach, which can learn neural open IE models without any human-labelled data by leveraging syntactic and semantic knowledge as noisier, higher-level supervisions. Specifically, we first employ syntactic patterns as data labelling functions and pretrain a base model using the generated labels. Then we propose a syntactic and semantic-driven reinforcement learning algorithm, which can effectively generalize the base model to open situations with high accuracy. Experimental results show that our approach significantly outperforms the supervised counterparts, and can even achieve competitive performance to supervised state-of-the-art (SoA) model


title: Properties of the Center of Gravity as an Algorithm for Position Measurements: Two-Dimensional Geometry

abstract: The center of gravity as an algorithm for position measurements is analyzed for a two-dimensional geometry. Several mathematical consequences of discretization for various types of detector arrays are extracted. Arrays with rectangular, hexagonal, and triangular detectors are analytically studied, and tools are given to simulate their discretization properties. Special signal distributions free of discretized error are isolated. It is proved that some crosstalk spreads are able to eliminate the center of gravity discretization error for any signal distribution (ideal detectors). Simulations, adapted to the CMS em-calorimeter and to a triangular detector array, are provided for energy and position reconstruction algorithms with a finite number of detectors.


title: DeepFreight: Integrating Deep Reinforcement Learning and Mixed Integer Programming for Multi-transfer Truck Freight Delivery

abstract: With the freight delivery demands and shipping costs increasing rapidly, intelligent control of fleets to enable efficient and cost-conscious solutions becomes an important problem. In this paper, we propose DeepFreight, a model-free deep-reinforcement-learning-based algorithm for multi-transfer freight delivery, which includes two closely-collaborative components: truck-dispatch and package-matching. Specifically, a deep multi-agent reinforcement learning framework called QMIX is leveraged to learn a dispatch policy, with which we can obtain the multi-step joint vehicle dispatch decisions for the fleet with respect to the delivery requests. Then an efficient multi-transfer matching algorithm is executed to assign the delivery requests to the trucks. Also, DeepFreight is integrated with a Mixed-Integer Linear Programming optimizer for further optimization. The evaluation results show that the proposed system is highly scalable and ensures a 100\% delivery success while maintaining low delivery-time and fuel consumption. The codes are available at https://github.com/LucasCJYSDL/DeepFreight.


title: Study Group Learning: Improving Retinal Vessel Segmentation Trained with Noisy Labels

abstract: Retinal vessel segmentation from retinal images is an essential task for developing the computer-aided diagnosis system for retinal diseases. Efforts have been made on high-performance deep learning-based approaches to segment the retinal images in an end-to-end manner. However, the acquisition of retinal vessel images and segmentation labels requires onerous work from professional clinicians, which results in smaller training dataset with incomplete labels. As known, data-driven methods suffer from data insufficiency, and the models will easily over-fit the small-scale training data. Such a situation becomes more severe when the training vessel labels are incomplete or incorrect. In this paper, we propose a Study Group Learning (SGL) scheme to improve the robustness of the model trained on noisy labels. Besides, a learned enhancement map provides better visualization than conventional methods as an auxiliary tool for clinicians. Experiments demonstrate that the proposed method further improves the vessel segmentation performance in DRIVE and CHASE$\_$DB1 datasets, especially when the training labels are noisy.


title: FedDR -- Randomized Douglas-Rachford Splitting Algorithms for Nonconvex Federated Composite Optimization

abstract: We develop two new algorithms, called, FedDR and asyncFedDR, for solving a fundamental nonconvex composite optimization problem in federated learning. Our algorithms rely on a novel combination between a nonconvex Douglas-Rachford splitting method, randomized block-coordinate strategies, and asynchronous implementation. They can also handle convex regularizers. Unlike recent methods in the literature, e.g., FedSplit and FedPD, our algorithms update only a subset of users at each communication round, and possibly in an asynchronous manner, making them more practical. These new algorithms can handle statistical and system heterogeneity, which are the two main challenges in federated learning, while achieving the best known communication complexity. In fact, our new algorithms match the communication complexity lower bound up to a constant factor under standard assumptions. Our numerical experiments illustrate the advantages of our methods over existing algorithms on synthetic and real datasets.


title: Haptic Feedback Improves Human-Robot Agreement and User Satisfaction in Shared-Autonomy Teleoperation

abstract: Shared autonomy teleoperation can guarantee safety, but does so by reducing the human operator's control authority, which can lead to reduced levels of human-robot agreement and user satisfaction. This paper presents a novel haptic shared autonomy teleoperation paradigm that uses haptic feedback to inform the user about the inner state of a shared autonomy paradigm, while still guaranteeing safety. This differs from haptic shared control, which uses haptic feedback to inform the user's actions, but gives the human operator full control over the robot's actions. We conducted a user study in which twelve users flew a simulated UAV in a search-and-rescue task with no assistance or assistance provided by haptic shared control, shared autonomy, or haptic shared autonomy. All assistive teleoperation methods use control barrier functions to find a control command that is both safe and as close as possible to the human-generated control command. For assistive teleoperation conditions with haptic feedback, we apply a force to the user that is proportional to the difference between the human-generated control and the safe control. We find that haptic shared autonomy improves the user's task performance and satisfaction. We also find that haptic feedback in assistive teleoperation can improve the user's situational awareness. Finally, results show that adding haptic feedback to shared-autonomy teleoperation can improve human-robot agreement.


title: Structured Scene Memory for Vision-Language Navigation

abstract: Recently, numerous algorithms have been developed to tackle the problem of vision-language navigation (VLN), i.e., entailing an agent to navigate 3D environments through following linguistic instructions. However, current VLN agents simply store their past experiences/observations as latent states in recurrent networks, failing to capture environment layouts and make long-term planning. To address these limitations, we propose a crucial architecture, called Structured Scene Memory (SSM). It is compartmentalized enough to accurately memorize the percepts during navigation. It also serves as a structured scene representation, which captures and disentangles visual and geometric cues in the environment. SSM has a collect-read controller that adaptively collects information for supporting current decision making and mimics iterative algorithms for long-range reasoning. As SSM provides a complete action space, i.e., all the navigable places on the map, a frontier-exploration based navigation decision making strategy is introduced to enable efficient and global planning. Experiment results on two VLN datasets (i.e., R2R and R4R) show that our method achieves state-of-the-art performance on several metrics.


title: On the Detection of Habitable Trojan Planets in the Kepler Circumbinary Systems

abstract: We present the results of a study of the prospect of detecting habitable Trojan planets in the Kepler Habitable Zone circumbinary planetary systems (Kepler-16, -47, -453, -1647, -1661). We integrated the orbits of 10,000 separate N-body systems (N=4,6), each with a one Earth-mass body in a randomly selected orbit near the L4 and L5 Lagrangian points of the host HZ circumbinary planet. We find that stable Trojan planets are restricted to a narrow range of semimajor axes in all five systems and limited to small eccentricities in Kepler-16, -47, and -1661. To assess the prospect of the detection of these habitable Trojan planets, we calculated the amplitudes of the variations they cause in the transit timing of their host bodies. Results show that the mean amplitudes of the transit timing variations (TTVs) correlate with the mass of the transiting planet and range from 70 minutes for Kepler-16b to 390 minutes for Kepler-47c. Our analysis indicates that the TTVs of the circumbinary planets caused by these Trojan bodies fall within the detectable range of timing precision obtained from the Kepler telescope's long-cadence data. The latter points to Kepler data as a viable source to search for habitable Trojan planets.


title: Piezoelectric quantum spin Hall insulator with Rashba spin splitting in Janus monolayer $\mathrm{SrAlGaSe_4}$

abstract: The realization of multifunctional two-dimensional (2D) materials is fundamentally intriguing, such as combination of piezoelectricity with topological insulating phase or ferromagnetism. In this work, a Janus monolayer $\mathrm{SrAlGaSe_4}$ is built from 2D $\mathrm{MA_2Z_4}$ family with dynamic, mechanical and thermal stabilities, which is piezoelectric due to lacking inversion symmetry. The unstrained $\mathrm{SrAlGaSe_4}$ monolayer is a narrow gap normal insulator (NI) with spin orbital coupling (SOC). However, the NI to topological insulator (TI) phase transition can be induced by the biaxial strain, and a piezoelectric quantum spin Hall insulator (PQSHI) can be achieved. More excitingly, the phase transformation point is only about 1.01 tensile strain, and nontrivial band topology can hold until considered 1.16 tensile strain. Moreover, a Rashba spin splitting in the conduction bands can exit in PQSHI due to the absence of a horizontal mirror symmetry and the presence of SOC. For monolayer $\mathrm{SrAlGaSe_4}$, both in-plane and much weak out-of-plane piezoelectric polarizations can be induced with a uniaxial strain applied. The calculated piezoelectric strain coefficients $d_{11}$ and $d_{31}$ of monolayer $\mathrm{SrAlGaSe_4}$ are -1.865 pm/V and -0.068 pm/V at 1.06 tensile strain as a representative TI. In fact, many PQSHIs can be realized from 2D $\mathrm{MA_2Z_4}$ family. To confirm that, similar to $\mathrm{SrAlGaSe_4}$, the coexistence of piezoelectricity and topological orders can be realized by strain (about 1.04 tensile strain) in the $\mathrm{CaAlGaSe_4}$ monolayer. Our works suggest that Janus monolayer $\mathrm{SrAlGaSe_4}$ is a pure 2D system for PQSHI, enabling future studies exploring the interplay between piezoelectricity and topological orders, which can lead to novel applications in electronics and spintronics.


title: IOT: Instance-wise Layer Reordering for Transformer Structures

abstract: With sequentially stacked self-attention, (optional) encoder-decoder attention, and feed-forward layers, Transformer achieves big success in natural language processing (NLP), and many variants have been proposed. Currently, almost all these models assume that the layer order is fixed and kept the same across data samples. We observe that different data samples actually favor different orders of the layers. Based on this observation, in this work, we break the assumption of the fixed layer order in the Transformer and introduce instance-wise layer reordering into the model structure. Our Instance-wise Ordered Transformer (IOT) can model variant functions by reordered layers, which enables each sample to select the better one to improve the model performance under the constraint of almost the same number of parameters. To achieve this, we introduce a light predictor with negligible parameter and inference cost to decide the most capable and favorable layer order for any input sequence. Experiments on 3 tasks (neural machine translation, abstractive summarization, and code generation) and 9 datasets demonstrate consistent improvements of our method. We further show that our method can also be applied to other architectures beyond Transformer. Our code is released at Github.


title: Toeplitz operators on the Fock space via the Fourier transform

abstract: In sprite by Berger-Coburn theorems and their conjecture in \cite{Coburn1994}, we use the Fourier transform to decompose $ T_{g}$ as an infinite sum of Toeplitz operators with symbols which have compact support in the frequency domain. As a consequence, we obtain a sufficient condition for $ T_{g}$ to be bounded in terms of the Carleson measure conditions defined by the heat transform of the symbol $g$. Moreover the decomposition of a Toeplitz operator leads us to get easily understanding that for a bounded function $g$, if its Berezin transform vanishes at infinity, then the Toeplitz operator $T_g$ is compact \cite{Eng} and the Toeplitz algebra generated by Toeplitz operators with symbols in $L^{\infty}$ is indeed generated by Toeplitz operators with symbols which on uniformly continuous on ${\mathbb C}^n$ \cite{Bauer2012}.Further, we will apply our decomposition theory for a Toeplitz operator to estimate the Schatten $p$-norm of the product of two Toeplitz operators.


title: Testing for a Random Walk Structure in the Frequency Evolution of a Tone in Noise

abstract: Inference and hypothesis testing are typically constructed on the basis that a specific model holds for the data. To determine the veracity of conclusions drawn from such data analyses, one must be able to identify the presence of the assumed structure within the data. In this paper, a model verification test is developed for the presence of a random walk-like structure in the variations in the frequency of complex-valued sinusoidal signals measured in additive Gaussian noise. This test evaluates the joint inference of the random walk hypothesis tests found in economics literature that seek random walk behaviours in time series data, with an additional test to account for how the random walk behaves in frequency space.


title: Vicinal and categorical domain adaptation

abstract: Unsupervised domain adaptation aims to learn a task classifier that performs well on the unlabeled target domain, by utilizing the labeled source domain. Inspiring results have been acquired by learning domain-invariant deep features via domain-adversarial training. However, its parallel design of task and domain classifiers limits the ability to achieve a finer category-level domain alignment. To promote categorical domain adaptation (CatDA), based on a joint category-domain classifier, we propose novel losses of adversarial training at both domain and category levels. Since the joint classifier can be regarded as a concatenation of individual task classifiers respectively for the two domains, our design principle is to enforce consistency of category predictions between the two task classifiers. Moreover, we propose a concept of vicinal domains whose instances are produced by a convex combination of pairs of instances respectively from the two domains. Intuitively, alignment of the possibly infinite number of vicinal domains enhances that of original domains. We propose novel adversarial losses for vicinal domain adaptation (VicDA) based on CatDA, leading to Vicinal and Categorical Domain Adaptation (ViCatDA). We also propose Target Discriminative Structure Recovery (TDSR) to recover the intrinsic target discrimination damaged by adversarial feature alignment. We also analyze the principles underlying the ability of our key designs to align the joint distributions. Extensive experiments on several benchmark datasets demonstrate that we achieve the new state of the art.


title: A Data-Driven Statistical Description for the Hydrodynamics of Active Matter

abstract: Modeling living systems at the collective scale can be very challenging because the individual constituents can themselves be complex and the respective interactions between the constituents are not fully understood. With the advent of high throughput experiments and in the age of big data, data-driven methods are on the rise to overcome these challenges. To directly uncover the underlying physical principles, we present a data-driven method for obtaining the phase-space density such that the solution to the stochastic dynamic equation for active matter readily emerges, from which time and space dependence of physical order parameters can be readily extracted. If the system is near a steady state, we illuminate how to construct a field theory to subsequently make physical predictions about the system. The method is first developed analytically and subsequently calibrated using simulated data. The method is then applied to an experimental system of particles actively driven by a {\it Serratia marcescens} bacterial swarm and in the presence of spatially localized UV light. The analysis demonstrates that the particles are in the steady-state before and sometime after the UV light and obey a Gaussian field theory with a spatially-varying "mass" in those regimes. This novel, yet simple, finding is surprising given the complex dynamics of the bacterial swarm. In response to the UV light, we demonstrate that there is a net flow of the particles away from the UV light and that the entropy of the particles increases away from the light. We conclude with a discussion of additional potential applications of our data-driven method such as when the internal structure of the individual constituents dynamically changes to result in a modified stochastic dynamic equation governing the system.


title: Forward Stability and Model Path Selection

abstract: Most scientific publications follow the familiar recipe of (i) obtain data, (ii) fit a model, and (iii) comment on the scientific relevance of the effects of particular covariates in that model. This approach, however, ignores the fact that there may exist a multitude of similarly-accurate models in which the implied effects of individual covariates may be vastly different. This problem of finding an entire collection of plausible models has also received relatively little attention in the statistics community, with nearly all of the proposed methodologies being narrowly tailored to a particular model class and/or requiring an exhaustive search over all possible models, making them largely infeasible in the current big data era. This work develops the idea of forward stability and proposes a novel, computationally-efficient approach to finding collections of accurate models we refer to as model path selection (MPS). MPS builds up a plausible model collection via a forward selection approach and is entirely agnostic to the model class and loss function employed. The resulting model collection can be displayed in a simple and intuitive graphical fashion, easily allowing practitioners to visualize whether some covariates can be swapped for others with minimal loss.


title: Mixed methods for the velocity-pressure-pseudostress formulation of the Stokes eigenvalue problem

abstract: In two and three dimensional domains, we analyze mixed finite element methods for a velocity-pressure-pseudostress formulation of the Stokes eigenvalue problem. The methods consist in two schemes: the velocity and pressure are approximated with piecewise polynomial and for the pseudostress we consider two classic families of finite elements for $\mathrm{H}(\mathop{\mathrm{div}})$ spaces: the Raviart-Thomas and the Brezzi-Douglas Marini elements. With the aid of the classic spectral theory for compact operators, we prove that our method does not introduce spurious modes. Also, we obtain convergence and error estimates for the proposed methods. In order to assess the performance of the schemes, we report numerical results to compare the accuracy and robustness between both numerical schemes.


title: Positioning Error Probabilities for Some Forms of Center-of-Gravity Algorithm Calculated with the Cumulative Distributions. Part II

abstract: To complete a previous work, the probability density functions for the errors in the center-of-gravity as positioning algorithm are derived with the usual methods of the cumulative distribution functions. These methods introduce substantial complications compared to the approaches used in a previous publication on similar problems. The combinations of random variables considered are: $X_{g3}=\theta(x_2-x_1) (x_1-x_3)/(x_1+x_2+x_3) + \theta(x_1-x_2)(x_1+2x_4)/(x_1+x_2+x_4)$ and $X_{g4}=(\theta(x_4-x_5)(2x_4+x_1-x_3)/(x_1+x_2+x_3+x_4)+ \theta(x_5-x_4)(x_1-x_3-2x_5)/(x_1+x_2+x_3+x_5)$ The complete and partial forms of the probability density functions of these expressions of the center-of-gravity algorithms are calculated for general probability density functions of the observation noise. The cumulative probability distributions are the essential steps in this study, never calculated elsewhere.


title: Unsupervised Motion Representation Enhanced Network for Action Recognition

abstract: Learning reliable motion representation between consecutive frames, such as optical flow, has proven to have great promotion to video understanding. However, the TV-L1 method, an effective optical flow solver, is time-consuming and expensive in storage for caching the extracted optical flow. To fill the gap, we propose UF-TSN, a novel end-to-end action recognition approach enhanced with an embedded lightweight unsupervised optical flow estimator. UF-TSN estimates motion cues from adjacent frames in a coarse-to-fine manner and focuses on small displacement for each level by extracting pyramid of feature and warping one to the other according to the estimated flow of the last level. Due to the lack of labeled motion for action datasets, we constrain the flow prediction with multi-scale photometric consistency and edge-aware smoothness. Compared with state-of-the-art unsupervised motion representation learning methods, our model achieves better accuracy while maintaining efficiency, which is competitive with some supervised or more complicated approaches.


title: Unintended Effects on Adaptive Learning Rate for Training Neural Network with Output Scale Change

abstract: A multiplicative constant scaling factor is often applied to the model output to adjust the dynamics of neural network parameters. This has been used as one of the key interventions in an empirical study of lazy and active behavior. However, we show that the combination of such scaling and a commonly used adaptive learning rate optimizer strongly affects the training behavior of the neural network. This is problematic as it can cause \emph{unintended behavior} of neural networks, resulting in the misinterpretation of experimental results. Specifically, for some scaling settings, the effect of the adaptive learning rate disappears or is strongly influenced by the scaling factor. To avoid the unintended effect, we present a modification of an optimization algorithm and demonstrate remarkable differences between adaptive learning rate optimization and simple gradient descent, especially with a small ($<1.0$) scaling factor.


title: Teachers Do More Than Teach: Compressing Image-to-Image Models

abstract: Generative Adversarial Networks (GANs) have achieved huge success in generating high-fidelity images, however, they suffer from low efficiency due to tremendous computational cost and bulky memory usage. Recent efforts on compression GANs show noticeable progress in obtaining smaller generators by sacrificing image quality or involving a time-consuming searching process. In this work, we aim to address these issues by introducing a teacher network that provides a search space in which efficient network architectures can be found, in addition to performing knowledge distillation. First, we revisit the search space of generative models, introducing an inception-based residual block into generators. Second, to achieve target computation cost, we propose a one-step pruning algorithm that searches a student architecture from the teacher model and substantially reduces searching cost. It requires no l1 sparsity regularization and its associated hyper-parameters, simplifying the training procedure. Finally, we propose to distill knowledge through maximizing feature similarity between teacher and student via an index named Global Kernel Alignment (GKA). Our compressed networks achieve similar or even better image fidelity (FID, mIoU) than the original models with much-reduced computational cost, e.g., MACs. Code will be released at https://github.com/snap-research/CAT.


title: Compressed Communication Complexity of Hamming Distance

abstract: We consider the communication complexity of the Hamming distance of two strings. Bille et al. [SPIRE 2018] considered the communication complexity of the longest common prefix (LCP) problem in the setting where the two parties have their strings in a compressed form, i.e., represented by the Lempel-Ziv 77 factorization (LZ77) with/without self-references. We present a randomized public-coin protocol for a joint computation of the Hamming distance of two strings represented by LZ77 without self-references. While our scheme is heavily based on Bille et al.'s LCP protocol, our complexity analysis is original which uses Crochemore's C-factorization and Rytter's AVL-grammar. As a byproduct, we also show that LZ77 with/without self-references are not monotonic in the sense that their sizes can increase by a factor of 4/3 when a prefix of the string is removed.


title: Comparison of the Tetrahedron Method to Smearing Methods for the Electronic Density of States

abstract: The electronic density of states (DOS) highlights fundamental properties of materials that oftentimes dictate their properties, such as the band gap and Van Hove singularities. In this short note, we discuss how sharp features of the density of states can be obscured by smearing methods (such as the Gaussian and Fermi smearing methods) when calculating the DOS. While the common approach to reach a "converged" density of states of a material is to increase the discrete k-point mesh density, we show that the DOS calculated by smearing methods can appear to converge but not to the correct DOS. Employing the tetrahedron method for Brillouin zone integration resolves key features of the density of states far better than smearing methods.


title: A note on $\mathcal{F}_n$-multiple zeta values

abstract: For several evaluations of special values and several relations known only in $\mathcal{A}_n$-multiple zeta values or $\mathcal{S}_n$-multiple zeta values, we prove that they are uniformly valid in $\mathcal{F}_n$-multiple zeta values for both the case where $\mathcal{F}=\mathcal{A}$ and $\mathcal{F}=\mathcal{S}$. In particular, the Bowman-Bradley type theorem and sum formulas for $\mathcal{S}_2$-multiple zeta values are proved.


title: Joint Network Topology Inference via Structured Fusion Regularization

abstract: Joint network topology inference represents a canonical problem of jointly learning multiple graph Laplacian matrices from heterogeneous graph signals. In such a problem, a widely employed assumption is that of a simple common component shared among multiple networks. However, in practice, a more intricate topological pattern, comprising simultaneously of sparse, homogeneity and heterogeneity components, would exhibit in multiple networks. In this paper, we propose a general graph estimator based on a novel structured fusion regularization that enables us to jointly learn multiple graph Laplacian matrices with such complex topological patterns, and enjoys both high computational efficiency and rigorous theoretical guarantee. Moreover, in the proposed regularization term, the topological pattern among networks is characterized by a Gram matrix, endowing our graph estimator with the ability of flexible modelling different types of topological patterns by different choices of the Gram matrix. Computationally, the regularization term, coupling the parameters together, makes the formulated optimization problem intractable and thus, we develop a computationally-scalable algorithm based on the alternating direction method of multipliers (ADMM) to solve it efficiently. Theoretically, we provide a theoretical analysis of the proposed graph estimator, which establishes a non-asymptotic bound of the estimation error under the high-dimensional setting and reflects the effect of several key factors on the convergence rate of our algorithm. Finally, the superior performance of the proposed method is illustrated through simulated and real data examples.


title: A Novel Framework for Threat Analysis of Machine Learning-based Smart Healthcare Systems

abstract: Smart healthcare systems (SHSs) are providing fast and efficient disease treatment leveraging wireless body sensor networks (WBSNs) and implantable medical devices (IMDs)-based internet of medical things (IoMT). In addition, IoMT-based SHSs are enabling automated medication, allowing communication among myriad healthcare sensor devices. However, adversaries can launch various attacks on the communication network and the hardware/firmware to introduce false data or cause data unavailability to the automatic medication system endangering the patient's life. In this paper, we propose SHChecker, a novel threat analysis framework that integrates machine learning and formal analysis capabilities to identify potential attacks and corresponding effects on an IoMT-based SHS. Our framework can provide us with all potential attack vectors, each representing a set of sensor measurements to be altered, for an SHS given a specific set of attack attributes, allowing us to realize the system's resiliency, thus the insight to enhance the robustness of the model. We implement SHChecker on a synthetic and a real dataset, which affirms that our framework can reveal potential attack vectors in an IoMT system. This is a novel effort to formally analyze supervised and unsupervised machine learning models for black-box SHS threat analysis.


title: Towards a standardised strategy to collect and distribute application software artifacts

abstract: Reference sets contain known content that are used to identify relevant or filter irrelevant content. Application profiles are a type of reference set that contain digital artifacts associated with application software. An application profile can be compared against a target data set to identify relevant evidence of application usage in a variety of investigation scenarios. The research objective is to design and implement a standardised strategy to collect and distribute application software artifacts using application profiles. An advanced technique for creating application profiles was designed using a formalised differential analysis strategy. The design was implemented in a live differential forensic analysis tool, LiveDiff, to automate and simplify data collection. A storage mechanism was designed based on a previously standardised forensic data abstraction. The design was implemented in a new data abstraction, Application Profile XML (APXML), to provide storage, distribution and automated processing of collected artifacts.


title: Delayed singularity formation for the three dimensional compressible Euler equations with non-zero vorticity

abstract: For the 3D compressible isentropic Euler equations with an initial perturbation of size $\ve$ of a rest state, if the initial vorticity is of size $\dl$ with $0<\dl\le \ve$ and $\ve$ is small, we establish that the lifespan of the smooth solutions is $T_{\dl}=O(\min\{e^\frac{1}{\ve},\frac{1}{\delta}\})$ for the polytropic gases, and $T_{\dl}=O(\frac{1}{\delta})$ for the Chaplygin gases. For example, when $\dl=e^{-\f{1}{\ve^2}}$ is chosen, then $T_{\dl}=O(e^{\f{1}{\ve}})$ for the polytropic gases and $T_{\dl}=O(e^{\f{1}{\ve^2}})$ for the Chaplygin gases although the perturbations of the initial density and the divergence of the initial velocity are only of order $O(\ve)$. Our result illustrates that the time of existence of smooth solutions depends crucially on the size of the vorticity of the initial data, as long as the initial data is sufficiently close to a constant. The main ingredients in the paper are: introducing some suitably weighted energies, deriving the pointwise space-time decay estimates of solutions, looking for the good unknown instead of the velocity, and establishing the required weighted estimates on the vorticty.


title: Elastic Net Regularization Paths for All Generalized Linear Models

abstract: The lasso and elastic net are popular regularized regression models for supervised learning. Friedman, Hastie, and Tibshirani (2010) introduced a computationally efficient algorithm for computing the elastic net regularization path for ordinary least squares regression, logistic regression and multinomial logistic regression, while Simon, Friedman, Hastie, and Tibshirani (2011) extended this work to Cox models for right-censored data. We further extend the reach of the elastic net-regularized regression to all generalized linear model families, Cox models with (start, stop] data and strata, and a simplified version of the relaxed lasso. We also discuss convenient utility functions for measuring the performance of these fitted models.


title: Scalar meson field in a conformally flat space

abstract: Among several authors, who studied massive and massless scalar meson fields in general relativity, attempts to obtain a complete set of solutions for a conformally flat metric $e^{\psi}\left({dx^1}^2 + {dx^2}^2 + {dx^3}^2 - {dx^4}^2\right)$ were made by Ray for massive and massless mesons and Gursay for massless mesons. Both of them concluded that $\psi$ must be a function of $K_0\left({dx^1}^2 + {dx^2}^2 + {dx^3}^2 -{dx^4}^2\right) + K_1 x^1 + K_2 x^2 + K_3 x^3 + K_4 x^4$, where, where $K_0,~K_1,~ K_2,~K_3,~K_4$ are all constants. Both Ray and Gursay, however, overlooked an important particular case, which is studied here. As a by-product certain equations obtained by Auria and Regge in connection with "Gravitational theories with asymptotic flat Instantons," are solved under less restrictive assumptions.


title: Entropy production due to electroweak phase transition in the framework of two Higgs doublet model

abstract: We revisit the possibility of first order electroweak phase transition~(EWPT) in one of the simplest extensions of the Standard Model (SM) scalar sector, namely the two-Higgs-doublet model~(2HDM). We take into account the ensuing constraints from the electroweak precision tests, Higgs signal strengths, and the recent LHC bounds from direct scalar searches. By studying the vacuum transition in 2HDM, we discuss in detail the entropy released in the first order EWPT in various parameter planes of 2HDM.