title: Morality, Machines and the Interpretation Problem: A Value-based, Wittgensteinian Approach to Building Moral Agents

abstract: We present what we call the Interpretation Problem, whereby any rule in symbolic form is open to infinite interpretation in ways that we might disapprove of and argue that any attempt to build morality into machines is subject to it. We show how the Interpretation Problem in Artificial Intelligence is an illustration of Wittgenstein's general claim that no rule can contain the criteria for its own application, and that the risks created by this problem escalate in proportion to the degree to which to machine is causally connected to the world, in what we call the Law of Interpretative Exposure. Using game theory, we attempt to define the structure of normative spaces and argue that any rule-following within a normative space is guided by values that are external to that space and which cannot themselves be represented as rules. In light of this, we categorise the types of mistakes an artificial moral agent could make into Mistakes of Intention and Instrumental Mistakes, and we propose ways of building morality into machines by getting them to interpret the rules we give in accordance with these external values, through explicit moral reasoning, the Show, not Tell paradigm, the adjustment of causal power and structure of the agent, and relational values, with the ultimate aim that the machine develop a virtuous character and that the impact of the Interpretation Problem is minimised.


title: Linear Bandit Algorithms with Sublinear Time Complexity

abstract: We propose two linear bandits algorithms with per-step complexity sublinear in the number of arms $K$. The algorithms are designed for applications where the arm set is extremely large and slowly changing. Our key realization is that choosing an arm reduces to a maximum inner product search (MIPS) problem, which can be solved approximately without breaking regret guarantees. Existing approximate MIPS solvers run in sublinear time. We extend those solvers and present theoretical guarantees for online learning problems, where adaptivity (i.e., a later step depends on the feedback in previous steps) becomes a unique challenge. We then explicitly characterize the tradeoff between the per-step complexity and regret. For sufficiently large $K$, our algorithms have sublinear per-step complexity and $\tilde O(\sqrt{T})$ regret. Empirically, we evaluate our proposed algorithms in a synthetic environment and a real-world online movie recommendation problem. Our proposed algorithms can deliver a more than 72 times speedup compared to the linear time baselines while retaining similar regret.


title: Memoir on the vibratory movement of an elliptical membrane

abstract: Translation of \'Emile Mathieu's "M\'emoire sur le mouvement vibratoire d'une membrane de forme elliptique", Journal de math\'ematiques pures et appliqu\'ees 2e s\'erie, tome 13 (1868), p. 137-203.


title: Iterated Logarithm Bounds of BGC Stochastic Processes

abstract: We derive a novel framework called Bi-Directional Grid Constrained (BGC) stochastic processes in which the further an Ito diffusion drifts away from the origin, then the further it will be constrained. By making suitable modifications to the Law of Iterated Logarithm (LIL), we derive a novel theorem about the upper and lower bounds for BGC processes and their hidden barrier. To visualize the theorem, we run many simulations of the Ito diffusions for a representative expression for lambda(X, t), both before and after BGC and uncover some interesting results with applications into finance and many other areas.


title: Modeling Macroeconomic Variations After COVID-19

abstract: The coronavirus is a global event of historical proportions and just a few months changed the time series properties of the data in ways that make many pre-covid forecasting models inadequate. It also creates a new problem for estimation of economic factors and dynamic causal effects because the variations around the outbreak can be interpreted as outliers, as shifts to the distribution of existing shocks, or as addition of new shocks. I take the latter view and use covid indicators as controls to 'de-covid' the data prior to estimation. I find that economic uncertainty remains high at the end of 2020 even though real economic activity has recovered and covid uncertainty has receded. Dynamic responses of variables to shocks in a VAR similar in magnitude and shape to the ones identified before 2020 can be recovered by directly or indirectly modeling covid and treating it as exogenous. These responses to economic shocks are distinctly different from those to a covid shock which are much larger but shorter lived. Disentangling the two types of shocks can be important in macroeconomic modeling post-covid.


title: Resilient Active Information Acquisition with Teams of Robots

abstract: Emerging applications of collaborative autonomy, such as Multi-Target Tracking, Unknown Map Exploration, and Persistent Surveillance, require robots plan paths to navigate an environment while maximizing the information collected via on-board sensors. In this paper, we consider such information acquisition tasks but in adversarial environments, where attacks may temporarily disable the robots' sensors. We propose the first receding horizon algorithm, aiming for robust and adaptive multi-robot planning against any number of attacks, which we call Resilient Active Information acquisitioN (RAIN). RAIN calls, in an online fashion, a Robust Trajectory Planning (RTP) subroutine which plans attack-robust control inputs over a look-ahead planning horizon. We quantify RTP's performance by bounding its suboptimality. We base our theoretical analysis on notions of curvature introduced in combinatorial optimization. We evaluate RAIN in three information acquisition scenarios: Multi-Target Tracking, Occupancy Grid Mapping, and Persistent Surveillance. The scenarios are simulated in C++ and a Unity-based simulator. In all simulations, RAIN runs in real-time, and exhibits superior performance against a state-of-the-art baseline information acquisition algorithm, even in the presence of a high number of attacks. We also demonstrate RAIN's robustness and effectiveness against varying models of attacks (worst-case and random), as well as, varying replanning rates.


title: Hybrid gausslet/Gaussian basis sets

abstract: We introduce hybrid gausslet/Gaussian basis sets, where a standard Gaussian basis is added to a gausslet basis in order to increase accuracy near the nuclei while keeping the spacing of the grid of gausslets relatively large. The Gaussians are orthogonalized to the gausslets, which are already orthonormal, and approximations are introduced to maintain the diagonal property of the two electron part of the Hamiltonian, so that it continues to scale as the second power of the number of basis functions, rather than the fourth. We introduce several corrections to the Hamiltonian designed to enforce certain exact properties, such as the values of certain two-electron integrals. We also introduce a simple universal energy correction which compensates for the incompleteness of the basis stemming from the electron-electron cusps, based on the measured double occupancy of each basis function. We perform a number of Hartree Fock and full configuration interaction (full-CI) test calculations on two electron systems, and Hartree Fock on a ten-atom hydrogen chain, to benchmark these techniques. The inclusion of the cusp correction allows us to obtain complete basis set full-CI results, for the two electron cases, at the level of several microHartrees, and we see similar apparent accuracy for Hartree Fock on the ten-atom hydrogen chain.


title: Fairness of Exposure in Stochastic Bandits

abstract: Contextual bandit algorithms have become widely used for recommendation in online systems (e.g. marketplaces, music streaming, news), where they now wield substantial influence on which items get exposed to the users. This raises questions of fairness to the items -- and to the sellers, artists, and writers that benefit from this exposure. We argue that the conventional bandit formulation can lead to an undesirable and unfair winner-takes-all allocation of exposure. To remedy this problem, we propose a new bandit objective that guarantees merit-based fairness of exposure to the items while optimizing utility to the users. We formulate fairness regret and reward regret in this setting, and present algorithms for both stochastic multi-armed bandits and stochastic linear bandits. We prove that the algorithms achieve sub-linear fairness regret and reward regret. Beyond the theoretical analysis, we also provide empirical evidence that these algorithms can fairly allocate exposure to different arms effectively.


title: Quasilinear Reaction Diffusion Systems with Mass Dissipation

abstract: We study quasilinear reaction diffusion systems relative to the Shigesada-Kawasaki-Teramoto model. Nonlinearity standing for the external force is provided with mass dissipation. Estimate in several norms of the solution is provided under the restriction of diffusion coefficients, growth rate of reaction, and space dimension.


title: Numerical Simulations of Frost Growth Using Mixture Model on Surfaces with Different Wettability

abstract: Frost growth on cold surfaces is a transient process with coupled heat and mass transfer. Due to multiple factors such as humidity, temperature, flow velocity and constantly changing thermal properties as frost grows, precise prediction can be challenging. Especially when the geometry of the frosting surfaces gets complicated, it requires a balance of computing accuracy and efficiency. In this work, a numerical model is developed to predict frost growth considering the effect of the above parameters. Mixture model is adapted to improve the computational efficiency and the unstructured grids add the flexibility to extend the model to complex geometries. The predicted frost growth rate matches well with the experimental data reported in the literature under similar conditions. The model predicts reasonable growth trend of frost as the surface temperature, air temperature, humidity and flow velocity vary. The surface wettability effect is well captured at the early stage of frosting and it shows a higher frost growth rate on surfaces with a higher wettability.


title: Exciton emissions in bilayer WSe2 tuned by the ferroelectric polymer

abstract: In this work, a hybrid integration of few-layer transition metal dichalcogenides (TMDCs) and ferroelectric polymer is designed to achieve passive control of optical properties in-situ. The electrical polarization in ferroelectric P(VDF-TrFE) polymer can regulate the photoluminescence (PL) in few-layer TMDCs. The total PL intensity is substantially suppressed or enhanced under opposite polarization in bilayer WSe2. This is because electrons transfer between valley K and {\Lambda} in the conduction band induced by the built-in electric field in P(VDF-TrFE) polymer. This charge transfer further changes the competing dynamics between direct and indirect exciton recombination path and overall optical radiation efficiency. We also illustrate that the engineered PL originates from external electric field dependent transferred electron effect. The theoretical result matches the experimental data well. This work demonstrates a device platform in which passive regulation is achieved using 2D TMDCs modulated by polarized ferroelectric materials.


title: Pericentric passage-driven star formation in satellite galaxies and their hosts: CLUES from Local Group simulations

abstract: Local Group satellite galaxies show a wide diversity of star formation histories (SFHs) whose origin is yet to be fully understood. Using hydrodynamical simulations from the Constrained Local UniversE project, we study the SFHs of satellites of Milky Way-like galaxies in a cosmological context: while in the majority of the cases the accretion onto their host galaxy causes the satellites to lose their gas, with a subsequent suppression in SF, in about 25$\%$ of our sample we observe a clear enhancement of SF after infall. Peaks in SF clearly correlate with the satellite pericentric passage around its host and, in one case, with a satellite-satellite interaction. We identify two key ingredients that result in enhanced SF after infall: galaxies must enter the host's virial radius with a reservoir of cold gas $M_{\rm gas,inf}/M_{\rm vir,inf}\gtrsim 10^{-2}$ and with a minimum pericentric distance $\gtrsim$10 kpc (mean distance $\sim$50 kpc for the full sample), in order to form new stars due to compression of cold gas at pericentric passage. On the other hand, satellites that infall with little gas or whose pericentric distance is too small, have their gas ram-pressure stripped and subsequent SF quenched. The pericentric passage of satellites likewise correlates with SF peaks in their hosts, suggesting that this mechanism induces bursts of SF in satellites and central galaxies alike, in agreement with recent studies of our Galaxy's SFH. Our findings can explain the recently reported multiple stellar populations observed in dwarf galaxies such as Carina and Fornax, and should be taken into account in semi-analytic models of galaxy formation and satellite quenching.


title: Contrastive learning of strong-mixing continuous-time stochastic processes

abstract: Contrastive learning is a family of self-supervised methods where a model is trained to solve a classification task constructed from unlabeled data. It has recently emerged as one of the leading learning paradigms in the absence of labels across many different domains (e.g. brain imaging, text, images). However, theoretical understanding of many aspects of training, both statistical and algorithmic, remain fairly elusive. In this work, we study the setting of time series -- more precisely, when we get data from a strong-mixing continuous-time stochastic process. We show that a properly constructed contrastive learning task can be used to estimate the transition kernel for small-to-mid-range intervals in the diffusion case. Moreover, we give sample complexity bounds for solving this task and quantitatively characterize what the value of the contrastive loss implies for distributional closeness of the learned kernel. As a byproduct, we illuminate the appropriate settings for the contrastive distribution, as well as other hyperparameters in this setup.


title: Combinatorial Bandits without Total Order for Arms

abstract: We consider the combinatorial bandits problem, where at each time step, the online learner selects a size-$k$ subset $s$ from the arms set $\mathcal{A}$, where $\left|\mathcal{A}\right| = n$, and observes a stochastic reward of each arm in the selected set $s$. The goal of the online learner is to minimize the regret, induced by not selecting $s^*$ which maximizes the expected total reward. Specifically, we focus on a challenging setting where 1) the reward distribution of an arm depends on the set $s$ it is part of, and crucially 2) there is \textit{no total order} for the arms in $\mathcal{A}$. In this paper, we formally present a reward model that captures set-dependent reward distribution and assumes no total order for arms. Correspondingly, we propose an Upper Confidence Bound (UCB) algorithm that maintains UCB for each individual arm and selects the arms with top-$k$ UCB. We develop a novel regret analysis and show an $O\left(\frac{k^2 n \log T}{\epsilon}\right)$ gap-dependent regret bound as well as an $O\left(k^2\sqrt{n T \log T}\right)$ gap-independent regret bound. We also provide a lower bound for the proposed reward model, which shows our proposed algorithm is near-optimal for any constant $k$. Empirical results on various reward models demonstrate the broad applicability of our algorithm.


title: Adaptive Transmission for Distributed Detection in Energy Harvesting Wireless Sensor Networks

abstract: We consider a wireless sensor network, consisting of N heterogeneous sensors and a fusion center (FC), tasked with detecting a known signal in uncorrelated Gaussian noises. Each sensor can harvest randomly arriving energy and store it in a finite-size battery. Sensors communicate directly with the FC over orthogonal fading channels. Each sensor adapts its transmit symbol power, such that the larger its stored energy and its quantized channel gain are, the higher its transmit symbol power is. To strike a balance between energy harvesting and energy consumption, we formulate two constrained optimization problems (P1) and (P2), where in both problems we seek the jointly optimal local decision thresholds and channel gain quantization thresholds. While in (P1) we maximize the Jdivergence of the received signal densities at the FC, in (P2) we minimize the average total transmit power, subject to certain constraints. We solve (P1) and (P2), assuming that the batteries reach their steady-state. Our simulation results demonstrate the effectiveness of our optimization on enhancing the detection performance in (P1), and lowering the average total transmit power in (P2). They also reveal how the energy harvesting rate, the battery size, the sensor observation and communication channel parameters impact obtained solutions.


title: Efficient data-driven encoding of scene motion using Eccentricity

abstract: This paper presents a novel approach of representing dynamic visual scenes with static maps generated from video/image streams. Such representation allows easy visual assessment of motion in dynamic environments. These maps are 2D matrices calculated recursively, in a pixel-wise manner, that is based on the recently introduced concept of Eccentricity data analysis. Eccentricity works as a metric of a discrepancy between a particular pixel of an image and its normality model, calculated in terms of mean and variance of past readings of the same spatial region of the image. While Eccentricity maps carry temporal information about the scene, actual images do not need to be stored nor processed in batches. Rather, all the calculations are done recursively, based on a small amount of statistical information stored in memory, thus resulting in a very computationally efficient (processor- and memory-wise) method. The list of potential applications includes video-based activity recognition, intent recognition, object tracking, video description, and so on.


title: The Positive Mass Theorem with Arbitrary Ends

abstract: We prove a Riemannian positive mass theorem for manifolds with a single asymptotically flat end, but otherwise arbitrary other ends, which can be incomplete and contain negative scalar curvature. The incompleteness and negativity is compensated for by large positive scalar curvature on an annulus, in a quantitative fashion. In the complete noncompact case with nonnegative scalar curvature, we have no extra assumption and hence prove a long-standing conjecture of Schoen and Yau.


title: Sub-Terahertz and mmWave Penetration Loss Measurements for Indoor Environments

abstract: Millimeter-wave (mmWave) and terahertz (THz) spectrum can support significantly higher data rates compared to lower frequency bands and hence are being actively considered for 5G wireless networks and beyond. These bands have high free-space path loss (FSPL) in line-of-sight (LOS) propagation due to their shorter wavelength. Moreover, in non-line-of-sight (NLOS) scenario, these two bands suffer higher penetration loss than lower frequency bands which could seriously affect the network coverage. It is therefore critical to study the NLOS penetration loss introduced by different building materials at mmWave and THz bands, to help establish link budgets for an accurate performance analysis in indoor environments. In this work, we measured the penetration loss and the attenuation of several common constructional materials at mmWave (28 and 39 GHz) and sub-THz (120 and 144 GHz) bands. Measurements were conducted using a channel sounder based on NI PXI platforms. Results show that the penetration loss changes extensively based on the frequency and the material properties, ranging from 0.401 dB for ceiling tile at 28 GHz, to 16.608 dB for plywood at 144 GHz. Ceiling tile has the lowest measured attenuation at 28 GHz, while clear glass has the highest attenuation of 27.633 dB/cm at 144 GHz. As expected, the penetration loss and attenuation increased with frequency for all the tested materials.


title: Malware Classification Using Long Short-Term Memory Models

abstract: Signature and anomaly based techniques are the quintessential approaches to malware detection. However, these techniques have become increasingly ineffective as malware has become more sophisticated and complex. Researchers have therefore turned to deep learning to construct better performing model. In this paper, we create four different long-short term memory (LSTM) based models and train each to classify malware samples from 20 families. Our features consist of opcodes extracted from malware executables. We employ techniques used in natural language processing (NLP), including word embedding and bidirection LSTMs (biLSTM), and we also use convolutional neural networks (CNN). We find that a model consisting of word embedding, biLSTMs, and CNN layers performs best in our malware classification experiments.


title: The Simons Observatory Large Aperture Telescope Receiver

abstract: The Simons Observatory (SO) Large Aperture Telescope Receiver (LATR) will be coupled to the Large Aperture Telescope located at an elevation of 5,200 m on Cerro Toco in Chile. The resulting instrument will produce arcminute-resolution millimeter-wave maps of half the sky with unprecedented precision. The LATR is the largest cryogenic millimeter-wave camera built to date with a diameter of 2.4 m and a length of 2.6 m. It cools 1200 kg of material to 4 K and 200 kg to 100 mk, the operating temperature of the bolometric detectors with bands centered around 27, 39, 93, 145, 225, and 280 GHz. Ultimately, the LATR will accommodate 13 40 cm diameter optics tubes, each with three detector wafers and a total of 62,000 detectors. The LATR design must simultaneously maintain the optical alignment of the system, control stray light, provide cryogenic isolation, limit thermal gradients, and minimize the time to cool the system from room temperature to 100 mK. The interplay between these competing factors poses unique challenges. We discuss the trade studies involved with the design, the final optimization, the construction, and ultimate performance of the system.


title: The Alma catalog of OB stars. II. A cross-match with Gaia DR2 and an updated map of the solar neighbourhood

abstract: We cross-match the Alma catalog of OB stars with Gaia DR2 astrometry and photometry as a first step towards producing a clean sample of massive stars in the solar neighbourhood with a high degree of completeness. We analyze the resulting colour-absolute magnitude diagram to divide our sample into categories and compare extinction estimates from two sources, finding problems with both of them. The distances obtained with three different priors are found to have few differences among them, indicating that Gaia DR2 distances are robust. An analysis of the 3-D distribution of massive stars in the solar neighbourhood is presented. We show that a kinematically distinct structure we dub the Cepheus spur extends from the Orion-Cygnus spiral arm towards the Perseus arm and is located above the Galactic mid-plane, likely being related to the recently discovered Radcliffe wave. We propose that this corrugation pattern in the Galactic disk may be responsible for the recent enhanced star formation at its crests and troughs. We also discuss our plans to extend this work in the immediate future.


title: Introduction to Periodic Geometry and Topology

abstract: This monograph introduces key concepts and problems in the new research area of Periodic Geometry and Topology for materials applications.Periodic structures such as solid crystalline materials or textiles were previously classified in discrete and coarse ways that depend on manual choices or are unstable under perturbations. Since crystal structures are determined in a rigid form, their finest natural equivalence is defined by rigid motion or isometry, which preserves inter-point distances. Due to atomic vibrations, isometry classes of periodic point sets form a continuous space whose geometry and topology were unknown. The key new problem in Periodic Geometry is to unambiguously parameterize this space of isometry classes by continuous coordinates that allow a complete reconstruction of any crystal. The major part of this manuscript reviews the recently developed isometry invariants to resolve the above problem: (1) density functions computed from higher order Voronoi zones, (2) distance-based invariants that allow ultra-fast visualizations of huge crystal datasets, and (3) the complete invariant isoset (a DNA-type code) with a first continuous metric on all periodic crystals. The main goal of Periodic Topology is to classify textiles up to periodic isotopy, which is a continuous deformation of a thickened plane without a fixed lattice basis. This practical problem substantially differs from past research focused on links in a fixed thickened torus.


title: Multiple-Channel Real Time Filtering for a Myoelectric Prosthetic Hand-Arm Robot System

abstract: On the base of the developed master-slave prosthetic hand-arm robot system, which is controlled mainly based on signals obtained from bending sensors fixed on the data glove, the first idea deduced was to develop and add a multi-dimensional filter into the original control system to make the control signals cleaner and more stable at real time. By going further, a second new idea was also proposed to predict new control information based on the combination of a new algorithm and prediction control theory. In order to fulfill the first idea properly, the possible methods to process data in real time, the different ways to produce Gaussian distributed random data, the way to combine the new algorithm with the previous complex program project, and the way to simplify and reduce the running time of the algorithm to maintain the high efficiency, the real time processing with multiple channels of the sensory system and the real-time performance of the control system were researched. Eventually, the experiment on the same provided robot system gives the results of the first idea and shows the improved performance of the filter comparing with the original control method.


title: A toolbox for neuromorphic sensing in robotics

abstract: The third generation of artificial intelligence (AI) introduced by neuromorphic computing is revolutionizing the way robots and autonomous systems can sense the world, process the information, and interact with their environment. The promises of high flexibility, energy efficiency, and robustness of neuromorphic systems is widely supported by software tools for simulating spiking neural networks, and hardware integration (neuromorphic processors). Yet, while efforts have been made on neuromorphic vision (event-based cameras), it is worth noting that most of the sensors available for robotics remain inherently incompatible with neuromorphic computing, where information is encoded into spikes. To facilitate the use of traditional sensors, we need to convert the output signals into streams of spikes, i.e., a series of events (+1, -1) along with their corresponding timestamps. In this paper, we propose a review of the coding algorithms from a robotics perspective and further supported by a benchmark to assess their performance. We also introduce a ROS (Robot Operating System) toolbox to encode and decode input signals coming from any type of sensor available on a robot. This initiative is meant to stimulate and facilitate robotic integration of neuromorphic AI, with the opportunity to adapt traditional off-the-shelf sensors to spiking neural nets within one of the most powerful robotic tools, ROS.


title: The CMS Precision Proton Spectrometer at the HL-LHC -- Expression of Interest

abstract: The CMS Collaboration intends to pursue the study of central exclusive production (CEP) events, pp $\to$ pXp, at the High-Luminosity LHC (HL-LHC) by means of a new near-beam proton spectrometer. In CEP events, the state X is produced at central rapidities, and the scattered protons do not leave the beam pipe. The kinematics of X can be fully reconstructed from that of the protons, which gives access to final states otherwise not visible. CEP allows unique sensitivity to physics beyond the standard model, e.g. in the search for anomalous quartic gauge couplings, axion-like particles, and in general new resonances. CMS has been successfully operating the Precision Proton Spectrometer (PPS), initially a joint CMS and TOTEM project, since 2016. The present document outlines the physics interest of a new PPS at the HL-LHC, and explores its feasibility and expected performance. Discussions with the machine groups led to the identification of four locations suitable for the installation of movable proton detectors: at 196, 220, 234, and 420 m from the interaction point, on both sides. Acceptance studies indicate that having the beams cross in the vertical plane at the interaction point, as implemented after Long Shutdown 3, is preferable over the present horizontal crossing. This gives access to states X in the mass range 133 GeV$-$2.7 TeV with the stations at 196, 220, and 234 m. The lower mass limit becomes 43 GeV if the 420 m station is included, which makes it possible to study central exclusive production of the 125 GeV Higgs boson. This is a major improvement with respect to the current mass range of 350 GeV$-$2 TeV. The project and its costs can easily be staged; the 420 m station can be addressed in a second step. In summary, a new near-beam proton spectrometer for operation at the HL-LHC appears feasible. It would greatly extend the CMS physics reach with a limited investment.


title: Malware Classification with GMM-HMM Models

abstract: Discrete hidden Markov models (HMM) are often applied to malware detection and classification problems. However, the continuous analog of discrete HMMs, that is, Gaussian mixture model-HMMs (GMM-HMM), are rarely considered in the field of cybersecurity. In this paper, we use GMM-HMMs for malware classification and we compare our results to those obtained using discrete HMMs. As features, we consider opcode sequences and entropy-based sequences. For our opcode features, GMM-HMMs produce results that are comparable to those obtained using discrete HMMs, whereas for our entropy-based features, GMM-HMMs generally improve significantly on the classification results that we have achieved with discrete HMMs.


title: Beyond Unbounded Beliefs: How Preferences and Information Interplay in Social Learning

abstract: When does society eventually learn the truth, or take the correct action, via observational learning? In a general model of sequential learning over social networks, we identify a simple condition for learning dubbed excludability. Excludability is a joint property of agents' preferences and their information. We develop two classes of preferences and information that jointly satisfy excludability: (i) for a one-dimensional state, preferences with single-crossing differences and a new informational condition, directionally unbounded beliefs; and (ii) for a multi-dimensional state, intermediate preferences and subexponential location-shift information. These applications exemplify that with multiple states "unbounded beliefs" is not only unnecessary for learning, but incompatible with familiar informational structures like normal information. Unbounded beliefs demands that a single agent can identify the correct action. Excludability, on the other hand, only requires that a single agent must be able to displace any wrong action, even if she cannot take the correct action.


title: Statistical inference for a mixture of Markov jump processes

abstract: We estimate a general mixture of Markov jump processes. The key novel feature of the proposed mixture is that the transition intensity matrices of the Markov processes comprising the mixture are entirely unconstrained. The Markov processes are mixed with distributions that depend on the initial state of the mixture process. The new mixture is estimated from its continuously observed realizations using the EM algorithm, which provides the maximum likelihood (ML) estimates of the mixture's parameters. We derive the asymptotic properties of the ML estimators. To obtain estimated standard errors of the ML estimates of the mixture's parameters, an explicit form of the observed Fisher information matrix is derived. In its new form, the information matrix simplifies the conditional expectation of outer product of the complete-data score function in the Louis (1982) general matrix formula for the observed Fisher information matrix. Simulation study verifies the estimates' accuracy and confirms the consistency and asymptotic normality of the estimators. The developed methods are applied to a medical dataset, for which the likelihood ratio test rejects the constrained mixture in favor of the proposed unconstrained one. This application exemplifies the usefulness of a new unconstrained mixture for identification and characterization of homogeneous subpopulations in a heterogeneous population.


title: Probability of Consensus of Hegselmann-Krause Dynamics

abstract: The original Hegselmann-Krause (HK) model comprises a set of $n$ agents characterized by their opinion, a number in $[0,1]$. Agent $i$ updates its opinion $x_i$ via taking the average opinion of its neighbors whose opinion differs by at most $\epsilon$ from $x_i$. In the article, the opinion space is extended to $\mathbf{R^d}.$ The main result is to derive bounds for the probability of consensus. In general, we have a positive lower bound for the probability of consensus and demonstrate a lower bound for the probability of consensus on a unit cube. In particular for one dimensional case, we derive an upper bound and a better lower bound for the probability of consensus and demonstrate them on a unit interval.


title: Coloring the distance graph in three dimensions

abstract: Let Gn be the graph on n-dimensional Euclidean space connecting points of rational Euclidean distance. It is consistent relative to an inaccessible cardinal that ZF+DC holds and G3 has countable chromatic number, yet G4 has uncountable chromatic number.


title: Learning Asynchronous and Sparse Human-Object Interaction in Videos

abstract: Human activities can be learned from video. With effective modeling it is possible to discover not only the action labels but also the temporal structures of the activities such as the progression of the sub-activities. Automatically recognizing such structure from raw video signal is a new capability that promises authentic modeling and successful recognition of human-object interactions. Toward this goal, we introduce Asynchronous-Sparse Interaction Graph Networks (ASSIGN), a recurrent graph network that is able to automatically detect the structure of interaction events associated with entities in a video scene. ASSIGN pioneers learning of autonomous behavior of video entities including their dynamic structure and their interaction with the coexisting neighbors. Entities' lives in our model are asynchronous to those of others therefore more flexible in adaptation to complex scenarios. Their interactions are sparse in time hence more faithful to the true underlying nature and more robust in inference and learning. ASSIGN is tested on human-object interaction recognition and shows superior performance in segmenting and labeling of human sub-activities and object affordances from raw videos. The native ability for discovering temporal structures of the model also eliminates the dependence on external segmentation that was previously mandatory for this task.


title: Operating a passive on-chip superconducting circulator: device control and quasiparticle effects

abstract: Microwave circulators play an important role in quantum technology based on superconducting circuits. The conventional circulator design, which employs ferrite materials, is bulky and involves strong magnetic fields, rendering it unsuitable for integration on superconducting chips. One promising design for an on-chip superconducting circulator is based on a passive Josephson-junction ring. In this paper, we consider two operational issues for such a device: circuit tuning and the effects of quasiparticle tunneling. We compute the scattering matrix using adiabatic elimination and derive the parameter constraints to achieve optimal circulation. We then numerically optimize the circulator performance over the full set of external control parameters, including gate voltages and flux bias, to demonstrate that this multi-dimensional optimization converges quickly to find optimal working points. We also consider the possibility of quasiparticle tunneling in the circulator ring and how it affects signal circulation. Our results form the basis for practical operation of a passive on-chip superconducting circulator made from a ring of Josephson junctions.


title: Worsening Perception: Real-time Degradation of Autonomous Vehicle Perception Performance for Simulation of Adverse Weather Conditions

abstract: Autonomous vehicles rely heavily upon their perception subsystems to see the environment in which they operate. Unfortunately, the effect of variable weather conditions presents a significant challenge to object detection algorithms, and thus it is imperative to test the vehicle extensively in all conditions which it may experience. However, development of robust autonomous vehicle subsystems requires repeatable, controlled testing - while real weather is unpredictable and cannot be scheduled. Real-world testing in adverse conditions is an expensive and time-consuming task, often requiring access to specialist facilities. Simulation is commonly relied upon as a substitute, with increasingly visually realistic representations of the real-world being developed. In the context of the complete autonomous vehicle control pipeline, subsystems downstream of perception need to be tested with accurate recreations of the perception system output, rather than focusing on subjective visual realism of the input - whether in simulation or the real world. This study develops the untapped potential of a lightweight weather augmentation method in an autonomous racing vehicle - focusing not on visual accuracy, but rather the effect upon perception subsystem performance in real time. With minimal adjustment, the prototype developed in this study can replicate the effects of water droplets on the camera lens, and fading light conditions. This approach introduces a latency of less than 8 ms using compute hardware well suited to being carried in the vehicle - rendering it ideal for real-time implementation that can be run during experiments in simulation, and augmented reality testing in the real world.


title: Comparing the Value of Labeled and Unlabeled Data in Method-of-Moments Latent Variable Estimation

abstract: Labeling data for modern machine learning is expensive and time-consuming. Latent variable models can be used to infer labels from weaker, easier-to-acquire sources operating on unlabeled data. Such models can also be trained using labeled data, presenting a key question: should a user invest in few labeled or many unlabeled points? We answer this via a framework centered on model misspecification in method-of-moments latent variable estimation. Our core result is a bias-variance decomposition of the generalization error, which shows that the unlabeled-only approach incurs additional bias under misspecification. We then introduce a correction that provably removes this bias in certain cases. We apply our decomposition framework to three scenarios -- well-specified, misspecified, and corrected models -- to 1) choose between labeled and unlabeled data and 2) learn from their combination. We observe theoretically and with synthetic experiments that for well-specified models, labeled points are worth a constant factor more than unlabeled points. With misspecification, however, their relative value is higher due to the additional bias but can be reduced with correction. We also apply our approach to study real-world weak supervision techniques for dataset construction.


title: Evaluation and Optimization of Distributed Machine Learning Techniques for Internet of Things

abstract: Federated learning (FL) and split learning (SL) are state-of-the-art distributed machine learning techniques to enable machine learning training without accessing raw data on clients or end devices. However, their \emph{comparative training performance} under real-world resource-restricted Internet of Things (IoT) device settings, e.g., Raspberry Pi, remains barely studied, which, to our knowledge, have not yet been evaluated and compared, rendering inconvenient reference for practitioners. This work firstly provides empirical comparisons of FL and SL in real-world IoT settings regarding (i) learning performance with heterogeneous data distributions and (ii) on-device execution overhead. Our analyses in this work demonstrate that the learning performance of SL is better than FL under an imbalanced data distribution but worse than FL under an extreme non-IID data distribution. Recently, FL and SL are combined to form splitfed learning (SFL) to leverage each of their benefits (e.g., parallel training of FL and lightweight on-device computation requirement of SL). This work then considers FL, SL, and SFL, and mount them on Raspberry Pi devices to evaluate their performance, including training time, communication overhead, power consumption, and memory usage. Besides evaluations, we apply two optimizations. Firstly, we generalize SFL by carefully examining the possibility of a hybrid type of model training at the server-side. The generalized SFL merges sequential (dependent) and parallel (independent) processes of model training and is thus beneficial for a system with large-scaled IoT devices, specifically at the server-side operations. Secondly, we propose pragmatic techniques to substantially reduce the communication overhead by up to four times for the SL and (generalized) SFL.


title: On the early stages of precipitation during direct ageing of Alloy 718

abstract: The Ni-based superalloy Alloy 718 is used in aircraft engines as high-pressure turbine discs and must endure challenging demands on high-temperature yield strength, creep-, and oxidation-resistance. Nanoscale $\gamma^{\prime}$- and $\gamma^{\prime \prime}$-precipitates commonly found in duplet and triplet co-precipitate morphologies provide high-temperature strength under these harsh operating conditions. Direct ageing of Alloy 718 is an attractive alternative manufacturing route known to increase the yield strength at 650 $^{\deg}$C by at least +10 $\%$, by both retaining high dislocation densities and changing the nanoscale co-precipitate morphology. However, the detailed nucleation and growth mechanisms of the duplet and triplet co-precipitate morphologies of $\gamma^{\prime}$ and $\gamma^{\prime \prime}$ during the direct ageing process remain unknown. We provide a correlative high-resolution microscopy approach using transmission electron microscopy, high-angle annular dark-field imaging, and atom probe microscopy to reveal the early stages of precipitation during direct ageing of Alloy 718. Quantitative stereological analyses of the $\gamma^{\prime}$- and $\gamma^{\prime \prime}$-precipitate dispersions as well as their chemical compositions have allowed us to propose a qualitative model of the microstructural evolution. It is shown that fine $\gamma^{\prime}$- and $\gamma^{\prime \prime}$-precipitates nucleate homogeneously and grow coherently. However, $\gamma^{\prime \prime}$-precipitates also nucleate heterogeneously on dislocations and experience accelerated growth due to Nb pipe diffusion. Moreover, the co-precipitation reactions are largely influenced by solute availability and the potential for enrichment of Nb and rejection of Al+Ti.


title: Strange electrical transport: Colossal magnetoresistance via avoiding fully polarized magnetization in ferrimagnetic insulator Mn3Si2Te6

abstract: Colossal magnetoresistance is of great fundamental and technological significance and exists mostly in the manganites and a few other materials. Here we report colossal magnetoresistance that is starkly different from that in all other materials. The stoichiometric Mn3Si2Te6 is an insulator featuring a ferrimagnetic transition at 78 K. The resistivity drops by 7 orders of magnitude with an applied magnetic field above 9 Tesla, leading to an insulator-metal transition at up to 130 K. However, the colossal magnetoresistance occurs only when the magnetic field is applied along the magnetic hard axis and is surprisingly absent when the magnetic field is applied along the magnetic easy axis where magnetization is fully saturated. The anisotropy field separating the easy and hard axes is 13 Tesla, unexpected for the Mn ions with nominally negligible orbital momentum and spin-orbit interactions. Double exchange and Jahn-Teller distortions that drive the hole-doped manganites do not exist in Mn3Si2Te6. The phenomena fit no existing models, suggesting a unique, intriguing type of electrical transport.


title: Fluidic Shaping of Freeform Optical Components

abstract: Freeform optical components offer significant compactization of multi-lens systems, as well as advanced manipulation of light that is not possible with traditional systems. However, their fabrication relies on machining processes that are complex, time-consuming, and incompatible with rapid prototyping. This work presents the ability to shape liquid volumes and solidify them into desired freeform components, enabling rapid freeform prototyping with high surface quality. The method is based on controlling the minimum energy state of the interface between a curable optical liquid and an immersion liquid, by dictating a geometrical boundary constraint. The boundary shape is modeled as a cylinder whose arbitrary height is expressed as a Fourier series, allowing for an analytical solution of the resulting freeform surface as a sum of Fourier-Bessel functions. Each of these functions represents a different basic mode, whose superposition creates complex topographies. This solution allows deterministic design of freeform surfaces by controlling three key parameters - the volume of the optical liquid, the density of the immersion liquid, and the shape of the bounding frame. The paper describes a complete workflow for rapid prototyping of such components, and demonstrates the fabrication of a 35 mm diameter freeform component with sub-nanometer surface roughness within minutes.


title: PC2WF: 3D Wireframe Reconstruction from Raw Point Clouds

abstract: We introduce PC2WF, the first end-to-end trainable deep network architecture to convert a 3D point cloud into a wireframe model. The network takes as input an unordered set of 3D points sampled from the surface of some object, and outputs a wireframe of that object, i.e., a sparse set of corner points linked by line segments. Recovering the wireframe is a challenging task, where the numbers of both vertices and edges are different for every instance, and a-priori unknown. Our architecture gradually builds up the model: It starts by encoding the points into feature vectors. Based on those features, it identifies a pool of candidate vertices, then prunes those candidates to a final set of corner vertices and refines their locations. Next, the corners are linked with an exhaustive set of candidate edges, which is again pruned to obtain the final wireframe. All steps are trainable, and errors can be backpropagated through the entire sequence. We validate the proposed model on a publicly available synthetic dataset, for which the ground truth wireframes are accessible, as well as on a new real-world dataset. Our model produces wireframe abstractions of good quality and outperforms several baselines.


title: Contrast Adaptive Tissue Classification by Alternating Segmentation and Synthesis

abstract: Deep learning approaches to the segmentation of magnetic resonance images have shown significant promise in automating the quantitative analysis of brain images. However, a continuing challenge has been its sensitivity to the variability of acquisition protocols. Attempting to segment images that have different contrast properties from those within the training data generally leads to significantly reduced performance. Furthermore, heterogeneous data sets cannot be easily evaluated because the quantitative variation due to acquisition differences often dwarfs the variation due to the biological differences that one seeks to measure. In this work, we describe an approach using alternating segmentation and synthesis steps that adapts the contrast properties of the training data to the input image. This allows input images that do not resemble the training data to be more consistently segmented. A notable advantage of this approach is that only a single example of the acquisition protocol is required to adapt to its contrast properties. We demonstrate the efficacy of our approaching using brain images from a set of human subjects scanned with two different T1-weighted volumetric protocols.


title: Learning to Predict with Supporting Evidence: Applications to Clinical Risk Prediction

abstract: The impact of machine learning models on healthcare will depend on the degree of trust that healthcare professionals place in the predictions made by these models. In this paper, we present a method to provide people with clinical expertise with domain-relevant evidence about why a prediction should be trusted. We first design a probabilistic model that relates meaningful latent concepts to prediction targets and observed data. Inference of latent variables in this model corresponds to both making a prediction and providing supporting evidence for that prediction. We present a two-step process to efficiently approximate inference: (i) estimating model parameters using variational learning, and (ii) approximating maximum a posteriori estimation of latent variables in the model using a neural network, trained with an objective derived from the probabilistic model. We demonstrate the method on the task of predicting mortality risk for patients with cardiovascular disease. Specifically, using electrocardiogram and tabular data as input, we show that our approach provides appropriate domain-relevant supporting evidence for accurate predictions.


title: Crystal-symmetry-based selection rules for anharmonic phonon-phonon scattering from a group theory formalism

abstract: Anharmonic phonon-phonon scattering serves a critical role in heat conduction in solids. Previous studies have identified many selection rules for possible phonon-phonon scattering channels imposed by phonon energy and momentum conservation conditions and crystal symmetry. However, the crystal-symmetry-based selection rules have mostly been \textit{ad hoc} so far in selected materials, and a general formalism that can summarize known selection rules and lead to new ones in any given crystal is still lacking. In this work, we apply a general formalism for symmetry-based scattering selection rules based on the group theory to anharmonic phonon-phonon scatterings, which can reproduce known selection rules and guide the discovery of new selection rules between phonon branches imposed by the crystal symmetry. We apply this formalism to analyze the phonon-phonon scattering selection rules imposed by the in-plane symmetry of graphene, and demonstrate the significant impact of symmetry-breaking strain on the lattice thermal conductivity. Our work quantifies the critical influence of the crystal symmetry on the lattice thermal conductivity in solids and suggests routes to engineer heat conduction by tuning the crystal symmetry.


title: SVMax: A Feature Embedding Regularizer

abstract: A neural network regularizer (e.g., weight decay) boosts performance by explicitly penalizing the complexity of a network. In this paper, we penalize inferior network activations -- feature embeddings -- which in turn regularize the network's weights implicitly. We propose singular value maximization (SVMax) to learn a more uniform feature embedding. The SVMax regularizer supports both supervised and unsupervised learning. Our formulation mitigates model collapse and enables larger learning rates. We evaluate the SVMax regularizer using both retrieval and generative adversarial networks. We leverage a synthetic mixture of Gaussians dataset to evaluate SVMax in an unsupervised setting. For retrieval networks, SVMax achieves significant improvement margins across various ranking losses. Code available at https://bit.ly/3jNkgDt


title: The rigid-beam model for simulating plasmas generated by intense electron beams

abstract: We introduce a simplified model of the electron-beam/plasma system to model the electrical breakdown caused by the inductive electric field created by a rapidly rising electron beam current. The rigid-beam model is a reduction to the problem geometry to cylindrical coordinated and simplifications to Maxwell's equations that are driven by a prescribed electron beam current density. The model is very convenient for comparing various reductions of the plasma dynamics and air chemistry equation while maintaining a good approximation to the overall magnitude of the beam-created electric field. The usefulness of this model is demonstrated by comparing results for two different fluid reductions of the plasma dynamics: one where the collision rates are computed from the local reduced electric field (E/p) and another where the collision rates are determined from the mean energy per particle. We find that the two methods give similar results at higher pressures where the energy relation rate is large but differs significantly at lower pressures where the characteristic inelastic energy loss time scale is comparable to or greater than the rise time of the electron beam current.


title: DeepTag: An Unsupervised Deep Learning Method for Motion Tracking on Cardiac Tagging Magnetic Resonance Images

abstract: Cardiac tagging magnetic resonance imaging (t-MRI) is the gold standard for regional myocardium deformation and cardiac strain estimation. However, this technique has not been widely used in clinical diagnosis, as a result of the difficulty of motion tracking encountered with t-MRI images. In this paper, we propose a novel deep learning-based fully unsupervised method for in vivo motion tracking on t-MRI images. We first estimate the motion field (INF) between any two consecutive t-MRI frames by a bi-directional generative diffeomorphic registration neural network. Using this result, we then estimate the Lagrangian motion field between the reference frame and any other frame through a differentiable composition layer. By utilizing temporal information to perform reasonable estimations on spatio-temporal motion fields, this novel method provides a useful solution for motion tracking and image registration in dynamic medical imaging. Our method has been validated on a representative clinical t-MRI dataset; the experimental results show that our method is superior to conventional motion tracking methods in terms of landmark tracking accuracy and inference efficiency.


title: Transcritical Bifurcations and Algebraic Aspects of Quadratic Multiparametric Families

abstract: This article reveals an analysis of the quadratic systems that hold multiparametric families therefore, in the first instance the quadratic systems are identified and classified in order to facilitate their study and then the stability of the critical points in the finite plane, its bifurcations, stable manifold and lastly, the stability of the critical points in the infinite plane, afterwards the phase portraits resulting from the analysis of these families are graphed. To properly perform this study it was necessary to use some results of the non-linear systems theory, for this reason vital definitions and theorems were included because of their importance during the study of the multiparametric families. Algebraic aspects are also included.


title: Non-Asymptotic Guarantees for Reliable Identification of Granger Causality via the LASSO

abstract: Granger causality is among the widely used data-driven approaches for causal analysis of time series data with applications in various areas including economics, molecular biology, and neuroscience. Two of the main challenges of this methodology are: 1) over-fitting as a result of limited data duration, and 2) correlated process noise as a confounding factor, both leading to errors in identifying the causal influences. Sparse estimation via the LASSO has successfully addressed these challenges for parameter estimation. However, the classical statistical tests for Granger causality resort to asymptotic analysis of ordinary least squares, which require long data duration to be useful and are not immune to confounding effects. In this work, we address this disconnect by introducing a LASSO-based statistic and studying its non-asymptotic properties under the assumption that the true models admit sparse autoregressive representations. We establish fundamental limits for reliable identification of Granger causal influences using the proposed LASSO-based statistic. We further characterize the false positive error probability and test power of a simple thresholding rule for identifying Granger causal effects and provide two methods to set the threshold in a data-driven fashion. We present simulation studies and application to real data to compare the performance of our proposed method to ordinary least squares and existing LASSO-based methods in detecting Granger causal influences, which corroborate our theoretical results.


title: The Ru-Vojta result for subvarieties

abstract: In their recent article, Min Ru and Paul Vojta, among other things, proved the so-called general theorem (arithmetic part) which can be viewed as an extension of Schmidt's subspace theorem. In this note, we extend their result by replacing the divisors by closed subschemes.


title: Role of triple excitations in calculating different properties of Ba+

abstract: We carried out calculations of the energies, hyperfine structure constants and electric-dipole transiton amplitudes for the low-lying states of Ba+ in the framework of the relativistic linearized coupled-cluster single double (LCCSD) and coupled-cluster single double (valence) triple (CCSDvT) methods. Taking into account that an iterative inclusion of the valence triples into consideration is a complicated and computationally demanding process we study the effects of computational restriction on the final results. We also present a detailed study of various corrections to all calculated properties and use our results to formulate several broad rules that can be used in future calculations of the elements where experimental data are scarce and correct theoretical predictions are highly important.


title: Application of Reversible Data Hiding for Printing with Special Color Inks to Preserve Compatibility with Normal Printing

abstract: We propose an efficient framework with compatibility between normal printing and printing with special color inks in this paper. Special color inks can be used for printing to represent some particular colors and specific optical properties, which are difficult to express using only CMYK inks. Special color layers are required in addition to the general color layer for printing with special color inks. We introduce a reversible data hiding (RDH) method to embed the special color layers into the general color layer without visible artifacts. The proposed method can realize both normal printing and printing with special color inks by using a single layer. Our experimental results show that the quality of the marked image is virtually identical to that of the original image, i.e., the general color layer.


title: Singular limit in Hopf bifurcation for doubly diffusive convection equations I: linearized analysis at criticality

abstract: A singularly perturbed system for doubly diffusive convection equations, called the artificial compressible system, is considered on a two-dimensional infinite layer for a parameters range where the Hopf bifurcation occurs in the corresponding incompressible system. The spectrum of the linearized operator in a time periodic function space is investigated in detail near the bifurcation point when the singular perturbation parameter is small. The results of this paper are the basis of the study of the nonlinear Hopf bifurcation problem and the singular limit of the time periodic bifurcating solutions.


title: Singular limit in Hopf bifurcation for doubly diffusive convection equations II: bifurcation and stability

abstract: A singular perturbation problem from the artificial compressible system to the incompressible system is considered for a doubly diffusive convection when a Hopf bifurcation from the motionless state occurs in the incompressible system. It is proved that the Hopf bifurcation also occurs in the artificial compressible system for small singular perturbation parameter, called the artificial Mach number. The time periodic solution branch of the artificial compressible system is shown to converge to the corresponding bifurcating branch of the incompressible system in the singular limit of vanishing artificial Mach number.


title: Towards classification of codimension 1 foliations on threefolds of general type

abstract: We aim to classify codimension 1 foliations $\mathscr{F}$ with canonical singularities and $\nu(K_{\mathscr{F}}) < 3$ on threefolds of general type. We prove a classification result for foliations satisfying these conditions and having non-trivial algebraic part. We also describe purely transcendental foliations $\mathscr{F}$ with the canonical class $K_{\mathscr{F}}$ being not big on manifolds of general type in any dimension, assuming that $\mathscr{F}$ is non-singular in codimension $2$.


title: Structure-Preserving Progressive Low-rank Image Completion for Defending Adversarial Attacks

abstract: Deep neural networks recognize objects by analyzing local image details and summarizing their information along the inference layers to derive the final decision. Because of this, they are prone to adversarial attacks. Small sophisticated noise in the input images can accumulate along the network inference path and produce wrong decisions at the network output. On the other hand, human eyes recognize objects based on their global structure and semantic cues, instead of local image textures. Because of this, human eyes can still clearly recognize objects from images which have been heavily damaged by adversarial attacks. This leads to a very interesting approach for defending deep neural networks against adversarial attacks. In this work, we propose to develop a structure-preserving progressive low-rank image completion (SPLIC) method to remove unneeded texture details from the input images and shift the bias of deep neural networks towards global object structures and semantic cues. We formulate the problem into a low-rank matrix completion problem with progressively smoothed rank functions to avoid local minimums during the optimization process. Our experimental results demonstrate that the proposed method is able to successfully remove the insignificant local image details while preserving important global object structures. On black-box, gray-box, and white-box attacks, our method outperforms existing defense methods (by up to 12.6%) and significantly improves the adversarial robustness of the network.


title: Feature Boosting, Suppression, and Diversification for Fine-Grained Visual Classification

abstract: Learning feature representation from discriminative local regions plays a key role in fine-grained visual classification. Employing attention mechanisms to extract part features has become a trend. However, there are two major limitations in these methods: First, they often focus on the most salient part while neglecting other inconspicuous but distinguishable parts. Second, they treat different part features in isolation while neglecting their relationships. To handle these limitations, we propose to locate multiple different distinguishable parts and explore their relationships in an explicit way. In this pursuit, we introduce two lightweight modules that can be easily plugged into existing convolutional neural networks. On one hand, we introduce a feature boosting and suppression module that boosts the most salient part of feature maps to obtain a part-specific representation and suppresses it to force the following network to mine other potential parts. On the other hand, we introduce a feature diversification module that learns semantically complementary information from the correlated part-specific representations. Our method does not need bounding boxes/part annotations and can be trained end-to-end. Extensive experimental results show that our method achieves state-of-the-art performances on several benchmark fine-grained datasets. Source code is available at https://github.com/chaomaer/FBSD.


title: Financial Application of Extended Residual Coherence

abstract: Residual coherence is a graphical tool for selecting potential second-order interaction terms as functions of a single time series and its lags. This paper extends the notion of residual coherence to account for interaction terms of multiple time series. Moreover, an alternative criterion, integrated spectrum, is proposed to facilitate this graphical selection. A financial market application shows that new insights can be gained regarding implied market volatility.


title: Convergence Analysis of Dual Decomposition Algorithm in Distributed Optimization: Asynchrony and Inexactness

abstract: Dual decomposition is widely utilized in distributed optimization of multi-agent systems. In practice, the dual decomposition algorithm is desired to admit an asynchronous implementation due to imperfect communication, such as time delay and packet drop. In addition, computational errors also exist when individual agents solve their own subproblems. In this paper, we analyze the convergence of the dual decomposition algorithm in distributed optimization when both the asynchrony in communication and the inexactness in solving subproblems exist. We find that the interaction between asynchrony and inexactness slows down the convergence rate from $\mathcal{O} ( 1 / k )$ to $\mathcal{O} ( 1 / \sqrt{k} )$. Specifically, with a constant step size, the value of objective function converges to a neighborhood of the optimal value, and the solution converges to a neighborhood of the exact optimal solution. Moreover, the violation of the constraints diminishes in $\mathcal{O} ( 1 / \sqrt{k} )$. Our result generalizes and unifies the existing ones that only consider either asynchrony or inexactness. Finally, numerical simulations validate the theoretical results.


title: Observation of the near-threshold intruder $0^-$ resonance in $^{12}$Be

abstract: A resonant state at $3.21^{+0.12}_{-0.04}$\,MeV, located just above the one-neutron separation threshold, was observed for the first time in $^{12}$Be from the $^{11}$Be\,$(d,p)^{12}$Be one-neutron transfer reaction in inverse kinematics. This state is assigned a spin-parity of $0^-$, according to the distorted-wave Born approximation (DWBA) and decay-width analysis. Gamow coupled-channel (GCC) and Gamow shell-model (GSM) calculations show the importance of the continuum-coupling, which dramatically influences the excitation energy and ordering of low-lying states. Various exotic structures associated with cross-shell intruding configurations in $^{12}$Be and in its isotonic nucleus $^{11}$Li are comparably discussed.


title: Symmetric Multiqudit States: Stars, Entanglement, Rotosensors

abstract: A constellation of $N=d-1$ Majorana stars represents an arbitrary pure quantum state of dimension $d$ or a permutation-symmetric state of a system consisting of $n$ qubits. We generalize the latter construction to represent in a similar way an arbitrary symmetric pure state of $k$ subsystems with $d$ levels each. For $d\geq 3$, such states are equivalent, as far as rotations are concerned, to a collection of various spin states, with definite relative complex weights. Following Majorana's lead, we introduce a multiconstellation, consisting of the Majorana constellations of the above spin states, augmented by an auxiliary, "spectator" constellation, encoding the complex weights. Examples of stellar representations of symmetric states of four qutrits, and two spin-$3/2$ systems, are presented. We revisit the Hermite and Murnaghan isomorphisms, which relate multipartite states of various spins, number of parties, and even symmetries. We show how the tools introduced can be used to analyze multipartite entanglement and to identify optimal quantum rotosensors, i.e., pure states which are maximally sensitive to rotations around a specified axis, or averaged over all axes.


title: Effect of Vaccination to COVID-19 Disease Progression

abstract: A mathematical model of COVID-19 with minimal compartments is developed. The model is simple enough to fit data on confirmed cases, estimate the hidden infection figure and incorporate the effect of vaccination. With the effect of the new variant being considered, the model fits well with Philippine data of confirmed cases. With the fitted parameters, results show that a second peak, strikingly similar in magnitude to the first, is to be expected if the current transmission rate is increased by about 5\% and already a complete disaster if it will go up to 20\%. The model is then used to estimate time to achieve herd immunity considering natural immunity from being infected and vaccination plan of the country. Results show that if the plan of 200,000 vaccinated people per day is achieved then herd immunity can be attained by March 2022. But if only half of that is achieved the time could go up to February 2023.


title: Learning Granularity-Aware Convolutional Neural Network for Fine-Grained Visual Classification

abstract: Locating discriminative parts plays a key role in fine-grained visual classification due to the high similarities between different objects. Recent works based on convolutional neural networks utilize the feature maps taken from the last convolutional layer to mine discriminative regions. However, the last convolutional layer tends to focus on the whole object due to the large receptive field, which leads to a reduced ability to spot the differences. To address this issue, we propose a novel Granularity-Aware Convolutional Neural Network (GA-CNN) that progressively explores discriminative features. Specifically, GA-CNN utilizes the differences of the receptive fields at different layers to learn multi-granularity features, and it exploits larger granularity information based on the smaller granularity information found at the previous stages. To further boost the performance, we introduce an object-attentive module that can effectively localize the object given a raw image. GA-CNN does not need bounding boxes/part annotations and can be trained end-to-end. Extensive experimental results show that our approach achieves state-of-the-art performances on three benchmark datasets.


title: Learning the Next Best View for 3D Point Clouds via Topological Features

abstract: In this paper, we introduce a reinforcement learning approach utilizing a novel topology-based information gain metric for directing the next best view of a noisy 3D sensor. The metric combines the disjoint sections of an observed surface to focus on high-detail features such as holes and concave sections. Experimental results show that our approach can aid in establishing the placement of a robotic sensor to optimize the information provided by its streaming point cloud data. Furthermore, a labeled dataset of 3D objects, a CAD design for a custom robotic manipulator, and software for the transformation, union, and registration of point clouds has been publicly released to the research community.


title: Discrimination between cosmological and stellar phenomena by the intensity interferometry

abstract: We provide a quantitative theory of discrimination between objects with the same color temperature but having different angular spectrum by intensity interferometry. The two-point correlation function of the black body image with extended angular spectrum has significant differences with a correlation function of a black body with a narrow angular spectrum.


title: Hybrid Interference Mitigation Using Analog Prewhitening

abstract: This paper proposes a novel scheme for mitigating strong interferences, which is applicable to various wireless scenarios, including full-duplex wireless communications and uncoordinated heterogenous networks. As strong interferences can saturate the receiver's analog-to-digital converters (ADC), they need to be mitigated both before and after the ADCs, i.e., via hybrid processing. The key idea of the proposed scheme, namely the Hybrid Interference Mitigation using Analog Prewhitening (HIMAP), is to insert an M-input M-output analog phase shifter network (PSN) between the receive antennas and the ADCs to spatially prewhiten the interferences, which requires no signal information but only an estimate of the covariance matrix. After interference mitigation by the PSN prewhitener, the preamble can be synchronized, the signal channel response can be estimated, and thus a minimum mean squared error (MMSE) beamformer can be applied in the digital domain to further mitigate the residual interferences. The simulation results verify that the HIMAP scheme can suppress interferences 80dB stronger than the signal by using off-the-shelf phase shifters (PS) of 6-bit resolution.


title: An Experimental and Computational Study of a Swirl-Stabilized Premixed Flame

abstract: An unconfined strongly swirled flow is investigated for different Reynolds numbers using particle image velocimetry (PIV) and Large Eddy Simulation (LES) with a Thickened Flame (TF) model. Both reacting and non-reacting flow results are presented. In the LES-TF approach, the flame front is resolved on the computational grid through artificial thickening and the individual species transport equations are directly solved with the reaction rates specified using Arrhenius chemistry. Good agreement is found when comparing predictions with the experimental data. Also the predicted RMS fluctuations exhibit a double-peak profile with one peak in the burnt and the other in the un-burnt region. The measured and predicted heat release distributions are in qualitative agreement with each other and exhibit the highest values along the inner edge of the shear layer. The precessing vortex core (PVC) is clearly observed in both the non-reacting and reacting cases. However, it appears more axially-elongated for the reacting cases and the oscillations in the PVC are damped with reactions.


title: Numerical Study of Bifurcating Flow through Sudden Expansions: Effect of divergence and geometric asymmetry

abstract: A numerical study of laminar flow through symmetric and slightly asymmetric sudden expansion, of expansion ratio 1:3, in channels with increasing cross section, is carried out using two different approaches - Conventional CFD and Lattice Boltzmann Method. The effect of divergence of walls of the channel, after a sudden expansion, on the symmetry of flow and recirculation is studied for various Reynolds numbers. It is seen that the angles of the walls play an active role in disrupting the symmetry of flow. For non-parallel walls, the symmetry breaking bifurcation phenomenon no longer exists and the loss of symmetry is a gradual process. The effect of asymmetry of geometry on flow is also studied by considering two types of asymmetry - First type is at the plane of expansion where the steps on either side are of unequal heights, while the second one deals the walls of the channel are at a different inclination with the direction of inflow. The present study reveals that small asymmetry impedes the sharp transition and thus smoothens the pitchfork bifurcation. Increased asymmetry finally leads to the unique solution of the governing Equations, indicating complete loss of bifurcation pattern.


title: An Introduction to Fluid Dynamics and Numerical Solution of Shock Tube Problem by Using Roe Solver

abstract: The study of fluids has been a topic of intense research for several hundred years. Over the years, this has further increased due to improved computational facility, which makes it easy to numerically simulate the fluid dynamics, which was beyond the analytical reach before. In this project, we discuss the general transport theorem for moving control volume system, apply this theory to control mass system which gives the continuity equation, and on momentum conservation from which we get the Navier-Stokes equation and energy conservation. By approximating the three equations for the ideal gas flow, we get one dimensional Euler equation. These equations are non-linear, and their analytic solutions are highly non-trivial. We will use Riemann solvers to get the exact solution numerically. In this project, we have considered only the Sod's Shock Tube problem. Finally, we focus on the exact and approximate solution of density, pressure, velocity, entropy, and Mach number using Python code.


title: Effect of Passive flow Control of Bifurcation Phenomenon in Sudden Expansion channel

abstract: In this article we describe, a numerical simulation has been performed for a channel flow with sudden expansion. Different geometric expansion ratios are considered in the current study such as 1:2, 1:3, and 1:4. The bifurcation phenomenon has been investigated for the baseline case and the critical Reynolds number is controlled using a passive modification in the channel. The geometry of sudden expansion channel is modified by introducing a two-dimensional plate along the center line of the channel at the expansion plane. This is one of the passive control techniques, which has been explored in the present study. The computations indicate that the critical Reynolds number of the symmetry-breaking bifurcation increases as the length of the plate increases. An empirical relation has been developed amongst the critical Reynolds number, length of control plates and expansion ratio (h/H). The critical Reynolds number predicted by the empirical relation for different plate lengths are in good agreement with computational results.


title: Notes on cluster algebras and some all-loop Feynman integrals

abstract: We study cluster algebras for some all-loop Feynman integrals, including box-ladder, penta-box-ladder, and (seven-point) double-penta-ladder integrals. In addition to the well-known box ladder whose symbol alphabet is $D_2\simeq A_1^2$, we show that penta-box ladder has an alphabet of $D_3\simeq A_3$ and provide strong evidence that the alphabet of double-penta ladder can be identified with a $D_4$ cluster algebra. We relate the symbol letters to the ${\bf u}$ variables of cluster configuration space, which provide a gauge-invariant description of the cluster algebra, and we find various sub-algebras associated with limits of the integrals. We comment on constraints similar to extended-Steinmann relations or cluster adjacency conditions on cluster function spaces. Our study of the symbol and alphabet is based on the recently proposed Wilson-loop ${\rm d}\log$ representation, which allows us to predict higher-loop alphabet recursively; by applying such recursions to six-dimensional hexagon integrals, we also find $D_5$ and $D_6$ cluster functions for the two-mass-easy and three-mass-easy case, respectively.


title: WawHelioGlow: a model of the heliospheric backscatter glow. I. Model definition

abstract: The helioglow is a fluorescence of interstellar atoms inside the heliosphere, where they are excited by the solar EUV emission. So far, the helioglow of interstellar H and He have been detected. The helioglow features a characteristic distribution in the sky, which can be used to derive both the properties of interstellar neutral gas and those of the solar wind. This requires a simulation model capable of catching with a sufficient realism the essential coupling relations between the solar factors and interstellar. The solar factors include the solar wind flux and its variation with time and heliolatitude, as well as the heliolatitude and time variation of the solar EUV output. The ISN gas inside the heliosphere features a complex distribution function, which varies with time and location. The paper presents the first version of a WawHelioGlow simulation model for the helioglow flux using an optically thin, single scattering approximation. The helioglow computations are based on a sophisticated kinetic treatment of the distribution functions of interstellar H and He provided by the (n)WTPM model. The model takes into account heliolatitudinal and spectral variations of the solar EUV output from observations. We present a formulation of the model and the treatment of the solar spectral flux. The accompanying Paper II illustrates details of the line of sight evolution of the elements of the model and a brief comparison of results of the WawHelioGlow code with selected sky maps of the hydrogen helioglow, obtained by the SWAN instrument onboard the SOHO mission.


title: Separation drag reduction through a spanwise oscillating pressure gradient

abstract: An oscillating spanwise pressure gradient is imposed numerically to control the flow separation and reduce the drag of a turbulent flow in a channel with square bars. The transverse flow produces a maximum drag reduction of 25\%, due to lower pressure and skin-friction drag forces. The pressure drag reduction reaches a maximum of 22\% and is due to a decrease of the positive high pressure in front of the bars and an increase of the low negative pressure behind the bars. The skin-friction drag reduction is caused by a lower wall-shear stress along the cavity between the bars where the flow is fully attached, while the wall-shear stress on the crest of the bars and in the separated region behind the bars is unaffected. The spanwise laminar flow obtained by neglecting the nonlinear terms involving the turbulent velocity fluctuations is used to compute the power spent for oscillating the fluid along the spanwise direction and an excellent agreement is found with the power spent obtained by the averaged turbulent flow. A marginal or negative net power saved is found by subtracting the power employed for controlling the flow from the power saved thanks to the transverse flow. The control reduces the total drag as the integral of the Reynolds stresses along the horizontal line connecting the corners of two consecutive bars is decreased, which in turn impacts on the pressure and wall-shear stress reductions.


title: 6d/5d exceptional gauge theories from web diagrams

abstract: We construct novel web diagrams with a trivalent or quadrivalent gluing for various 6d/5d theories from certain Higgsings of 6d conformal matter theories on a circle. The theories realized on the web diagrams include 5d Kaluza-Klein theories from circle compactifications of the 6d $G_2$ gauge theory with 4 flavors, the 6d $F_4$ gauge theory with 3 flavors, the 6d $E_6$ gauge theory with 4 flavors and the 6d $E_7$ gauge theory with 3 flavors. The Higgsings also give rise to 5d Kaluza-Klein theories from twisted compactifications of 6d theories including the 5d pure SU(3) gauge theory with the Chern-Simons level 9 and the 5d pure SU(4) gauge theory with the Chern-Simons level 8. We also compute the Nekrasov partition functions of the theories by applying the topological vertex formalism to the newly obtained web diagrams.


title: Hardware Acceleration of Fully Quantized BERT for Efficient Natural Language Processing

abstract: BERT is the most recent Transformer-based model that achieves state-of-the-art performance in various NLP tasks. In this paper, we investigate the hardware acceleration of BERT on FPGA for edge computing. To tackle the issue of huge computational complexity and memory footprint, we propose to fully quantize the BERT (FQ-BERT), including weights, activations, softmax, layer normalization, and all the intermediate results. Experiments demonstrate that the FQ-BERT can achieve 7.94x compression for weights with negligible performance loss. We then propose an accelerator tailored for the FQ-BERT and evaluate on Xilinx ZCU102 and ZCU111 FPGA. It can achieve a performance-per-watt of 3.18 fps/W, which is 28.91x and 12.72x over Intel(R) Core(TM) i7-8700 CPU and NVIDIA K80 GPU, respectively.


title: Sober topological spaces valued in a quantale

abstract: The notion of sobriety is extended to the realm of topological spaces valued in a commutative and unital quantale, via an adjunction between a category of quantale modules and the category of quantale-valued topological spaces. Relations between such sober spaces and quantale-valued domains based on flat ideals are investigated.


title: WawHelioGlow: a model of the heliospheric backscatter glow. II. The helioglow buildup and the potential significance of the anisotropy in the solar EUV output

abstract: The helioglow is a fluorescence of interstellar atoms inside the heliosphere, where they are excited by the solar EUV. Because the mean free path between collisions for the interstellar gas is comparable to the size of the heliosphere, the distribution function of this gas inside the heliosphere strongly varies in space and with time and is non-Maxwellian. Coupling between realistically modeled solar factors and the distribution function of interstellar neutral gas is accounted for in a helioglow model that we have developed. WawHelioGlow is presented in the accompanying Paper I. Here, we present the evolution of the gas density, solar illumination, helioglow source function, and other relevant parameters building up the helioglow signal for selected lines of sight observed at 1 au. We compare these elements for various phases of the solar cycle and we present the sensitivity of the results to heliolatitudinal anisotropy of the solar EUV output. We assume a realistic latitudinal anisotropy of the solar wind flux using results from analysis of interplanetary scintillations. We compare the simulated helioglow with with selected maps observed by the SOHO/SWAN instrument. We demonstrate that WawHelioGlow is able to reproduce fundamental features of the sky distribution of the helioglow. For some phases of the solar cycle, the model with an anisotropy of the solar EUV output better reproduces the observations, while for other phases no EUV anisotropy is needed. In all simulated cases, the solar wind anisotropy following insight from interplanetary scintillation measurements is present.


title: Robust Pairwise n-Person Stochastic Duel Game

abstract: This paper is dealing with another multiple person game model under the antagonistic duel type setup. The most flexible multiple person duel game is analytically solved and the explicit formulas are solved to determine the time dependent duel game model by using the first exceed theory. Unlike conventional two-person duel game, multiple battle fields are introduced in the paper and each battle field becomes shooting ground of pairwise players. This model is targeted for real-world situations especially for selected target shooting scenarios. An analogue of the theory in the paper is designed for solving the best shooting time within multiple battle fields. This new proposed model is fully mathematically explained to be adapted in various domains including the strategies and operations.


title: Detecting and modelling real percolation and phase transitions of information on social media

abstract: It is widely believed that information spread on social media is a percolation process, with parallels to phase transitions in theoretical physics. However, evidence for this hypothesis is limited, as phase transitions have not been directly observed in any social media. Here, through analysis of 100 million Weibo and 40 million Twitter users, we identify percolation-like spread, and find that it happens more readily than current theoretical models would predict. The lower percolation threshold can be explained by the existence of positive feedback in the coevolution between network structure and user activity level, such that more active users gain more followers. Moreover, this coevolution induces an extreme imbalance in users' influence. Our findings indicate that the ability of information to spread across social networks is higher than expected, with implications for many information spread problems.


title: When Face Recognition Meets Occlusion: A New Benchmark

abstract: The existing face recognition datasets usually lack occlusion samples, which hinders the development of face recognition. Especially during the COVID-19 coronavirus epidemic, wearing a mask has become an effective means of preventing the virus spread. Traditional CNN-based face recognition models trained on existing datasets are almost ineffective for heavy occlusion. To this end, we pioneer a simulated occlusion face recognition dataset. In particular, we first collect a variety of glasses and masks as occlusion, and randomly combine the occlusion attributes (occlusion objects, textures,and colors) to achieve a large number of more realistic occlusion types. We then cover them in the proper position of the face image with the normal occlusion habit. Furthermore, we reasonably combine original normal face images and occluded face images to form our final dataset, termed as Webface-OCC. It covers 804,704 face images of 10,575 subjects, with diverse occlusion types to ensure its diversity and stability. Extensive experiments on public datasets show that the ArcFace retrained by our dataset significantly outperforms the state-of-the-arts. Webface-OCC is available at https://github.com/Baojin-Huang/Webface-OCC.


title: A Planner-Trader Decomposition for Multi-Market Hydro Scheduling

abstract: Peak/off-peak spreads on European electricity forward and spot markets are eroding due to the ongoing nuclear phaseout in Germany and the steady growth in photovoltaic capacity. The reduced profitability of peak/off-peak arbitrage forces hydropower producers to recover part of their original profitability on the reserve markets. We propose a bi-layer stochastic programming framework for the optimal operation of a fleet of interconnected hydropower plants that sells energy on both the spot and the reserve markets. The outer layer (the planner's problem) optimizes end-of-day reservoir filling levels over one year, whereas the inner layer (the trader's problem) selects optimal hourly market bids within each day. Using an information restriction whereby the planner prescribes the end-of-day reservoir targets one day in advance, we prove that the trader's problem simplifies from an infinite-dimensional stochastic program with 25 stages to a finite two-stage stochastic program with only two scenarios. Substituting this reformulation back into the outer layer and approximating the reservoir targets by affine decision rules allows us to simplify the planner's problem from an infinite-dimensional stochastic program with 365 stages to a two-stage stochastic program that can conveniently be solved via the sample average approximation. Numerical experiments based on a cascade in the Salzburg region of Austria demonstrate the effectiveness of the suggested framework.


title: Flow over an espresso cup: Inferring 3D velocity and pressure fields from tomographic background oriented schlieren videos via physics-informed neural networks

abstract: Tomographic background oriented schlieren (Tomo-BOS) imaging measures density or temperature fields in 3D using multiple camera BOS projections, and is particularly useful for instantaneous flow visualizations of complex fluid dynamics problems. We propose a new method based on physics-informed neural networks (PINNs) to infer the full continuous 3D velocity and pressure fields from snapshots of 3D temperature fields obtained by Tomo-BOS imaging. PINNs seamlessly integrate the underlying physics of the observed fluid flow and the visualization data, hence enabling the inference of latent quantities using limited experimental data. In this hidden fluid mechanics paradigm, we train the neural network by minimizing a loss function composed of a data mismatch term and residual terms associated with the coupled Navier-Stokes and heat transfer equations. We first quantify the accuracy of the proposed method based on a 2D synthetic data set for buoyancy-driven flow, and subsequently apply it to the Tomo-BOS data set, where we are able to infer the instantaneous velocity and pressure fields of the flow over an espresso cup based only on the temperature field provided by the Tomo-BOS imaging. Moreover, we conduct an independent PIV experiment to validate the PINN inference for the unsteady velocity field at a center plane. To explain the observed flow physics, we also perform systematic PINN simulations at different Reynolds and Richardson numbers and quantify the variations in velocity and pressure fields. The results in this paper indicate that the proposed deep learning technique can become a promising direction in experimental fluid mechanics.


title: Unsupervised Domain Adaptation for Image Classification via Structure-Conditioned Adversarial Learning

abstract: Unsupervised domain adaptation (UDA) typically carries out knowledge transfer from a label-rich source domain to an unlabeled target domain by adversarial learning. In principle, existing UDA approaches mainly focus on the global distribution alignment between domains while ignoring the intrinsic local distribution properties. Motivated by this observation, we propose an end-to-end structure-conditioned adversarial learning scheme (SCAL) that is able to preserve the intra-class compactness during domain distribution alignment. By using local structures as structure-aware conditions, the proposed scheme is implemented in a structure-conditioned adversarial learning pipeline. The above learning procedure is iteratively performed by alternating between local structures establishment and structure-conditioned adversarial learning. Experimental results demonstrate the effectiveness of the proposed scheme in UDA scenarios.


title: Identification of new isomers in $^{228}$Ac : Impact on dark matter searches

abstract: We report the identification of metastable isomeric states of $^{228}$Ac at 6.28 keV, 6.67 keV and 20.19 keV, with lifetimes of an order of 100 ns. These states are produced by the $\beta$-decay of $^{228}$Ra, a component of the $^{232}$Th decay chain, with $\beta$ Q-values of 39.52 keV, 39.13 keV and 25.61 keV, respectively. Due to its low Q-value as well as the relative abundance of $^{232}$Th and their progeny in low background experiments, these observations potentially impact the low-energy background modeling of dark matter search experiments.


title: Weak coupling limits for directed polymers in tube environments

abstract: In this paper, we study a model of directed polymers in random environment, where the environment is restricted to a time-space tube whose spatial width grows polynomially with time. It can be viewed as an interpolation between the disordered pinning model and the classic directed polymer model. We prove weak coupling limits for the directed polymer partition functions in such tube environments in all dimensions, as the inverse temperature vanishes at a suitable rate. As the tube width varies, transitions between regimes of disorder irrelevance, marginal relevance and disorder relevance are observed.


title: Physics-informed Neural Networks for Elliptic Partial Differential Equations on 3D Manifolds

abstract: Motivated by recent research on Physics-Informed Neural Networks (PINNs), we make the first attempt to introduce the PINNs for numerical simulation of the elliptic Partial Differential Equations (PDEs) on 3D manifolds. PINNs are one of the deep learning-based techniques. Based on the data and physical models, PINNs introduce the standard feedforward neural networks (NNs) to approximate the solutions to the PDE systems. By using automatic differentiation, the PDEs system could be explicitly encoded into NNs and consequently, the sum of mean squared residuals from PDEs could be minimized with respect to the NN parameters. In this study, the residual in the loss function could be constructed validly by using the automatic differentiation because of the relationship between the surface differential operators $\nabla_S/\Delta_S$ and the standard Euclidean differential operators $\nabla/\Delta$. We first consider the unit sphere as surface to investigate the numerical accuracy and convergence of the PINNs with different training example sizes and the depth of the NNs. Another examples are provided with different complex manifolds to verify the robustness of the PINNs.