title: Learning to Associate Every Segment for Video Panoptic Segmentation

abstract: Temporal correspondence - linking pixels or objects across frames - is a fundamental supervisory signal for the video models. For the panoptic understanding of dynamic scenes, we further extend this concept to every segment. Specifically, we aim to learn coarse segment-level matching and fine pixel-level matching together. We implement this idea by designing two novel learning objectives. To validate our proposals, we adopt a deep siamese model and train the model to learn the temporal correspondence on two different levels (i.e., segment and pixel) along with the target task. At inference time, the model processes each frame independently without any extra computation and post-processing. We show that our per-frame inference model can achieve new state-of-the-art results on Cityscapes-VPS and VIPER datasets. Moreover, due to its high efficiency, the model runs in a fraction of time (3x) compared to the previous state-of-the-art approach.


title: SRG/eROSITA discovery of a large circular SNR candidate G116.6-26.1: SN Ia explosion probing the gas of the Milky Way halo?

abstract: We report a discovery of a new X-ray-selected supernova remnant (SNR) candidate SRGe~J0023+3625 = G116.6-26.1 found in the SRG/eROSITA all-sky survey. The source features a large angular extent ($\sim 4$ deg in diameter), nearly circular shape and X-ray spectrum dominated by emission lines of helium- and hydrogen-like oxygen. It lacks bright counterparts of similar extent at other wavelengths which could be unequivocally associated with it. Given the relatively high Galactic latitude of the source, $b\approx-26$ deg, we interpret these observational properties as an indication of the off-disk location of this SNR candidate. Namely, we propose that this object originated from a Type Ia supernova which exploded some 40 000 yr ago in the low density ($\sim 10^{-3}\,{\rm cm^{-3}}$) and hot ($\sim (1-2)\times10^6\,{\rm K}$) gas of the Milky Way halo at a distance of $\sim 3\,{\rm kpc}$ from the Sun. The low density of the halo gas implies that the cooling and collisional ionization equilibrium (CEI) timescales downstream of the forward shock are much longer than the age of the SNR. This results in a relatively soft spectrum, reflecting pre-shock ionization state of the gas, and strong boost in the plasma emissivity (compared to CEI) due to enhanced collisional excitation through the increased electron temperature. If confirmed, such a rare object would provide us with a unique "in situ" probe of physical conditions (density, temperature and metallicity) near the interface between the Milky Way's disk and the halo.


title: Conference proceedings KI4Industry AI for SMEs -- The online congress for practical entry into AI for SMEs

abstract: The Institute of Materials and Processes, IMP, of the University of Applied Sciences in Karlsruhe, Germany in cooperation with VDI Verein Deutscher Ingenieure e.V, AEN Automotive Engineering Network and their cooperation partners present their competences of AI-based solution approaches in the production engineering field. The online congress KI 4 Industry on November 12 and 13, 2020, showed what opportunities the use of artificial intelligence offers for medium-sized manufacturing companies, SMEs, and where potential fields of application lie. The main purpose of KI 4 Industry is to increase the transfer of knowledge, research and technology from universities to small and medium-sized enterprises, to demystify the term AI and to encourage companies to use AI-based solutions in their own value chain or in their products.


title: Coupled Micro-Doppler Signatures of Closely Located Targets

abstract: The classical Doppler shift originates from the movement of a target's center of mass, but it does not hold information about the internal dynamics of the scattering object. In contrast, micro-Doppler signatures contain data about the micro-motions that arise from internal degrees of freedom within the target (such as rotation and vibration), which can be remotely detected by careful analysis of the scattered field. Here we investigate, both theoretically and experimentally, how coupling between a pair of closely situated targets affects the resulting micro-Doppler signatures. The presented model considers a pair of near-field coupled resonators with dynamically reconfigurable scattering properties. Voltage controlled varactor diodes enable modulating the scattering cross-section of each target independently, mimicking rotational degrees of freedom. As a result, coupled micro-Doppler combs are observed, containing new frequency components that arise from the near field coupling, making it possible to extract information about the internal geometry of the system from far-field measurements. From a practical point of view, micro-Doppler spectroscopy allows remote classification of distant objects, while deep understanding of the coupling effects on such signatures in the low frequency regime can provide valuable insight for radar and sonar systems, as well as optical and stellar radio-interferometry, among many others.


title: 8 x 8 Terahertz Photoconductive Antenna Array and Parallelized Signal Acquisition System for Fast Spatially Resolved Time Domain Spectroscopy

abstract: Terahertz (THz) technology is promising in several applications such as imaging, spectroscopy and communications. Among several methods in the generation and detection of THz waves, a THz time domain system (TDS) that is developed using photoconductive antennas (PCA) as emitter and detector presents several advantages such as simple alignment, low cost, high performance etc. In this work, we report the design, fabrication and characterization of a 2-D PCA array that is capable of detecting both the amplitude and phase of the THz pulse. The PCA array is fabricated using LT-GaAs and has 8 channels with 64 pixels (8x8). The infrared probe beam is steered and focused towards each pixel of the PCA array using a spatial light modulator (SLM). The measured photocurrent (amplitude and phase) from each channel is recorded separately and the frequencies up to 1.4 THz can be detected. Furthermore, the parameters such as directional time delay of the THz pulse, crosstalk between the channels etc., were characterized. Finally, we show that the proposed 2D PCA array design is flexible and can be used for accelerated THz spectral image acquisition.


title: Broadband resonant calibration-free complex permittivity retrieval of liquid solutions

abstract: Material susceptibilities govern interactions between electromagnetic waves and matter and are of a crucial importance for basic understanding of natural phenomena and for tailoring practical applications. Here we present a new calibration-free method for relative complex permittivity retrieval, which allows using accessible and cheap apparatus and simplifies the measurement process. The method combines advantages of resonant and non-resonant techniques, allowing to extract parameters of liquids and solids in a broad frequency range, where material's loss tangent is less than 0.5. The essence of the method is based on exciting magnetic dipole resonance in a spherical sample with variable dimensions. Size-dependent resonant frequencies and quality factors of magnetic dipolar modes are mapped on real and imaginary parts of permittivity by employing Mie theory. Samples are comprised of liquid solutions, enclosed in stretchable covers, which allows changing the dimensions continuously. This approach allows tuning magnetic dipolar resonance over a wide frequency range, effectively making resonance retrieval method broadband. The technique can be extended to powder and solid materials, depending on their physical parameters, such as granularity and processability.


title: Attosecond spectroscopy of size-resolved water clusters

abstract: Electron dynamics in water are of fundamental importance for a broad range of phenomena, but their real-time study faces numerous conceptual and methodological challenges. Here, we introduce attosecond size-resolved cluster spectroscopy and build up a molecular-level understanding of the attosecond electron dynamics in water. We measure the effect that the addition of single water molecules has on the photoionization time delays of water clusters. We find a continuous increase of the delay for clusters containing up to 4-5 molecules and little change towards larger clusters. We show that these delays are proportional to the spatial extension of the created electron hole, which first increases with cluster size and then partially localizes through the onset of structural disorder that is characteristic of large clusters and bulk liquid water. These results establish a previously unknown sensitivity of photoionization delays to electron-hole delocalization and reveal a direct link between electronic structure and attosecond photoemission dynamics. Our results offer novel perspectives for studying electron/hole delocalization and its attosecond dynamics.


title: DravidianCodeMix: Sentiment Analysis and Offensive Language Identification Dataset for Dravidian Languages in Code-Mixed Text

abstract: This paper describes the development of a multilingual, manually annotated dataset for three under-resourced Dravidian languages generated from social media comments. The dataset was annotated for sentiment analysis and offensive language identification for a total of more than 60,000 YouTube comments. The dataset consists of around 44,000 comments in Tamil-English, around 7,000 comments in Kannada-English, and around 20,000 comments in Malayalam-English. The data was manually annotated by volunteer annotators and has a high inter-annotator agreement in Krippendorff's alpha. The dataset contains all types of code-mixing phenomena since it comprises user-generated content from a multilingual country. We also present baseline experiments to establish benchmarks on the dataset using machine learning methods. The dataset is available on Github (https://github.com/bharathichezhiyan/DravidianCodeMix-Dataset) and Zenodo (https://zenodo.org/record/4750858\#.YJtw0SYo\_0M).


title: Modelling resource allocation in uncertain system environment through deep reinforcement learning

abstract: Reinforcement Learning has applications in field of mechatronics, robotics, and other resource-constrained control system. Problem of resource allocation is primarily solved using traditional predefined techniques and modern deep learning methods. The drawback of predefined and most deep learning methods for resource allocation is failing to meet the requirements in cases of uncertain system environment. We can approach problem of resource allocation in uncertain system environment alongside following certain criteria using deep reinforcement learning. Also, reinforcement learning has ability for adapting to new uncertain environment for prolonged period of time. The paper provides a detailed comparative analysis on various deep reinforcement learning methods by applying different components to modify architecture of reinforcement learning with use of noisy layers, prioritized replay, bagging, duelling networks, and other related combination to obtain improvement in terms of performance and reduction of computational cost. The paper identifies problem of resource allocation in uncertain environment could be effectively solved using Noisy Bagging duelling double deep Q network achieving efficiency of 97.7% by maximizing reward with significant exploration in given simulated environment for resource allocation.


title: pysentimiento: A Python Toolkit for Opinion Mining and Social NLP tasks

abstract: In recent years, the extraction of opinions and information from user-generated text has attracted a lot of interest, largely due to the unprecedented volume of content in Social Media. However, social researchers face some issues in adopting cutting-edge tools for these tasks, as they are usually behind commercial APIs, unavailable for other languages than English, or very complex to use for non-experts. To address these issues, we present pysentimiento, a comprehensive multilingual Python toolkit designed for opinion mining and other Social NLP tasks. This open-source library brings state-of-the-art models for Spanish, English, Italian, and Portuguese in an easy-to-use Python library, allowing researchers to leverage these techniques. We present a comprehensive assessment of performance for several pre-trained language models across a variety of tasks, languages, and datasets, including an evaluation of fairness in the results.


title: Lepton mass effects in exclusive semileptonic $B_c$-meson decays

abstract: In this work, we discuss exclusive semileptonic $B_c$-meson decays: $B_c\to \eta_c(J/\psi)l\nu$ and $B_c\to D(D^*)l\nu$ in the framework of the relativistic independent quark(RIQ) model based on an average flavor independent confining potential in equally mixed scalar-vector harmonic form. We calculate the invariant form factors representing decay amplitudes from the overlapping integrals of meson wave functions derivable in the RIQ model. To evaluate the lepton mass effects in the semileptonic decays, we first study the $q^2$-dependence of the form factors in the accessible kinematic range of $q^2$ involved in the decay process in its $e^-$ and $\tau^-$ mode separately. Similar studies on helicity amplitudes, $q^2-$spectra for different helicity contributions, and total $q^2$-spectra for each decay process are carried out separately in their $e^-$ and $\tau^-$ modes. We predict the decay rates/ branching fractions, forward-backward asymmetry, and the asymmetry parameter in reasonable agreement with other model predictions, which can hopefully be tested in future experiments at the Tevatron and LHC. We also predict the observable $'R'$ which corresponds to the ratio of branching fractions for the decay process in its $e^-$ mode to its corresponding value in the $\tau^-$ mode. Our results are comparable to another standard model(SM) predictions which highlight the failure of the lepton flavor universality hinting at new physics beyond SM for the explanation of the observed deviation of observable $'R'$ value from the corresponding SM predictions.


title: Free space optical communication receiver based on a spatial demultiplexer and a photonic integrated coherent combining circuit

abstract: Atmospheric turbulences can generate scintillation or beam wandering phenomena that impairs free space optical (FSO) communication. In this paper, we propose and demonstrate a proof-of-concept FSO communication receiver based on a spatial demultiplexer and a photonic integrated circuit coherent combiner. The system collects the light from several Hermite Gauss spatial modes and coherently combine on chip the energy from the different modes into a single output. The FSO receiver is characterized with a wavefront emulator bench that generates arbitrary phase and intensity patterns. The multimode receiver presents a strong resilience to wavefront distortions, compared to a monomode FSO receiver. The system is then used to detect a modulation of the optical beam through a random wavefront profile.


title: Comprehensive analysis of optimized near-field tandem thermophotovoltaic system

abstract: It is well known that performance of a thermophotovoltaic (TPV) device can be enhanced if the vacuum gap between the thermal emitter and the TPV cell becomes nanoscale due to the photon tunneling of evanescent waves. Having multiple bandgaps, multi-junction TPV cells have received attention as an alternative way to improve its performance by selectively absorbing the spectral radiation in each subcell. In this work, we comprehensively analyze the optimized near-field tandem TPV system consisting of the thin-ITO-covered tungsten emitter (at 1500 K) and GaInAsSb/InAs monolithic interconnected tandem TPV cell (at 300 K). We develop a simulation model by coupling the near-field radiation solved by fluctuational electrodynamics and the diffusion-recombination-based charge transport equations. The optimal configuration of the near-field tandem TPV system obtained by the genetic algorithm achieves the electrical power output of 8.41 W/cm$^2$ and the conversion efficiency of 35.6\% at the vacuum gap of 100 nm. We show that two resonance modes (i.e., surface plasmon polaritons supported by the ITO-vacuum interface and the confined waveguide mode in the tandem TPV cell) greatly contribute to the enhanced performance of the optimized system. We also show that the near-field tandem TPV system is superior to the single-cell-based near-field TPV system in both power output and conversion efficiency through loss analysis. Interestingly, the optimization performed with the objective function of the conversion efficiency leads to the current matching condition for the tandem TPV system regardless of the vacuum gap distances.


title: A Rigorous Derivation of the Functional Renormalisation Group Equation

abstract: The functional renormalisation group equation is derived in a mathematically rigorous fashion in a framework suitable for the Osterwalder-Schrader formulation of quantum field theory. To this end, we devise a very general regularisation scheme which retains reflection positivity as well as the infinite degrees of freedom including smoothness. Furthermore, it is shown how the classical limit is altered by the regularisation process leading to an inevitable breaking of translation invariance. We also give precise conditions for the convergence of the obtained theories upon removal of the regularisation.


title: Algorithmic Bias and Data Bias: Understanding the Relation between Distributionally Robust Optimization and Data Curation

abstract: Machine learning systems based on minimizing average error have been shown to perform inconsistently across notable subsets of the data, which is not exposed by a low average error for the entire dataset. In consequential social and economic applications, where data represent people, this can lead to discrimination of underrepresented gender and ethnic groups. Given the importance of bias mitigation in machine learning, the topic leads to contentious debates on how to ensure fairness in practice (data bias versus algorithmic bias). Distributionally Robust Optimization (DRO) seemingly addresses this problem by minimizing the worst expected risk across subpopulations. We establish theoretical results that clarify the relation between DRO and the optimization of the same loss averaged on an adequately weighted training dataset. The results cover finite and infinite number of training distributions, as well as convex and non-convex loss functions. We show that neither DRO nor curating the training set should be construed as a complete solution for bias mitigation: in the same way that there is no universally robust training set, there is no universal way to setup a DRO problem and ensure a socially acceptable set of results. We then leverage these insights to provide a mininal set of practical recommendations for addressing bias with DRO. Finally, we discuss ramifications of our results in other related applications of DRO, using an example of adversarial robustness. Our results show that there is merit to both the algorithm-focused and the data-focused side of the bias debate, as long as arguments in favor of these positions are precisely qualified and backed by relevant mathematics known today.


title: Vertex-regular $1$-factorizations in infinite graphs

abstract: The existence of $1$-factorizations of an infinite complete equipartite graph $K_m[n]$ (with $m$ parts of size $n$) admitting a vertex-regular automorphism group $G$ is known only when $n=1$ and $m$ is countable (that is, for countable complete graphs) and, in addition, $G$ is a finitely generated abelian group $G$ of order $m$. In this paper, we show that a vertex-regular $1$-factorization of $K_m[n]$ under the group $G$ exists if and only if $G$ has a subgroup $H$ of order $n$ whose index in $G$ is $m$. Furthermore, we provide a sufficient condition for an infinite Cayley graph to have a regular $1$-factorization. Finally, we construct 1-factorizations that contain a given subfactorization, both having a vertex-regular automorphism group.


title: A posteriori estimator for the adaptive solution of a quasi-static fracture phase-field model with irreversibility constraints

abstract: Within this article, we develop a residual type a posteriori error estimator for a time discrete quasi-static phase-field fracture model. Particular emphasize is given to the robustness of the error estimator for the variational inequality governing the phase-field evolution with respect to the phase-field regularization parameter $\epsilon$. The article concludes with numerical examples highlighting the performance of the proposed a posteriori error estimators on three standard test cases; the single edge notched tension and shear test as well as the L-shaped panel test.


title: SNAP microwave optical filters

abstract: If the originally flat bottom of a wide quantum well with multiple eigenstates is periodically modulated, its eigenvalues rearrange into denser groups separated by wider gaps. We show that this effect, if implemented in an elongated bottle microresonator (also called a SNAP microresonator) allows to design microwave photonic tunable filters with an outstanding performance.


title: A skeleton model to enumerate standard puzzle sequences

abstract: Guo-Niu Han [arXiv:2006.14070 [math.CO]] has introduced a new combinatorial object named standard puzzle. We use digraphs to show the relations between numbers in standard puzzles and propose a skeleton model. By this model, we solve the enumeration problem of over fifty thousand standard puzzle sequences. Most of them can be represented by classical numbers, such as Catalan numbers, double factorials, Secant numbers and so on. Also, we prove several identities in standard puzzle sequences.


title: Ultra-high bandwidth fiber-optic data transmission with a single chip source

abstract: We report world record high data transmission over standard optical fiber from a single optical source. We achieve a line rate of 44.2 Terabits per second (Tb/s) employing only the C-band at 1550nm, resulting in a spectral efficiency of 10.4 bits/s/Hz. We use a new and powerful class of micro-comb called soliton crystals that exhibit robust operation and stable generation as well as a high intrinsic efficiency that, together with an extremely low spacing of 48.9 GHz enables a very high coherent data modulation format of 64 QAM. We achieve error free transmission across 75 km of standard optical fiber in the lab and over a field trial with a metropolitan optical fiber network. This work demonstrates the ability of optical micro-combs to exceed other approaches in performance for the most demanding practical optical communications applications.


title: Importance measures derived from random forests: characterisation and extension

abstract: Nowadays new technologies, and especially artificial intelligence, are more and more established in our society. Big data analysis and machine learning, two sub-fields of artificial intelligence, are at the core of many recent breakthroughs in many application fields (e.g., medicine, communication, finance, ...), including some that are strongly related to our day-to-day life (e.g., social networks, computers, smartphones, ...). In machine learning, significant improvements are usually achieved at the price of an increasing computational complexity and thanks to bigger datasets. Currently, cutting-edge models built by the most advanced machine learning algorithms typically became simultaneously very efficient and profitable but also extremely complex. Their complexity is to such an extent that these models are commonly seen as black-boxes providing a prediction or a decision which can not be interpreted or justified. Nevertheless, whether these models are used autonomously or as a simple decision-making support tool, they are already being used in machine learning applications where health and human life are at stake. Therefore, it appears to be an obvious necessity not to blindly believe everything coming out of those models without a detailed understanding of their predictions or decisions. Accordingly, this thesis aims at improving the interpretability of models built by a specific family of machine learning algorithms, the so-called tree-based methods. Several mechanisms have been proposed to interpret these models and we aim along this thesis to improve their understanding, study their properties, and define their limitations.


title: Optimising simulations for diphoton production at hadron colliders using amplitude neural networks

abstract: Machine learning technology has the potential to dramatically optimise event generation and simulations. We continue to investigate the use of neural networks to approximate matrix elements for high-multiplicity scattering processes. We focus on the case of loop-induced diphoton production through gluon fusion and develop a realistic simulation method that can be applied to hadron collider observables. Neural networks are trained using the one-loop amplitudes implemented in the NJet C++ library and interfaced to the Sherpa Monte Carlo event generator where we perform a detailed study for $2\to3$ and $2\to4$ scattering problems. We also consider how the trained networks perform when varying the kinematic cuts effecting the phase space and the reliability of the neural network simulations.


title: Backward Gradient Normalization in Deep Neural Networks

abstract: We introduce a new technique for gradient normalization during neural network training. The gradients are rescaled during the backward pass using normalization layers introduced at certain points within the network architecture. These normalization nodes do not affect forward activity propagation, but modify backpropagation equations to permit a well-scaled gradient flow that reaches the deepest network layers without experimenting vanishing or explosion. Results on tests with very deep neural networks show that the new technique can do an effective control of the gradient norm, allowing the update of weights in the deepest layers and improving network accuracy on several experimental conditions.


title: Efficient and compact thermo-optic phase shifter in silicon-rich silicon nitride

abstract: The design, fabrication, and characterization of low loss ultra-compact bends in high index (n = 3.1 at {\lambda} = 1550 nm) PECVD silicon rich silicon nitride (SRN) is demonstrated and utilized to realize efficient, small footprint thermo-optic phase shifter. Compact bends are structured into a folded waveguide geometry to form a rectangular spiral within an area of 65 x 65 \mum2 possessing a total active waveguide length of 1.2 mm. The device features a phase shifting efficiency of 8 mW/{\pi} and a 3 dB switching bandwidth of 15 KHz. We propose SRN as a promising thermo-optic platform combining the properties of silicon and silicon stoichiometric nitride


title: Concept of miniature optical pressure sensor based on coupled WGMs in a dielectric microsphere

abstract: We present the physical concept and sample engineering design of a new miniature pressure sensor based on the whispering gallery modes (WGMs) optically excited in a dielectric microsphere placed near a flexible reflective membrane which acts as an ambient pressure sensing element. WGMs excitation is carried out by free-space coupling of optical radiation to a microsphere. The distinctive feature of proposed sensor design is double excitation of optical eigenmodes by forward and backward propagating radiation reflected from a membrane that causes WGMs interference in particle volume. The optical intensity of resulting resonant field established in the microsphere carries information about the exact position of the pressure-loaded reflecting membrane. The sensitivity of the proposed sensor strongly depends on the quality factor of the excited resonant mode, as well as geometrical and mechanical parameters of the flexible membrane. Important advantages of the proposed sensor are miniature design (linear sensor dimensions depends only on the membrane diameter) and the absence of a mechanical contact of pressure-sensitive element with WGM resonator.


title: On the Independence of Electromagnetism and Gravitation from Test Bodies Physical Properties

abstract: Does a physical field exist independently of the interaction between the field source and the test body used to measure it at a given point? What does propagate between two physical bodies when they interact? These are the fundamental questions we answer in the present work for electromagnetic and gravitational interactions. We come to the conclusion that gravitational fields as well as spacetime curvature cannot depend on the passive-gravitational to inertial mass ratio of the test bodies, because this would lead to energy conservation and causality violation except when this ratio is universally exactly equal to one. For what concerns the hypothetical dependence of electromagnetic fields on the charge to inertial-mass ratio of test bodies, this would call for the propagation of an operationally ill defined quantity (Coulomb . Meter$^2$ / Second$^2$) that would replace energy (Joule = Kilogram . Meter$^2$ / Second$^2$) transfer in the interaction between two electrically charged bodies. Hence electromagnetic fields cannot depend on the charge to inertial-mass ratio of test bodies. A consequence of these results is also the disqualification of Murat Ozer's unification theory of gravitation and electromagnetism.


title: Reply to "Comment on 'Dr. Bertlmann's Socks in a Quaternionic World of Ambidextral Reality'"

abstract: In this paper, I respond to a critique of one of my papers previously published in this journal, entitled `Dr. Bertlmann's socks in a quaternionic world of ambidextral reality.' The geometrical framework presented in my paper is based on a quaternionic 3-sphere, or S^3, taken as a model of the physical space in which we are inescapably confined to perform all our experiments. The framework intrinsically circumvents Bell's theorem by reproducing the singlet correlations local-realistically, without resorting to backward causation, superdeterminism, or any other conspiracy loophole. In this response, I demonstrate point by point that, contrary to its claims, the critique has not found any mistakes in my paper, either in the analytical model of the singlet correlations or in its event-by-event numerical simulation based on Geometric Algebra.


title: Jarzynski Equality Counterexample?

abstract: Almost 25 years ago, Jarzynski published a paper in which it was asserted: the work done, W, in driving a system from state A to state B, characterized by the Helmholtz free energies FA and FB, satisfies an equality in which an average over an ensemble of measurements for W determines the difference in Free energy. Several features of this result require more detailed description, to be given in the text. The equality is significant and unexpected. So is the statement that the equality is independent of the rate of change from state A to state B. A few years ago, I had presented three papers in which the contraction of the description from full phase space to coordinate space only was made. This was motivated by the large difference in time scales for momenta relaxation and coordinate relaxation. The Jarzynski equality (JE) will be shown here to be correct only in the limit of extremely slow processes. The proposed counterexample is for a macromolecular harmonic oscillator with a Hooke's spring constant, k, that during the time interval linearly changes from k1 to k2. When performed very slowly, we obtain JE in a form in which the free energy is related to the ratio of the k's. However, when the transition is performed more rapidly the equality is lost. Jarzynski has suggested to me that Hummer and Szabo have shown that JE follows directly from the Feynman-Kac formula. We show here that F-K does not reproduce the direct calculation executed in this paper and that it has been misapplied in earlier papers.


title: Stochastic Bias-Reduced Gradient Methods

abstract: We develop a new primitive for stochastic optimization: a low-bias, low-cost estimator of the minimizer $x_\star$ of any Lipschitz strongly-convex function. In particular, we use a multilevel Monte-Carlo approach due to Blanchet and Glynn to turn any optimal stochastic gradient method into an estimator of $x_\star$ with bias $\delta$, variance $O(\log(1/\delta))$, and an expected sampling cost of $O(\log(1/\delta))$ stochastic gradient evaluations. As an immediate consequence, we obtain cheap and nearly unbiased gradient estimators for the Moreau-Yoshida envelope of any Lipschitz convex function, allowing us to perform dimension-free randomized smoothing. We demonstrate the potential of our estimator through four applications. First, we develop a method for minimizing the maximum of $N$ functions, improving on recent results and matching a lower bound up to logarithmic factors. Second and third, we recover state-of-the-art rates for projection-efficient and gradient-efficient optimization using simple algorithms with a transparent analysis. Finally, we show that an improved version of our estimator would yield a nearly linear-time, optimal-utility, differentially-private non-smooth stochastic optimization method.


title: Elicitation of Adaptive Requirements Using Creativity Triggers: A Controlled Experiment

abstract: Adaptive systems react to changes in their environment by changing their behavior. Identifying these needed adaptations is very difficult, but central to requirements elicitation for adaptive systems. As the necessary or potential adaptations are typically not obvious to the stakeholders, the problem is how to effectively elicit adaptation-relevant information. One approach is to use creativity techniques to support the systematic identification and elicitation of adaptation requirements. In particular, here, we analyze a set of creativity triggers defined for systematic exploration of potential adaptation requirements. We compare these triggers with brainstorming as a baseline in a controlled experiment with 85 master students. The results indicate that the proposed triggers are suitable for the efficient elicitation of adaptive requirements and that the 15 trigger questions produce significantly more requirements fragments than solo brainstorming.


title: Fundamental formalism of statistical mechanics and thermodynamics of negative kinetic energy systems

abstract: The solutions of a particle's Dirac equation contains a negative kinetic energy (NKE) branch. Such an energy spectrum has an upper limit but no lower limit, so that the system with this spectrum, called NKE system, is of negative temperature. Fundamental formulas of statistical mechanics and thermodynamics of NKE systems are presented. All the formulas have the same forms of those of positive kinetic energy (PKE) systems. Almost all thermodynamic quantities, except entropy and specific heat, have a contrary sign compared to those of PKE systems. Specially, pressure is negative and its microscopic mechanism is given. Entropy is always positive and Boltzmann entropy formula remains valid. The three laws of thermodynamics remain valid, as long as the thermodynamic quantities have a negative sign. Negative temperature Carnot engine can work between two negative temperatures. Since the NKE levels need not be fully filled, it is argued that the concept of Dirac's Fermion Sea can be totally abandoned.


title: Investigations of the linear and non-linear flow harmonics using the A Multi-Phase Transport model

abstract: The Multi-Phase Transport model (AMPT) is used to study the effects of the parton-scattering cross-sections ($\sigma_{pp}$) and hadronic re-scattering on the linear contributions to the flow harmonic $\textit{v}_{4}$, the non-linear response coefficients, and the correlations between different order flow symmetry planes in Au+Au collisions at 200~GeV. The model results, which agree with current experimental measurements, indicate that the higher-order flow harmonics are sensitive to the $\sigma_{pp}$ variations. However, the non-linear response coefficients and the correlations between different order flow symmetry planes are $\sigma_{pp}$ independent. These results suggest that further detailed experimental measurements which span a broad range of collision systems and beam energies could serve as an additional constraint for the theoretical models' calculations.


title: Secure Multi-Function Computation with Private Remote Sources

abstract: We consider a distributed function computation problem in which parties observing noisy versions of a remote source facilitate the computation of a function of their observations at a fusion center through public communication. The distributed function computation is subject to constraints, including not only reliability and storage but also privacy and secrecy. Specifically, 1) the remote source should remain private from an eavesdropper and the fusion center, measured in terms of the information leaked about the remote source; 2) the function computed should remain secret from the eavesdropper, measured in terms of the information leaked about the arguments of the function, to ensure secrecy regardless of the exact function used. We derive the exact rate regions for lossless and lossy single-function computation and illustrate the lossy single-function computation rate region for an information bottleneck example, in which the optimal auxiliary random variables are characterized for binary-input symmetric-output channels. We extend the approach to lossless and lossy asynchronous multiple-function computations with joint secrecy and privacy constraints, in which case inner and outer bounds for the rate regions differing only in the Markov chain conditions imposed are characterized.


title: Deep HDR Hallucination for Inverse Tone Mapping

abstract: Inverse Tone Mapping (ITM) methods attempt to reconstruct High Dynamic Range (HDR) information from Low Dynamic Range (LDR) image content. The dynamic range of well-exposed areas must be expanded and any missing information due to over/under-exposure must be recovered (hallucinated). The majority of methods focus on the former and are relatively successful, while most attempts on the latter are not of sufficient quality, even ones based on Convolutional Neural Networks (CNNs). A major factor for the reduced inpainting quality in some works is the choice of loss function. Work based on Generative Adversarial Networks (GANs) shows promising results for image synthesis and LDR inpainting, suggesting that GAN losses can improve inverse tone mapping results. This work presents a GAN-based method that hallucinates missing information from badly exposed areas in LDR images and compares its efficacy with alternative variations. The proposed method is quantitatively competitive with state-of-the-art inverse tone mapping methods, providing good dynamic range expansion for well-exposed areas and plausible hallucinations for saturated and under-exposed areas. A density-based normalisation method, targeted for HDR content, is also proposed, as well as an HDR data augmentation method targeted for HDR hallucination.


title: Synthesizing Modular Manipulators For Tasks With Time, Obstacle, And Torque Constraints

abstract: Modular robots can be tailored to achieve specific tasks and rearranged to achieve previously infeasible ones. The challenge is choosing an appropriate design from a large search space. In this work, we describe a framework that automatically synthesizes the design and controls for a serial chain modular manipulator given a task description. The task includes points to be reached in the 3D space, time constraints, a load to be sustained at the end-effector, and obstacles to be avoided in the environment. These specifications are encoded as a constrained optimization in the robot's kinematics and dynamics and, if a solution is found, the formulation returns the specific design and controls to perform the task. Finally, we demonstrate our approach on a complex specification in which the robot navigates a constrained environment while holding an object.


title: Scaling Laws for Acoustic Models

abstract: There is a recent trend in machine learning to increase model quality by growing models to sizes previously thought to be unreasonable. Recent work has shown that autoregressive generative models with cross-entropy objective functions exhibit smooth power-law relationships, or scaling laws, that predict model quality from model size, training set size, and the available compute budget. These scaling laws allow one to choose nearly optimal hyper-parameters given constraints on available training data, model parameter count, or training computation budget. In this paper, we demonstrate that acoustic models trained with an auto-predictive coding loss behave as if they are subject to similar scaling laws. We extend previous work to jointly predict loss due to model size, to training set size, and to the inherent "irreducible loss" of the task. We find that the scaling laws accurately match model performance over two orders of magnitude in both model size and training set size, and make predictions about the limits of model performance.


title: Risk assessment for long and short range airborne transmission of SARS-CoV-2, indoors and outdoors

abstract: Preventive measures to reduce infection are needed to combat the COVID-19 pandemic and prepare for a possible endemic phase. Current prophylactic vaccines are highly effective to prevent disease but lose their ability to reduce viral transmission as viral evolution leads to increasing immune escape. Long term proactive public health policies must therefore complement vaccination with available nonpharmaceutical interventions (NPI) aiming to reduce the viral transmission risk in public spaces. Here, we revisit the quantitative assessment of airborne transmission risk, considering asymptotic limits that considerably simplify its expression. We show that the aerosol transmission risk is the product of three factors: a biological factor that depends on the viral strain, a hydrodynamical factor defined as the ratio of concentration in viral particles between inhaled and exhaled air, and a face mask filtering factor. The short range contribution to the risk, both present indoors and outdoors, is related to the turbulent dispersion of exhaled aerosols by air drafts and by convection (indoor), or by the wind (outdoors). We show experimentally that airborne droplets and CO$_2$ molecules present the same dispersion. As a consequence, the dilution factor, and therefore the risk, can be measured quantitatively using the CO$_2$ concentration, regardless of the room volume, the flow rate of fresh air and the occupancy. We show that the dispersion cone leads to a concentration in viral particles, and therefore a short range transmission risk, inversely proportional to the squared distance to an infected person and to the flow velocity. The aerosolization criterion derived as an intermediate result, which compares the Stokes relaxation time to the Lagrangian time scale, may find application for a broad class of aerosol-borne pathogens and pollutants.


title: Calibration-based overlay sensing with minimal-footprint targets

abstract: Overlay measurements are a critical part of modern semiconductor fabrication, but overlay targets have not scaled down in the way devices have. In this work, we produce overlay targets with very small footprint, consisting of just a few scattering nanoparticles in two separate device layers. Using moir\'e patterns to deterministically generate many overlay errors on a single chip, we demonstrate successful readout of the relative displacement between the two layers and show that calibration on one realization of the targets can be used for overlay measurements on subsequent instances. Our results suggest using greater quantities of smaller overlay targets may benefit performance both directly and through finer sampling of deformation.


title: Development of a low-cost portable turbidimeter for processes

abstract: Turbidity is a physical property related to the scattering of light by particles that are suspended in a liquid. Commercial turbidimeters are priced at the range of hundreds to thousands of dollars. Considering this scenario, it is proposed in this work the development of a low-cost portable turbidimeter for monitoring of turbidity in processes. An infrared LED was used as light emitter, and an infrared phototransistor as light receiver. The signal processing control unit was developed with the Arduino Uno platform. The calibration of the turbidimeter was done by means of a comparative test in triplicate, using as reference the commercial turbidimeter 2100P, HACH. The turbidimeter was able to perform analysis in the range of 100 to 1000 NTU, presenting an innovation character given its portability and computer communication via USB, and in a good price range for the prototype, costing US$ 46.30.


title: Emergence of near-boundary segregation zones in face-centered cubic multi-principal element alloys

abstract: Grain boundaries have been shown to dramatically influence the behavior of relatively simple materials such as monatomic metals and binary alloys. The increased chemical complexity associated with multi-principal element alloys is hypothesized to lead to new grain boundary phenomena. To explore the relationship between grain boundary structure and chemistry in these materials, hybrid molecular dynamics/Monte Carlo simulations of a faceted {\Sigma}11 <110> tilt boundary, chosen to sample both high- and low-energy boundary configurations, are performed in face-centered cubic CrFeCoNiCu and CrFeCoNi equiatomic alloys. Unexpected enrichment of Fe is discovered in the face-centered cubic regions adjacent to the interface and found to be correlated with a structurally-distinct region of reduced atomic volume. Comparison with the boundary of the same type in monatomic Cu demonstrates that altered near-boundary regions exist in simpler systems as well, with the chemical complexity of the multi-principal element alloys highlighting its existence and importance.


title: Scalable Approach for Normalizing E-commerce Text Attributes (SANTA)

abstract: In this paper, we present SANTA, a scalable framework to automatically normalize E-commerce attribute values (e.g. "Win 10 Pro") to a fixed set of pre-defined canonical values (e.g. "Windows 10"). Earlier works on attribute normalization focused on fuzzy string matching (also referred as syntactic matching in this paper). In this work, we first perform an extensive study of nine syntactic matching algorithms and establish that 'cosine' similarity leads to best results, showing 2.7% improvement over commonly used Jaccard index. Next, we argue that string similarity alone is not sufficient for attribute normalization as many surface forms require going beyond syntactic matching (e.g. "720p" and "HD" are synonyms). While semantic techniques like unsupervised embeddings (e.g. word2vec/fastText) have shown good results in word similarity tasks, we observed that they perform poorly to distinguish between close canonical forms, as these close forms often occur in similar contexts. We propose to learn token embeddings using a twin network with triplet loss. We propose an embedding learning task leveraging raw attribute values and product titles to learn these embeddings in a self-supervised fashion. We show that providing supervision using our proposed task improves over both syntactic and unsupervised embeddings based techniques for attribute normalization. Experiments on a real-world attribute normalization dataset of 50 attributes show that the embeddings trained using our proposed approach obtain 2.3% improvement over best string matching and 19.3% improvement over best unsupervised embeddings.


title: Optimum Allocation for Adaptive Multi-Wave Sampling in R: The R Package optimall

abstract: The R package optimall offers a collection of functions that efficiently streamline the design process of sampling in surveys ranging from simple to complex. The package's main functions allow users to interactively define and adjust strata cut points based on values or quantiles of auxiliary covariates, adaptively calculate the optimum number of samples to allocate to each stratum using Neyman or Wright allocation, and select specific IDs to sample based on a stratified sampling design. Using real-life epidemiological study examples, we demonstrate how optimall facilitates an efficient workflow for the design and implementation of surveys in R. Although tailored towards multi-wave sampling under two- or three-phase designs, the R package optimall may be useful for any sampling survey.


title: Exponential asymptotics for steady parasitic capillary ripples on steep gravity waves

abstract: In this paper we develop an asymptotic theory for steadily travelling gravity-capillary waves under the small-surface tension limit. In an accompanying work [Shelton et al. (2021), J. Fluid Mech., vol 922] it was demonstrated that solutions associated with a perturbation about a leading-order gravity wave (a Stokes wave) contain surface-tension-driven parasitic ripples with an exponentially-small amplitude. Thus a naive Poincar\'e expansion is insufficient for their description. Here, we shall develop specialised methodologies in exponential asymptotics for derivation of the parasitic ripples on periodic domains. The ripples are shown to arise in conjunction with Stokes lines and the Stokes phenomenon. The analysis relies crucially upon the derivation and analysis of singularities in the analytic continuation of the classic Stokes wave. A solvability condition is derived, showing that solutions of this type do not exist at certain values of the Bond number. The asymptotic results are compared to full numerical solutions and show excellent agreement. The work provides corrections and insight of a seminal theory on parasitic capillary waves first proposed by Longuet-Higgins [J. Fluid Mech., vol. 16 (1), 1963, pp. 138-159].


title: Calculation of force and torque between two arbitrarily oriented circular filaments using Kalantarov-Zeitlin's method

abstract: In this article, formulas for the calculation of force and torque between two circular filaments arbitrarily oriented in space were derived by using Kalantarov-Zeitlin's method. Formulas are presented in an analytical form through integral expressions, whose kernel function is expressed in terms of the elliptic integrals of the first and second kinds, and provide an alternative formulation to Babic's expressions. The derived new formulas were validated via comparison with a series of reference examples. Also, we obtained additional expressions for the calculation of force and torque between two circular filaments by means of differentiation of Grover's formula for the mutual inductance between two circular filaments with respect to appropriate coordinates. These additional expressions allow to verifying comprehensively and independently derived new formulas.


title: On ergodic control problem for viscous Hamilton--Jacobi equations for weakly coupled elliptic systems

abstract: In this article we study ergodic problems in the whole space $\mathbb{R}^N$ for weakly coupled systems of viscous Hamilton-Jacobi equations with coercive right-hand sides. The Hamiltonians are assumed to have a fairly general structure and the switching rates need not be constant. We prove the existence of a critical value $\lambda^*$ such that the ergodic eigenvalue problem has a solution for every $\lambda\leq\lambda^*$ and no solution for $\lambda>\lambda^*$. Moreover, the existence and uniqueness of non-negative solutions corresponding to the value $\lambda^*$ are also established. We also exhibit the implication of these results to the ergodic optimal control problems of controlled switching diffusions.


title: The Concept, Types and Structure of Corruption

abstract: The article analyzes the essence of the phenomenon of corruption, highlights its main varieties and characteristics. The authors of the study apply historical analysis, emphasizing the long-term nature of corruption and its historical roots. The paper uses legal analysis to characterize the legal interpretation of corruption as an economic crime.


title: Maximum Entropy Spectral Analysis: a case study

abstract: The Maximum Entropy Spectral Analysis (MESA) method, developed by Burg, provides a powerful tool to perform spectral estimation of a time-series. The method relies on a Jaynes' maximum entropy principle and provides the means of inferring the spectrum of a stochastic process in terms of the coefficients of some autoregressive process AR($p$) of order $p$. A closed form recursive solution provides an estimate of the autoregressive coefficients as well as of the order $p$ of the process. We provide a ready-to-use implementation of the algorithm in the form of a python package \texttt{memspectrum}. We characterize our implementation by performing a power spectral density analysis on synthetic data (with known power spectral density) and we compare different criteria for stopping the recursion. Furthermore, we compare the performance of our code with the ubiquitous Welch algorithm, using synthetic data generated from the released spectrum by the LIGO-Virgo collaboration. We find that, when compared to Welch's method, Burg's method provides a power spectral density (PSD) estimation with a systematically lower variance and bias. This is particularly manifest in the case of a little number of data points, making Burg's method most suitable to work in this regime.


title: Making Sense of Complex Sensor Data Streams

abstract: This concept paper draws from our previous research on individual grip force data collected from biosensors placed on specific anatomical locations in the dominant and non dominant hands of operators performing a robot assisted precision grip task for minimally invasive endoscopic surgery. The specificity of the robotic system on the one hand, and that of the 2D image guided task performed in a real world 3D space on the other, constrain the individual hand and finger movements during task performance in a unique way. Our previous work showed task specific characteristics of operator expertise in terms of specific grip force profiles, which we were able to detect in thousands of highly variable individual data. This concept paper is focused on two complementary data analysis strategies that allow achieving such a goal. In contrast with other sensor data analysis strategies aimed at minimizing variance in the data, it is in this case here necessary to decipher the meaning of the full extent of intra and inter individual variance in the sensor data by using the appropriate statistical analyses, as shown in the first part of this paper. Then, it is explained how the computation of individual spatio temporal grip force profiles permits detecting expertise specific differences between individual users. It is concluded that these two analytic strategies are complementary. They enable drawing meaning from thousands of biosensor data reflecting human grip performance and its evolution with training, while fully taking into account their considerable inter and intra individual variability.


title: DeepInsight: Interpretability Assisting Detection of Adversarial Samples on Graphs

abstract: With the rapid development of artificial intelligence, a number of machine learning algorithms, such as graph neural networks have been proposed to facilitate network analysis or graph data mining. Although effective, recent studies show that these advanced methods may suffer from adversarial attacks, i.e., they may lose effectiveness when only a small fraction of links are unexpectedly changed. This paper investigates three well-known adversarial attack methods, i.e., Nettack, Meta Attack, and GradArgmax. It is found that different attack methods have their specific attack preferences on changing the target network structures. Such attack pattern are further verified by experimental results on some real-world networks, revealing that generally the top four most important network attributes on detecting adversarial samples suffice to explain the preference of an attack method. Based on these findings, the network attributes are utilized to design machine learning models for adversarial sample detection and attack method recognition with outstanding performance.


abstract: Pre-trained language models induce dense entity representations that offer strong performance on entity-centric NLP tasks, but such representations are not immediately interpretable. This can be a barrier to model uptake in important domains such as biomedicine. There has been recent work on general interpretable representation learning (Onoe and Durrett, 2020), but these domain-agnostic representations do not readily transfer to the important domain of biomedicine. In this paper, we create a new entity type system and training set from a large corpus of biomedical texts by mapping entities to concepts in a medical ontology, and from these to Wikipedia pages whose categories are our types. From this mapping we derive Biomedical Interpretable Entity Representations(BIERs), in which dimensions correspond to fine-grained entity types, and values are predicted probabilities that a given entity is of the corresponding type. We propose a novel method that exploits BIER's final sparse and intermediate dense representations to facilitate model and entity type debugging. We show that BIERs achieve strong performance in biomedical tasks including named entity disambiguation and entity label classification, and we provide error analysis to highlight the utility of their interpretability, particularly in low-supervision settings. Finally, we provide our induced 68K biomedical type system, the corresponding 37 million triples of derived data used to train BIER models and our best performing model.


title: The Parity Ray Regularizer for Pacing in Auction Markets

abstract: Budget-management systems are one of the key components of modern auction markets. Internet advertising platforms typically offer advertisers the possibility to pace the rate at which their budget is depleted, through budget-pacing mechanisms. We focus on multiplicative pacing mechanisms in an online setting in which a bidder is repeatedly confronted with a series of advertising opportunities. After collecting bids, each item is then allocated through a single-item, second-price auction. If there were no budgetary constraints, bidding truthfully would be an optimal choice for the advertiser. However, since their budget is limited, the advertiser may want to shade their bid downwards in order to preserve their budget for future opportunities, and to spread expenditures evenly over time. The literature on online pacing problems mostly focuses on the setting in which the bidder optimizes an additive separable objective, such as the total click-through rate or the revenue of the allocation. In many settings, however, bidders may also care about other objectives which oftentimes are non-separable, and therefore not amenable to traditional online learning techniques. Building on recent work, we study the frequent case in which advertisers seek to reach a certain distribution of impressions over a target population of users. We introduce a novel regularizer to achieve this desideratum, and show how to integrate it into an online mirror descent scheme attaining the optimal order of sub-linear regret compared to the optimal allocation in hindsight when inputs are drawn independently, from an unknown distribution. Moreover, we show that our approach can easily be incorporated in standard existing pacing systems that are not usually built for this objective. The effectiveness of our algorithm in internet advertising applications is confirmed by numerical experiments on real-world data.


title: High Resolution Measurement of Near-Field Radiative Heat Transfer enabled by Nanomechanical Resonators

abstract: Near-field radiative heat transfer (NFHT) research currently suffers from an imbalance between numerous theoretical studies, as opposed to experimental reports that remain, in proportion, relatively scarce. Existing experimental platforms all rely on unique custom-built devices on which it is difficult to integrate new materials and structures for studying the breadth of theoretically proposed phenomena. Here we show high-resolution NFHT measurements using, as our sensing element, silicon nitride (SiN) freestanding nanomembranes$-$a widely available platform routinely used in materials and cavity optomechanics research. We measure NFHT by tracking the high mechanical quality (Q) factor ($>2\times10^6$) resonance of a membrane placed in the near-field of a hemispherical hot object. We find that high Q-factor enables a temperature resolution ($1.2\times10^{-6} \ \mathrm{K}$) that is unparalleled in previous NFHT experiments. Results are in good agreement with a custom-built model combining heat transport in nanomembranes and the effect of non-uniform stress/temperature on the resonator eigenmodes.


title: SN 2020cpg: an energetic link between type IIb and Ib supernovae

abstract: Stripped-envelope supernovae (SE-SNe) show a wide variety of photometric and spectroscopic properties. This is due to the different potential formation channels and the stripping mechanism that allows for a large diversity within the progenitors outer envelop compositions. Here, the photometric and spectroscopic observations of SN 2020cpg covering $\sim 130$ days from the explosion date are presented. SN 2020cpg ($z = 0.037$) is a bright SE-SNe with the $B$-band peaking at $M_{B} = -17.75 \pm 0.39$ mag and a maximum pseudo-bolometric luminosity of $L_\mathrm{max} = 6.03 \pm 0.01 \times 10^{42} \mathrm{ergs^{-1}}$. Spectroscopically, SN 2020cpg displays a weak high and low velocity H$\alpha$ feature during the photospheric phase of its evolution, suggesting that it contained a detached hydrogen envelope prior to explosion. From comparisons with spectral models, the mass of hydrogen within the outer envelope was constrained to be $\sim 0.1 \mathrm{M}_{\odot}$. From the pseudo-bolometric light curve of SN 2020cpg a $^{56}$Ni mass of $M_\mathrm{Ni} \sim 0.27 \pm 0.08$ $\mathrm{M}_{\odot}$ was determined using an Arnett-like model. The ejecta mass and kinetic energy of SN 2020cpg were determined using an alternative method that compares the light curve of SN 2020cpg and several modelled SE-SNe, resulting in an ejecta mass of $M_\mathrm{ejc} \sim 5.5 \pm 2.0$ $\mathrm{M}_{\odot}$ and a kinetic energy of $E_\mathrm{K} \sim 9.0 \pm 3.0 \times 10^{51} \mathrm{erg}$. The ejected mass indicates a progenitor mass of $18 - 25 \mathrm{M}_{\odot}$. The use of the comparative light curve method provides an alternative process to the commonly used Arnett-like model to determine the physical properties of SE-SNe.


title: Non-thermal electron energization during the impulsive phase of an X9.3 flare revealed by Insight-HXMT

abstract: The X9.3 flare SOL20170906T11:55 was observed by the CsI detector aboard the first Chinese X-ray observatory Hard X-ray Modulation telescope (Insight-HXMT). By using wavelets method, we report about 22 s quasiperiodic pulsations(QPPs) during the impulsive phase. And the spectra from 100 keV to 800 keV showed the evolution with the gamma-ray flux, of a power-law photon index from $\sim 1.8$ before the peak, $\sim 2.0$ around the flare peak, to $\sim 1.8$ again. The gyrosynchrotron microwave spectral analysis reveals a $36.6 \pm 0.6 \arcsec$ radius gyrosynchrotron source with mean transverse magnetic field around 608.2 Gauss, and the penetrated $\ge$ 10 keV non-thermal electron density is about $10^{6.7} \mathrm{cm}^{-3}$ at peak time. The magnetic field strength followed the evolution of high-frequency radio flux. Further gyrosynchrotron source modeling analysis implies that there exists a quite steady gyrosynchrotron source, the non-thermal electron density and transverse magnetic field evolution are similar to higher-frequency light curves. The temporally spectral analysis reveals that those non-thermal electrons are accelerated by repeated magnetic reconnection, likely from a lower corona source.


title: On endomorphism algebras of Gelfand-Graev representations

abstract: For a connected reductive group $G$ defined over $\mathbb{F}_q$ and equipped with the induced Frobenius endomorphism $F$, we study the relation among the following three $\mathbb{Z}$-algebras: (i) the $\mathbb{Z}$-model $\mathsf{E}_G$ of endomorphism algebras of Gelfand-Graev representations of $G^F$; (ii) the Grothendieck group $\mathsf{K}_{G^\ast}$ of the category of representations of $G^{\ast F^\ast}$ over $\overline{\mathbb{F}_q}$ (Deligne-Lusztig dual side); (iii) the ring $\mathsf{B}_{G^\vee}$ of the scheme $(T^\vee/\!\!/ W)^{F^\vee}$ over $\mathbb{Z}$ (Langlands dual side). The comparison between (i) and (iii) is motivated by recent advances in the local Langlands program.


title: KIT Bus: A Shuttle Model for CARLA Simulator

abstract: With the continuous development of science and technology, self-driving vehicles will surely change the nature of transportation and realize the automotive industry's transformation in the future. Compared with self-driving cars, self-driving buses are more efficient in carrying passengers and more environmentally friendly in terms of energy consumption. Therefore, it is speculated that in the future, self-driving buses will become more and more important. As a simulator for autonomous driving research, the CARLA simulator can help people accumulate experience in autonomous driving technology faster and safer. However, a shortcoming is that there is no modern bus model in the CARLA simulator. Consequently, people cannot simulate autonomous driving on buses or the scenarios interacting with buses. Therefore, we built a bus model in 3ds Max software and imported it into the CARLA to fill this gap. Our model, namely KIT bus, is proven to work in the CARLA by testing it with the autopilot simulation. The video demo is shown on our Youtube.


title: Resurrect3D: An Open and Customizable Platform for Visualizing and Analyzing Cultural Heritage Artifacts

abstract: Art and culture, at their best, lie in the act of discovery and exploration. This paper describes Resurrect3D, an open visualization platform for both casual users and domain experts to explore cultural artifacts. To that end, Resurrect3D takes two steps. First, it provides an interactive cultural heritage toolbox, providing not only commonly used tools in cultural heritage such as relighting and material editing, but also the ability for users to create an interactive "story": a saved session with annotations and visualizations others can later replay. Second, Resurrect3D exposes a set of programming interfaces to extend the toolbox. Domain experts can develop custom tools that perform artifact-specific visualization and analysis.


title: Extremal mild solutions for Hilfer fractional evolution equation with mixed monotone Impulsive conditions

abstract: The well established mixed monotone iterative technique that is used to study the existence and uniqueness of fractional order system is studied explicitly for impulsive system with Hilfer fractional order in this paper. The procedure of finding mild $L$-quasi solution of such impulsive evolution equation with noncomapct semigroups involves measure of non-compactness and Sadovskii's fixed point theorem as well. An example is provided to illustrate the main results.


title: Gevrey well posedness for $3$-evolution equations with variable coefficients

abstract: We study the Cauchy problem for a class of third order linear anisotropic evolution equations with complex valued lower order terms depending both on time and space variables. Under suitable decay assumptions for $|x| \to \infty$ on these coefficients, we prove a well posedness result in Gevrey-type spaces.


title: Machine learning methods for postprocessing ensemble forecasts of wind gusts: A systematic comparison

abstract: Postprocessing ensemble weather predictions to correct systematic errors has become a standard practice in research and operations. However, only few recent studies have focused on ensemble postprocessing of wind gust forecasts, despite its importance for severe weather warnings. Here, we provide a comprehensive review and systematic comparison of eight statistical and machine learning methods for probabilistic wind gust forecasting via ensemble postprocessing, that can be divided in three groups: State of the art postprocessing techniques from statistics (ensemble model output statistics (EMOS), member-by-member postprocessing, isotonic distributional regression), established machine learning methods (gradient-boosting extended EMOS, quantile regression forests) and neural network-based approaches (distributional regression network, Bernstein quantile network, histogram estimation network). The methods are systematically compared using six years of data from a high-resolution, convection-permitting ensemble prediction system that was run operationally at the German weather service, and hourly observations at 175 surface weather stations in Germany. While all postprocessing methods yield calibrated forecasts and are able to correct the systematic errors of the raw ensemble predictions, incorporating information from additional meteorological predictor variables beyond wind gusts leads to significant improvements in forecast skill. In particular, we propose a flexible framework of locally adaptive neural networks with different probabilistic forecast types as output, which not only significantly outperform all benchmark postprocessing methods but also learn physically consistent relations associated with the diurnal cycle, especially the evening transition of the planetary boundary layer.


title: The promise of energy-efficient battery-powered urban aircraft

abstract: Improvements in rechargeable batteries are enabling several electric urban air mobility (UAM) aircraft designs with up to 300 miles of range with payload equivalents of up to 7 passengers. We find that novel UAM aircraft consume between 130 Wh/passenger-mile up to ~1,200 Wh/passenger-mile depending on the design and utilization, relative to an expected consumption of over 220 Wh/passenger-mi for terrestrial electric vehicles and 1,000 Wh/passenger-mile for combustion engine vehicles. We also find that several UAM aircraft designs are approaching technological viability with current Li-ion batteries, based on the specific power-and-energy while rechargeability and lifetime performance remain uncertain. These aspects highlight the technological readiness of a new segment of transportation.


title: Discovery of the 5 keV cyclotron line followed by three harmonics in SwiftJ1626.6-5156

abstract: We report on observations of the Be/X-ray binary system SwiftJ1626.6-5156 performed with NuSTAR during a short outburst in March 2021, following its detection of by the MAXI monitor and Spektrum-Roentgen-Gamma (SRG) observatory. Our analysis of the broadband X-ray spectrum of the source confirms the presence of two absorption-like features at energies ~9 and ~17 keV previously reported in literature and interpreted as the fundamental cyclotron resonance scattering feature (CRSF) and its first harmonic (based on RXTE data). The better sensitivity and energy resolution of NuSTAR, combined with the low energy coverage of NICER, allowed us to detect two additional absorption-like features at ~4.9 keV and ~13 keV. We conclude, therefore, that in total four cyclotron lines are observed in the spectrum of SwiftJ1626.6-5156: the fundamental CRSF at ~4.9 keV and three higher spaced harmonics. This discovery makes SwiftJ1626.6-5156 the second accreting pulsar, after 4U0115+63, whose spectrum is characterized by more than three lines of a cyclotronic origin, and implies the source has the weakest confirmed magnetic field among all X-ray pulsars B~4E11 G. This discovery makes SwiftJ1626.6-5156 one of prime targets for the upcoming X-ray polarimetry missions covering soft X-ray band such as IXPE and eXTP.


title: A Neutron Star is born

abstract: A neutron star was first detected as a pulsar in 1967. It is one of the most mysterious compact objects in the universe, with a radius of the order of 10 km and masses that can reach two solar masses. In fact, neutron stars are star remnants, a kind of stellar zombies (they die, but do not disappear). In the last decades, astronomical observations yielded various contraints for the neutron star masses and finally, in 2017, a gravitational wave was detected (GW170817). Its source was identified as the merger of two neutron stars coming from NGC 4993, a galaxy 140 million light years away from us. The very same event was detected in $\gamma$-ray, x-ray, UV, IR, radio frequency and even in the optical region of the electromagnetic spectrum, starting the new era of multi-messenger astronomy. To understand and describe neutron stars, an appropriate equation of state that satisfies bulk nuclear matter properties is necessary. GW170817 detection contributed with extra constraints to determine it. On the other hand, magnetars are the same sort of compact objects, but bearing much stronger magnetic fields that can reach up to 10$^{15}$ G on the surface as compared with the usual 10$^{12}$ G present in ordinary pulsars. While the description of ordinary pulsars is not completely established, describing magnetars poses extra challenges. In this paper, I give an overview on the history of neutron stars and on the development of nuclear models and show how the description of the tiny world of the nuclear physics can help the understanding of the cosmos, especially of the neutron stars.


title: Transductive Few-Shot Learning: Clustering is All You Need?

abstract: We investigate a general formulation for clustering and transductive few-shot learning, which integrates prototype-based objectives, Laplacian regularization and supervision constraints from a few labeled data points. We propose a concave-convex relaxation of the problem, and derive a computationally efficient block-coordinate bound optimizer, with convergence guarantee. At each iteration,our optimizer computes independent (parallel) updates for each point-to-cluster assignment. Therefore, it could be trivially distributed for large-scale clustering and few-shot tasks. Furthermore, we provides a thorough convergence analysis based on point-to-set maps. Were port comprehensive clustering and few-shot learning experiments over various data sets, showing that our method yields competitive performances, in term of accuracy and optimization quality, while scaling up to large problems. Using standard training on the base classes, without resorting to complex meta-learning and episodic-training strategies, our approach outperforms state-of-the-art few-shot methods by significant margins, across various models, settings and data sets. Surprisingly, we found that even standard clustering procedures (e.g., K-means), which correspond to particular, non-regularized cases of our general model, already achieve competitive performances in comparison to the state-of-the-art in few-shot learning. These surprising results point to the limitations of the current few-shot benchmarks, and question the viability of a large body of convoluted few-shot learning techniques in the recent literature.


title: Dynamic Knowledge Distillation With Noise Elimination for RGB-D Salient Object Detection

abstract: RGB-D salient object detection (SOD) demonstrates its superiority on detecting in complex environments due to the additional depth information introduced in the data. Inevitably, an independent stream is introduced to extract features from depth images, leading to extra computation and parameters. This methodology sacrifices the model size to improve the detection accuracy which may impede the practical application of SOD problems. To tackle this dilemma, we propose a dynamic distillation method along with a lightweight structure, which significantly reduces the computational burden while maintaining validity. This method considers the factors of both teacher and student performance within the training stage and dynamically assigns the distillation weight instead of applying a fixed weight on the student model. We also investigate the issue of RGB-D early fusion strategy in distillation and propose a simple noise elimination method to mitigate the impact of distorted training data caused by low quality depth maps. Extensive experiments are conducted on five public datasets to demonstrate that our method can achieve competitive performance with a fast inference speed (136FPS) compared to 10 prior methods.


abstract: The research designs a new integrated system for the security enhancement of a decentralized network by preventing damages from attackers, particularly for the 51 percent attack. The concept of multiple layered design based on Blockchain Governance Games frameworks could handle multiple number of networks analytically. The Multi-Layered Blockchain Governance Game is an innovative analytical model to find the best strategies for executing a safety operation to protect whole multiple layered network systems from attackers. This research fully analyzes a complex network with the compact mathematical forms and theoretically tractable results for predicting the moment of a safety operation execution are fully obtained. Additionally, simulation results are demonstrated to obtain the optimal values of configuring parameters of a blockchain-based security network. The Matlab codes for the simulations are publicly available to help those whom are constructing an enhanced decentralized security network architecture through this proposed integrated theoretical framework.


title: The Quasi-Zariski topology on the graded quasi-primary spectrum of a graded module over a graded commutative ring

abstract: Let $G$ be a group with identity $e$. Let $R$ be a $G$-graded commutative ring and $M$ a graded $R$-module. A proper graded submodule $Q$ of $M$ is called a graded quasi-primary submodule if whenever $r\in h(R)$ and $m\in h(M)$ with $rm\in Q$, then either $r\in Gr((Q:_{R}M))$ or $m\in Gr_{M}(Q)$. The graded quasi primary spectrum $qp.Spec_{g}(M)$ is defined to be the set of all graded quasi primary submodules of $M$. In this paper, we introduce and study a topology on $qp.Spec_{g}(M)$, called the Quasi-Zariski Topology, and investigate properties of this topology and some conditions under which (% $qp.Spec_{g}(M)$, $q.\tau ^{g}$) is a Noetherian, spctral space.


title: A theoretical model of Dark Energy Stars in Einstein-Gauss-Bonnet Gravity

abstract: Dark energy stars research is an issue of great interest since recent astronomical observations with respect to measurements in distant supernovas, cosmic microwave background and weak gravitational lensing confirm that the universe is undergoing a phase of accelerated expansion and this cosmological behavior is caused by the presence of a cosmic fluid which has a strong negative pressure that allows to explain the expanding universe. In this paper, we obtained new relativistic stellar configurations within the framework of Einstein-Gauss-Bonnet (EGB) gravity considering negative anisotropic pressures and the equation of state pr={\omega}\r{ho} where pr is the radial pressure, {\omega} is the dark energy parameter, and \r{ho} is the dark energy density. We have chosen a modified version of metric potential proposed by Korkina-Orlyanskii (1991). For the new solutions we checked that the radial pressure, metric coefficients, energy density and anisotropy are well defined and are regular in the interior of the star and are dependent of the values of the Gauss-Bonnet coupling constant. The solutions found can be used in the development of dark energy stars models satisfying all physical acceptability conditions, but the causality condition and strong energy condition cannot be satisfied.


title: Singularities in the acoustic Casimir pressure as a function of reflectivities

abstract: We study the acoustic Casimir pressure between imperfectly reflecting plates immersed in various isotropic noise backgrounds. Unlike the case of perfect reflectors, the force tends to strong repulsion at small plate separations due to the existence of modes between the plates. Additionally, in a noise field of constant spectral intensity, the large-bandwidth limit of the pressure has a reflectivity-dependent sensitivity to the infrared cutoff; we uncover the associated singular behavior as the product of the reflection coefficients approaches 1, which is intimately connected to a tendency of closely-spaced plates to repel if placed in a narrowly peaked spectral background.


title: Development of Gated Fiber Detectors for Laser-Induced Strong Electromagnetic Pulse Environments

abstract: With the development of laser technologies, nuclear reactions can happen in high-temperature plasma environments induced by lasers and have attracted a lot of attention from different physical disciplines. However, studies on nuclear reactions in plasma are still limited by detecting technologies. This is mainly due to the fact that extremely high electromagnetic pulses (EMPs) can also be induced when high-intensity lasers hit targets to induce plasma, and then cause dysfunction of many types of traditional detectors. Therefore, new particle detecting technologies are highly needed. In this paper, we report a recently developed gated fiber detector which can be used in harsh EMP environments. In this prototype detector, scintillating photons are coupled by fiber and then transferred to a gated photomultiplier tube which is located far away from the EMP source and shielded well. With those measures, the EMPs can be avoided, and this device has the capability to identify a single event of nuclear reaction products generated in laser-induced plasma from noise EMP backgrounds. This new type of detector can be widely used as a Time-of-Flight (TOF) detector in high-intensity laser nuclear physics experiments for detecting neutron, photons, and other charged particles.


title: Equivalence of a harmonic oscillator to a free particle and Eisenhart lift

abstract: It is widely known in quantum mechanics that solutions of the Schr\"{o}inger equation (SE) for a linear potential are in one-to-one correspondence with the solutions of the free SE. The physical reason for this correspondence is Einstein's principle of equivalence. What is usually not so widely known is that solutions of the Schr\"{o}dinger equation with harmonic potential can also be mapped to the solutions of the free Schr\"{o}dinger equation. The physical understanding of this equivalence is not known as precisely as in the case of the equivalence principle. We present a geometric picture that will link both of the above equivalences with one constraint on the Eisenhart metric.


title: Implicit Bias of SGD for Diagonal Linear Networks: a Provable Benefit of Stochasticity

abstract: Understanding the implicit bias of training algorithms is of crucial importance in order to explain the success of overparametrised neural networks. In this paper, we study the dynamics of stochastic gradient descent over diagonal linear networks through its continuous time version, namely stochastic gradient flow. We explicitly characterise the solution chosen by the stochastic flow and prove that it always enjoys better generalisation properties than that of gradient flow. Quite surprisingly, we show that the convergence speed of the training loss controls the magnitude of the biasing effect: the slower the convergence, the better the bias. To fully complete our analysis, we provide convergence guarantees for the dynamics. We also give experimental results which support our theoretical claims. Our findings highlight the fact that structured noise can induce better generalisation and they help explain the greater performances observed in practice of stochastic gradient descent over gradient descent.


title: Impact of magneto-rotational instability on grain growth in protoplanetary disks: II. Increased grain collisional velocities

abstract: Turbulence is the dominant source of collisional velocities for grains with a wide range of sizes in protoplanetary disks. So far, only Kolmogorov turbulence has been considered for calculating grain collisional velocities, despite the evidence that turbulence in protoplanetary disks may be non-Kolmogorov. In this work, we present calculations of grain collisional velocities for arbitrary turbulence models characterized by power-law spectra and determined by three dimensionless parameters: the slope of the kinetic energy spectrum, the slope of the auto-correlation time, and the Reynolds number. The implications of our results are illustrated by numerical simulations of the grain size evolution for different turbulence models. We find that for the modeled cases of the Iroshnikov-Kraichnan turbulence and the turbulence induced by the magneto-rotational instabilities, collisional velocities of small grains are much larger than those for the standard Kolmogorov turbulence. This leads to faster grain coagulation in the outer regions of protoplanetary disks, resulting in rapid increase of dust opacity in mm-wavelength and possibly promoting planet formation in very young disks.


title: Exploring the Properties and Evolution of Neural Network Eigenspaces during Training

abstract: In this work we explore the information processing inside neural networks using logistic regression probes \cite{probes} and the saturation metric \cite{featurespace_saturation}. We show that problem difficulty and neural network capacity affect the predictive performance in an antagonistic manner, opening the possibility of detecting over- and under-parameterization of neural networks for a given task. We further show that the observed effects are independent from previously reported pathological patterns like the ``tail pattern'' described in \cite{featurespace_saturation}. Finally we are able to show that saturation patterns converge early during training, allowing for a quicker cycle time during analysis


title: Federated Learning for Intrusion Detection System: Concepts, Challenges and Future Directions

abstract: The rapid development of the Internet and smart devices trigger surge in network traffic making its infrastructure more complex and heterogeneous. The predominated usage of mobile phones, wearable devices and autonomous vehicles are examples of distributed networks which generate huge amount of data each and every day. The computational power of these devices have also seen steady progression which has created the need to transmit information, store data locally and drive network computations towards edge devices. Intrusion detection systems play a significant role in ensuring security and privacy of such devices. Machine Learning and Deep Learning with Intrusion Detection Systems have gained great momentum due to their achievement of high classification accuracy. However the privacy and security aspects potentially gets jeopardised due to the need of storing and communicating data to centralized server. On the contrary, federated learning (FL) fits in appropriately as a privacy-preserving decentralized learning technique that does not transfer data but trains models locally and transfers the parameters to the centralized server. The present paper aims to present an extensive and exhaustive review on the use of FL in intrusion detection system. In order to establish the need for FL, various types of IDS, relevant ML approaches and its associated issues are discussed. The paper presents detailed overview of the implementation of FL in various aspects of anomaly detection. The allied challenges of FL implementations are also identified which provides idea on the scope of future direction of research. The paper finally presents the plausible solutions associated with the identified challenges in FL based intrusion detection system implementation acting as a baseline for prospective research.


title: Optimal control strategies to tailor antivirals for acute infectious diseases in the host

abstract: Several mathematical models in SARS-CoV-2 have shown how target-cell model can help to understand the spread of the virus in the host and how potential candidates of antiviral treatments can help to control the virus. Concepts as equilibrium and stability show to be crucial to qualitatively determine the best alternatives to schedule drugs, according to effectivity in inhibiting the virus infection and replication rates. Important biological events such as rebounds of the infections (when antivirals are incorrectly interrupted) can also be explained by means of a dynamic study of the target-cell model. In this work, a full characterization of the dynamical behavior of the target-cell models under control actions is made and, based on this characterization, the optimal fixed-dose antiviral schedule that produces the smallest amount of dead cells (without viral load rebounds) is computed. Several simulation results - performed by considering real patient data - show the potential benefits of both, the model characterization and the control strategy.


title: Recent LIGO-Virgo discoveries

abstract: The LIGO and Virgo gravitational-wave detectors carried out the first half of their third observing run from April through October 2019. During this period, they detected 39 new signals from the coalescence of black holes or neutron stars, more than quadrupling the total number of detected events. These detections included some unprecedented sources, like a pair of black holes with unequal masses (GW190412), a massive pair of neutron stars (GW190425), a black hole potentially in the supernova pair-instability mass gap (GW190521), and either the lightest black hole or the heaviest neutron star known to date (GW190814). Collectively, the full set of signals provided astrophysically valuable information about the distributions of compact objects and their evolution throughout cosmic history. It also enabled more constraining and diverse tests of general relativity, including new probes of the fundamental nature of black holes. This review summarizes the highlights of these results and their implications.


title: Theory of superconductivity due to Ngai's mechanism in lightly doped SrTiO3

abstract: We develop a theory of superconducting pairing in low-density Strontium titanate due to quadratic coupling of electron density to soft transverse optical phonons. It leads to static attractive potential between electrons which decay length scales inversely with soft optical gap. For low electron densities attraction between electrons is local and transition temperature Tc was found. The Tc(n) dependence in agreement with experimental data for low doping was calculated. Next, we show that suppression of Tc by hydrostatic pressure and strong increase of Tc due to isotop substitution are explained within our theory.


title: Influence of the Galactic bar on the kinematics of the disc stars with Gaia EDR3 data

abstract: A model of the Galaxy with the outer ring R1R2 can explain the observed distribution of the radial, VR, and azimuthal, VT, velocity components along the Galactocentric distance, R, derived from the Gaia EDR3 data. We selected stars from the Gaia EDR3 catalogue with reliable parallaxes, proper motions and line-of-sight velocities lying near the Galactic plane, |z|<200 pc, and in the sector of the Galactocentic angles |theta|<15 degrees and calculated the median velocities VR and VT in small bins along the distance R. The distribution of observed velocities appears to have some specific features: the radial velocity VR demonstrates a smooth fall from +5 km s-1 at the distance of R=R0-1.5 kpc to -3 km s-1 at R=R0+1.0 kpc while the azimuthal velocity VT shows a sharp drop by 7 km s-1 in the distance interval R0<R<R0+1.0 kpc, where R0 is the solar Galactocentric distance. We build a model of the Galaxy including bulge, bar, disc and halo components, which reproduces the observed specific features of the velocity distribution in the Galactocentric distance interval |R-R0|< 1.5 kpc. The best agreement corresponds to the time 1.8+/-0.5 Gyr after the start of the simulation. A model of the Galaxy with the bar rotating at the angular velocity of Omega_b=55+/-3 km s-1 kpc-1, which sets the OLR of the bar at the distance of R0-0.5+/-0.4 kpc, provides the best agreement between the model and observed velocities. The position angle of the bar, theta_b, corresponding to the best agreement between the model and observed velocities is theta_b=45+/-15 degrees.


title: ASR Adaptation for E-commerce Chatbots using Cross-Utterance Context and Multi-Task Language Modeling

abstract: Automatic Speech Recognition (ASR) robustness toward slot entities are critical in e-commerce voice assistants that involve monetary transactions and purchases. Along with effective domain adaptation, it is intuitive that cross utterance contextual cues play an important role in disambiguating domain specific content words from speech. In this paper, we investigate various techniques to improve contextualization, content word robustness and domain adaptation of a Transformer-XL neural language model (NLM) to rescore ASR N-best hypotheses. To improve contextualization, we utilize turn level dialogue acts along with cross utterance context carry over. Additionally, to adapt our domain-general NLM towards e-commerce on-the-fly, we use embeddings derived from a finetuned masked LM on in-domain data. Finally, to improve robustness towards in-domain content words, we propose a multi-task model that can jointly perform content word detection and language modeling tasks. Compared to a non-contextual LSTM LM baseline, our best performing NLM rescorer results in a content WER reduction of 19.2% on e-commerce audio test set and a slot labeling F1 improvement of 6.4%.


title: Author Clustering and Topic Estimation for Short Texts

abstract: Analysis of short text, such as social media posts, is extremely difficult because of their inherent brevity. In addition to classifying topics of such posts, a common downstream task is grouping the authors of these documents for subsequent analyses. We propose a novel model that expands on the Latent Dirichlet Allocation by modeling strong dependence among the words in the same document, with user-level topic distributions. We also simultaneously cluster users, removing the need for post-hoc cluster estimation and improving topic estimation by shrinking noisy user-level topic distributions towards typical values. Our method performs as well as -- or better -- than traditional approaches, and we demonstrate its usefulness on a dataset of tweets from United States Senators, recovering both meaningful topics and clusters that reflect partisan ideology. We also develop a novel measure of echo chambers among these politicians by characterizing insularity of topics discussed by groups of Senators and provide uncertainty quantification.


title: Adversarial Visual Robustness by Causal Intervention

abstract: Adversarial training is the de facto most promising defense against adversarial examples. Yet, its passive nature inevitably prevents it from being immune to unknown attackers. To achieve a proactive defense, we need a more fundamental understanding of adversarial examples, beyond the popular bounded threat model. In this paper, we provide a causal viewpoint of adversarial vulnerability: the cause is the spurious correlation ubiquitously existing in learning, i.e., the confounding effect, where attackers are precisely exploiting these effects. Therefore, a fundamental solution for adversarial robustness is by causal intervention. As these visual confounders are imperceptible in general, we propose to use the instrumental variable that achieves causal intervention without the need for confounder observation. We term our robust training method as Causal intervention by instrumental Variable (CiiV). It's a causal regularization that 1) augments the image with multiple retinotopic centers and 2) encourages the model to learn causal features, rather than local confounding patterns, by favoring features linearly responding to spatial interpolations. Extensive experiments on a wide spectrum of attackers and settings applied in CIFAR-10, CIFAR-100, and mini-ImageNet demonstrate that CiiV is robust to adaptive attacks, including the recent AutoAttack. Besides, as a general causal regularization, it can be easily plugged into other methods to further boost the robustness.


title: Characterization of stilbene-d12 for neutron spectroscopy without time of flight

abstract: We have experimentally characterized the light-output response of a deuterated trans-stilbene (stilbene-d12) crystal to quasi-monoenergetic neutrons in the 0.8 to 4.4 MeV energy range. These data allowed us to perform neutron spectroscopy measurements of a DT 14.1 MeV source and a PuBe-239 source by unfolding the impinging neutron spectrum from the measured light-output response. The stilbene-d12 outperforms a H1-stilbene of similar size when comparing the shape of the unfolded spectra and the reference ones. These results confirm the viability of non-hygroscopic stilbene-d12 crystal for direct neutron spectroscopy without need for time-of-flight measurements. This capability makes stilbene-d12 a well suited detector for fast-neutron spectroscopy in many applications including nuclear reaction studies, radiation protection, nuclear non-proliferation, and space travel.