title: $N$-Timescale Stochastic Approximation: Stability and Convergence

abstract: This paper presents the first sufficient conditions that guarantee the stability and almost sure convergence of $N$-timescale stochastic approximation (SA) iterates for any $N\geq1$. It extends the existing results on One-timescale and Two-timescale SA iterates to general $N$-timescale stochastic recursions using the ordinary differential equation (ODE) method. As an application of our results, we study SA algorithms with an added heavy ball momentum term in the context of Gradient Temporal Difference (GTD) algorithms. We show that, when the momentum parameters are chosen in a certain way, the schemes are stable and convergent to the same solution using our proposed results.


title: Magnetization process of the S=1/2 Heisenberg antiferromagnet on the floret pentagonal lattice

abstract: We study the S=1/2 Heisenberg antiferromagnet on the floret pentagonal lattice by numerical diagonalization method. This system shows various behaviours that are different from that of the Cairo-pentagonal-lattice antiferromagnet. The ground-state energy without magnetic field and the magnetization process of this system are reported. Magnetization plateaux appear at one-ninth height of the saturation magnetization, at one-third height, and at seven-ninth height. The magnetization plateaux at one-third and seven-ninth heights come from interactions linking the sixfold-coordinated spin sites. A magnetization jump appears from the plateau at one-ninth height to the plateau at one-third height. Another magnetization jump is observed between the heights corresponding to the one-third and seven-ninth plateaux; however the jump is away from the two plateaux, namely, the jump is not accompanied with any magnetization plateaux. The jump is a peculiar phenomenon that has not been reported.


title: CG-NeRF: Conditional Generative Neural Radiance Fields

abstract: While recent NeRF-based generative models achieve the generation of diverse 3D-aware images, these approaches have limitations when generating images that contain user-specified characteristics. In this paper, we propose a novel model, referred to as the conditional generative neural radiance fields (CG-NeRF), which can generate multi-view images reflecting extra input conditions such as images or texts. While preserving the common characteristics of a given input condition, the proposed model generates diverse images in fine detail. We propose: 1) a novel unified architecture which disentangles the shape and appearance from a condition given in various forms and 2) the pose-consistent diversity loss for generating multimodal outputs while maintaining consistency of the view. Experimental results show that the proposed method maintains consistent image quality on various condition types and achieves superior fidelity and diversity compared to existing NeRF-based generative models.


title: Genetic Algorithm for Constrained Molecular Inverse Design

abstract: A genetic algorithm is suitable for exploring large search spaces as it finds an approximate solution. Because of this advantage, genetic algorithm is effective in exploring vast and unknown space such as molecular search space. Though the algorithm is suitable for searching vast chemical space, it is difficult to optimize pharmacological properties while maintaining molecular substructure. To solve this issue, we introduce a genetic algorithm featuring a constrained molecular inverse design. The proposed algorithm successfully produces valid molecules for crossover and mutation. Furthermore, it optimizes specific properties while adhering to structural constraints using a two-phase optimization. Experiments prove that our algorithm effectively finds molecules that satisfy specific properties while maintaining structural constraints.


title: Systematic study for the surface properties of neutron star

abstract: [Background] In our earlier work {\bf [Phys. Rev. C 104, 055804 (2021)]}, we studied the surface properties of a neutron star, assuming it as a huge finite nucleus containing protons, neutrons, electrons, and muons. For the first time, we reported these results of a neutron star for a few representative masses. In the present paper, we give a detailed study of these quantities to draw definite conclusions. [Method]To carry forward our earlier idea, the energy density functional of the momentum space of neutron star matter is converted to the coordinate space in a local density approximation. This functional is again used to derive the neutron star surface properties within the coherent density fluctuation model using the weight function obtained from the density profile of the neutron star using the recently developed G3 and widely used NL3 and IU-FSU parameter sets in the context of relativistic mean-field formalism. [Results] The systematic surface properties of the neutron star, such as incompressibility, symmetry energy, slope parameter, and curvature coefficient, is calculated. The volume and surface components of the total symmetry energy are decomposed with the help of the $\kappa$ factor obtained from the volume to surface ratio of the symmetry energies in the liquid drop limit of Danielewicz. The magnitude of the computed surface quantities increases with the neutron star's mass. [Conclusion] The incompressibility $K^{\rm star}$, symmetry energy $S^{\rm star}$, slope parameter $L_{\rm sym}^{\rm star}$ and curvature coefficient $K_{\rm sym}^{\rm star}$ of the neutron stars with different mass are analyzed and found to be model dependent. NL3 is the stiffest equation of state endue us with the higher magnitude of surface quantities as compared to the G3 and IU-FSU forces.


title: Collision centrality and system size dependences of light nuclei production via dynamical coalescence mechanism

abstract: Light (anti-)nuclei in relativistic heavy-ion collisions are considered to be formed by the coalescence mechanism of (anti-)nucleons in the present work. Using a dynamical phase-space coalescence model coupled with a multi-phase transport (AMPT) model, we explore the formation of light clusters such as deuteron, triton and their anti-particles in different centralities for $^{197}$Au + $^{197}$Au collisions at $\sqrt{s_{NN}} = 39$ GeV. The calculated transverse momentum spectra of protons, deuterons, and tritons are comparable to those of experimental data from the RHIC-STAR collaboration. Both coalescence parameters $B_{2}$ for (anti-)deuteron and $B_{3}$ for triton increase with the transverse momentum as well as the collision centrality, and they are comparable with the measured values in experiments. The effect of system size on the production of light nuclei is also investigated by $^{10}$B + $^{10}$B, $^{16}$O + $^{16}$O, $^{40}$Ca + $^{40}$Ca, and $^{197}$Au + $^{197}$Au systems in central collisions. The results show that yields of light nuclei increase with system size, while the values of coalescence parameters present an opposite trend. It is interesting to see that the system size, as well as the centrality dependence of $B_A$ ($A$ = 2, 3), falls into the same group, which further demonstrates production probability of light nuclei is proportional to the size of the fireball. Furthermore, we compare our coalescence results with other models, such as the thermal model and analytic coalescence model, it seems that the description of light nuclei production is consistent with each other.


title: UNITER-Based Situated Coreference Resolution with Rich Multimodal Input

abstract: We present our work on the multimodal coreference resolution task of the Situated and Interactive Multimodal Conversation 2.0 (SIMMC 2.0) dataset as a part of the tenth Dialog System Technology Challenge (DSTC10). We propose a UNITER-based model utilizing rich multimodal context such as textual dialog history, object knowledge base and visual dialog scenes to determine whether each object in the current scene is mentioned in the current dialog turn. Results show that the proposed approach outperforms the official DSTC10 baseline substantially, with the object F1 score boosted from 36.6% to 77.3% on the development set, demonstrating the effectiveness of the proposed object representations from rich multimodal input. Our model ranks second in the official evaluation on the object coreference resolution task with an F1 score of 73.3% after model ensembling.


title: Production of excited heavy quarkonia in $e^+e^- \to \gamma^*/Z^0 \to |(Q\bar{Q})[n]\rangle +\gamma$ at super $Z$ factory

abstract: Within the nonrelativistic quantum chromodynamics framework, we make a comprehensive study on the exclusive production of excited charmonium and bottomonium in $e^+e^-\to \gamma^*/Z^0 \to|(Q\bar{Q})[n]\rangle +\gamma$ ($Q=c$ or $b$ quarks) at future $Z$ factory, where the $[n]$ represents the color-singlet $n^1S_0,~n^3S_1,~n^1P_0$ and $n^3P_J$ ($n=1,2,3,4; J=0,1,2$) Fock states. The "improved trace technology" is adopted to derive the analytic expressions at the amplitude level, which is useful for calculating the complicated $nP$-wave channels. Total cross sections, differential distributions, and uncertainties are discussed in system. According to our study, production rates of heavy quarkonia of high excited Fock states are considerable at future $Z$ factory. The cross sections of charmonium for $2S$, $3S$, $4S$, $1P$, $2P$, $3P$ and $4P$-wave states are about $53.5\%$, $30.4\%$, $23.7\%$, $13.7\%$, $6.8\%$, $9.2\%$, and $9.2\%$ of that of the $1S$ state, respectively. And cross sections of bottomonium for $2S$, $3S$, $4S$, $1P$, $2P$, $3P$ and $4P$-wave states are about $39.3\%$, $12.3\%$, $14.3\%$, $7.1\%$, $3.1\%$, $2.7\%$, and $3.1\%$ of that of the $1S$ state, respectively. The main uncertainties come from the radial wave functions at the origin and their derivatives at the origin under different potential models. Then, such super $Z$ factory should be a good platform to study the properties of the high excited charmonium and bottomonium states.


title: Distributed Containment Reference Signal for Nonholonomic Planar Vehicles

abstract: Cooperative of multiple nonholonomic vehicles can be converted into tracking problems of a single-vehicle. The reference trajectory design within distributed features for each vehicle in the group is addressed in this note. The motivation is that nonholonomic vehicles cannot achieve asymptotical stabilization of non-feasible reference signals, and modifications about the virtual reference trajectory design are needed. Reduced-order design and time-varying technique, and some simple geometry tricks are applied to derive the dynamic reference trajectory.


title: Self-healing and transformation characteristics of obstructed Hermite-Gaussian modes composed structured beams

abstract: The self-healing property of laser beams is of great interest. And a laser beam with spatial structures is also widely concerned due to its important applications in lots of areas. We theoretically and experimentally investigate the self-healing and transformation characteristics of obstructed structured beams composed by incoherent or coherent superposition of multiple Hermite-Gaussian (HG) modes. We reveal that partially obstructed single HG mode can recover itself or transfer to a lower order in the far-field. When the obstacle retains one pair of edged bright spots of HG mode in each direction of its two symmetry axes, the beam structure information (number of knot lines) along each axis can be restored. Otherwise, it will be transferred to the corresponding low-order HG mode or multi interference fringes in the far-field, according to the interval of the two most edged remaining spots on each axis. It's proved that the above effect is induced by the diffraction and interference results of the partially retained light field. This principle is also applicable to multi-eigenmodes composed beams with special customized optical structures. Then the self-healing and transformation characteristics of the partially obstructed HG modes composed structured beams are investigated. It's found that the HG modes incoherently composed structured beams have a strong ability to recover themselves in the far-field after occlusion. These investigations can expand the applications of optical lattice structures of laser communication, atom optical capture, and optical imaging.


title: Enhanced thermoelectric performance by van Hove singularities in the density of states of type-II nodal-line semimetals

abstract: The effects of the unique density of states (DOS) of a topological type-II nodal-line semimetal (NLS) on its thermoelectric (TE) transport properties are investigated through a combination of semi-analytical and first-principles methods with "spinless Mg$_3$Bi$_2$" as artificial material. The DOS in such a type-II NLS possesses two van Hove singularities near the energy of the nodal line that leads to a large $S$ value compared to the normal metals. Combined with the linear band at the nodal line that gives high electrical conductivity $\sigma$, the type-II NLS can exhibit a relatively high TE power factor ($\text{PF}=S^2\sigma$) at the nodal line. In particular, we find $\text{PF} \sim 60$ $\mu$W/cmK$^2$ at 300 K for the n-type Mg$_3$Bi$_2$ by considering the electron-phonon scattering, in which the relaxation time $\tau$ of carriers can be expressed as $\tau\propto\text{DOS}^{-1}$ for the type-II NLS. Furthermore, we optimize parameters for the TE power factor of type-II NLSs in general by adopting the two-band model with the DOS-dependent relaxation time approximation. Our results suggest the type-II NLSs as a potential class of high-performance TE materials among metals and semimetals, which are traditionally considered not good TE materials compared to semiconductors.


title: Socially acceptable route planning and trajectory behavior analysis of personal mobility device for mobility management with improved sensing

abstract: In urban cities, with increasing acceptability of shared spaces used by pedestrians and personal mobility devices (PMDs), there is need for pragmatic socially ac-ceptable path planning and navigation management policies. Hence, we propose a socially acceptable global route planner and assess the legibility of the resulting global route. Our approach proposed for choosing global route avoids streets penetrating shared spaces and main routes with high probability of dense usage. The experimental study shows that socially acceptable routes can be effectively found with an average of 10 % increment of route length with optimal hyperpa-rameters. This helps PMDs to reach the goal while taking a socially acceptable and safe route with minimal interaction of different PMDs and pedestrians. When PMDs interact with pedestrians and other types of PMDs in shared spaces, mi-cro-mobility simulations are of prime usage for acceptable and safe navigation policy. Social force models being state of the art for pedestrian simulation are cal-ibrated for capturing random movements of pedestrian behavior. Social force model with calibration can imitate the required behavior of PMDs in a pedestrian mix navigation scheme. Based on calibrated models, simulations on shared space links and gate structures are performed to assist policies related to deciding wait-ing and stopping time. Also, based on simulated PMDs interaction with pedestri-ans, location data with finer resolution can be obtained if the resolution of GPS sensor is 0.2 m or less. This will help in formalizing better modelling and hence better micro-mobility policies.


title: Reionization process dependence of the ratio of CMB polarization power spectra at low-$\ell$

abstract: We investigate how much the ratio of cosmic microwave background (CMB) polarization power spectra $C^{BB}_\ell/C^{EE}_\ell$ at low-$\ell$ ($\ell \lesssim 10$) depends on the process of reionization. Both such low-$\ell$ B-mode and E-mode polarization powers are dominantly produced by Thomson scattering of CMB photons off the free electrons which are produced in the process of reionization. Since the reionization should be finished until at least the redshift $z \simeq 6$ and the low-$\ell$ polarization powers are produced at late time, the ratio is rather insensitive by the ionization process at higher redshifts, but it is sensitive to the value of optical depth.The value of the ratio at $\ell=2$, however, is almost insensitive to the reionization process including the value of optical depth, and the value is approximately half of the value of tensor-to-scalar ratio. This fact can be utilized for future determination of tensor-to-scalar ratio in spite of the ambiguity due to cosmic variance.


title: Physics guided deep learning generative models for crystal materials discovery

abstract: Deep learning based generative models such as deepfake have been able to generate amazing images and videos. However, these models may need significant transformation when applied to generate crystal materials structures in which the building blocks, the physical atoms are very different from the pixels. Naively transferred generative models tend to generate a large portion of physically infeasible crystal structures that are not stable or synthesizable. Herein we show that by exploiting and adding physically oriented data augmentation, loss function terms, and post processing, our deep adversarial network (GAN) based generative models can now generate crystal structures with higher physical feasibility and expand our previous models which can only create cubic structures.


title: Ground-Truth, Whose Truth? -- Examining the Challenges with Annotating Toxic Text Datasets

abstract: The use of machine learning (ML)-based language models (LMs) to monitor content online is on the rise. For toxic text identification, task-specific fine-tuning of these models are performed using datasets labeled by annotators who provide ground-truth labels in an effort to distinguish between offensive and normal content. These projects have led to the development, improvement, and expansion of large datasets over time, and have contributed immensely to research on natural language. Despite the achievements, existing evidence suggests that ML models built on these datasets do not always result in desirable outcomes. Therefore, using a design science research (DSR) approach, this study examines selected toxic text datasets with the goal of shedding light on some of the inherent issues and contributing to discussions on navigating these challenges for existing and future projects. To achieve the goal of the study, we re-annotate samples from three toxic text datasets and find that a multi-label approach to annotating toxic text samples can help to improve dataset quality. While this approach may not improve the traditional metric of inter-annotator agreement, it may better capture dependence on context and diversity in annotators. We discuss the implications of these results for both theory and practice.


title: A Conditional Point Diffusion-Refinement Paradigm for 3D Point Cloud Completion

abstract: 3D point cloud is an important 3D representation for capturing real world 3D objects. However, real-scanned 3D point clouds are often incomplete, and it is important to recover complete point clouds for downstream applications. Most existing point cloud completion methods use Chamfer Distance (CD) loss for training. The CD loss estimates correspondences between two point clouds by searching nearest neighbors, which does not capture the overall point density distribution on the generated shape, and therefore likely leads to non-uniform point cloud generation. To tackle this problem, we propose a novel Point Diffusion-Refinement (PDR) paradigm for point cloud completion. PDR consists of a Conditional Generation Network (CGNet) and a ReFinement Network (RFNet). The CGNet uses a conditional generative model called the denoising diffusion probabilistic model (DDPM) to generate a coarse completion conditioned on the partial observation. DDPM establishes a one-to-one pointwise mapping between the generated point cloud and the uniform ground truth, and then optimizes the mean squared error loss to realize uniform generation. The RFNet refines the coarse output of the CGNet and further improves quality of the completed point cloud. Furthermore, we develop a novel dual-path architecture for both networks. The architecture can (1) effectively and efficiently extract multi-level features from partially observed point clouds to guide completion, and (2) accurately manipulate spatial locations of 3D points to obtain smooth surfaces and sharp details. Extensive experimental results on various benchmark datasets show that our PDR paradigm outperforms previous state-of-the-art methods for point cloud completion. Remarkably, with the help of the RFNet, we can accelerate the iterative generation process of the DDPM by up to 50 times without much performance drop.


title: Casselman-Shahidi's conjecture on normalized intertwining operators for groups of classical type

abstract: Intertwining operators play an essential role and appear everywhere in the Langlands program, their analytic properties interact directly, yet deeply with the decomposition of parabolic induction locally and the residues of Eisenstein series globally. Inspired by the profound Langlands-Shahidi theory, Casselman-Shahidi conjectured that a certain normalization factor would govern the singularity of intertwining operators for generic standard modules. Indeed, motivated by the theory of theta correspondence, especially the Siegel-Weil formula globally, and the composition problem of degenerate principal series and the demand of a g.c.d. definition of standard $L$-functions in the framework of the doubling method locally, an optimal normalization factor has been determined for degenerate principal series of classical groups via the theory of integrals on prehomogeneous vector spaces. Such a method seems impossible to be generalized to work even in the setting of degenerate generalized principal series, which are naturally involved in the recent Cai-Friedberg-Ginzburg-Kaplan's generalized doubling method. To circumvent it, we discover a new uniform argument that can answer the singularity problem of intertwining operators for a large class of induced representations. As an illustration, we prove the aforementioned Casselman-Shahidi conjecture for quasi-split groups of classical type in the paper. Along the way, with the help of Shahidi's local coefficient theory, we also prove that those normalized intertwining operators are always non-zero, and provide a new one-sentence proof of the standard module conjecture in the spirit of Casselman-Shahidi.


title: Renormalization constants of overlap quark bilinear operators from RI/MOM and RI/SMOM scheme

abstract: We calculate the renormalization constants (RCs) of vector, axial, vector scalar, pseudoscalar and tensor quark operators of the overlap valence fermion, on the 11 gauge ensembles with dynamical fermion using either Domain wall fermion~(DWF) action orHighly improved stagger quark~(HISQ) action at lattice spacings from 0.04 fm to 0.20 fm. We find the results under the $\overline{\text{MS}}$ scheme using either the RI/MOM or RI/SMOM scheme are consistent with each other, once the proper $a^2p^2$ extrapolation is applied and the systematic uncertainties are estimated cautiously. Our results with different gauge and fermion actions also indicate that the RCs are majorly dependent on the lattice spacing (as the inverse of UV cut-off) rather than the bare gauge coupling used by the gauge action.


title: A Time-domain Real-valued Generalized Wiener Filter for Multi-channel Neural Separation Systems

abstract: Frequency-domain beamformers have been successful in a wide range of multi-channel neural separation systems in the past years. However, the operations in conventional frequency-domain beamformers are typically independently-defined and complex-valued, which result in two drawbacks: the former does not fully utilize the advantage of end-to-end optimization, and the latter may introduce numerical instability during the training phase. Motivated by the recent success in end-to-end neural separation systems, in this paper we propose time-domain real-valued generalized Wiener filter (TD-GWF), a linear filter defined on a 2-D learnable real-valued signal transform. TD-GWF splits the transformed representation into groups and performs an minimum mean-square error (MMSE) estimation on all available channels on each of the groups. We show how TD-GWF can be connected to conventional filter-and-sum beamformers when certain signal transform and the number of groups are specified. Moreover, given the recent success in the sequential neural beamforming frameworks, we show how TD-GWF can be applied in such frameworks to perform iterative beamforming and separation to obtain an overall performance gain. Comprehensive experiment results show that TD-GWF performs consistently better than conventional frequency-domain beamformers in the sequential neural beamforming pipeline with various neural network architectures, microphone array scenarios, and task configurations.


title: Deep Surrogate Assisted MAP-Elites for Automated Hearthstone Deckbuilding

abstract: We study the problem of efficiently generating high-quality and diverse content in games. Previous work on automated deckbuilding in Hearthstone shows that the quality diversity algorithm MAP-Elites can generate a collection of high-performing decks with diverse strategic gameplay. However, MAP-Elites requires a large number of expensive evaluations to discover a diverse collection of decks. We propose assisting MAP-Elites with a deep surrogate model trained online to predict game outcomes with respect to candidate decks. MAP-Elites discovers a diverse dataset to improve the surrogate model accuracy, while the surrogate model helps guide MAP-Elites towards promising new content. In a Hearthstone deckbuilding case study, we show that our approach improves the sample efficiency of MAP-Elites and outperforms a model trained offline with random decks, as well as a linear surrogate model baseline, setting a new state-of-the-art for quality diversity approaches in automated Hearthstone deckbuilding. We include the source code for all the experiments at: https://github.com/icaros-usc/EvoStone2.


title: Horospherical random graphs

abstract: Expanders are sparse graph that are strongly connected, where {\it connectivity} is quantified using eigenvalues of the adjacency matrix, and {\it sparsity} in terms of vertex valency. We give a model of random graphs and study their connectivity and sparsity. This model is a particular case of soft geometric random graphs, and allows to construct sparse graphs with good expansion properties, as well as highly clustered ones. On those graphs, we study the speed at which random walks spread in the graph, and visit all vertices. As an illustration, we build a model for mainland France and study the spread of random walks under several types of lockdown. Our experiments show that completely closing medium and long distance travel to slow down the spread of a random walk is more efficient than than local restrictions.


title: Learning Pixel-Adaptive Weights for Portrait Photo Retouching

abstract: Portrait photo retouching is a photo retouching task that emphasizes human-region priority and group-level consistency. The lookup table-based method achieves promising retouching performance by learning image-adaptive weights to combine 3-dimensional lookup tables (3D LUTs) and conducting pixel-to-pixel color transformation. However, this paradigm ignores the local context cues and applies the same transformation to portrait pixels and background pixels when they exhibit the same raw RGB values. In contrast, an expert usually conducts different operations to adjust the color temperatures and tones of portrait regions and background regions. This inspires us to model local context cues to improve the retouching quality explicitly. Firstly, we consider an image patch and predict pixel-adaptive lookup table weights to precisely retouch the center pixel. Secondly, as neighboring pixels exhibit different affinities to the center pixel, we estimate a local attention mask to modulate the influence of neighboring pixels. Thirdly, the quality of the local attention mask can be further improved by applying supervision, which is based on the affinity map calculated by the groundtruth portrait mask. As for group-level consistency, we propose to directly constrain the variance of mean color components in the Lab space. Extensive experiments on PPR10K dataset verify the effectiveness of our method, e.g. on high-resolution photos, the PSNR metric receives over 0.5 gains while the group-level consistency metric obtains at least 2.1 decreases.


title: Simulation of thermodynamic properties of magnetic transition metals from an efficient tight-binding model

abstract: Atomic scale simulations at finite temperature are an ideal approach to study the thermodynamic properties of magnetic transition metals. However, the development of interatomic potentials explicitly taking into account magnetic variables is a delicate task. In this context, we present a tight-binding model for magnetic transition metals in the Stoner approximation. This potential is integrated into a Monte Carlo structural relaxations code where trials of atomic displacements as well as fluctuations of local magnetic moments are performed to determine the thermodynamic equilibrium state of the considered systems. As an example, the Curie temperature of cobalt is investigated while showing the important role of atomic relaxations. Furthermore, our model is generalized to other transition metals highlighting a local magnetic moment distribution that varies with the gradual filling of the d states. Consequently, the successful validation of the potential for different magnetic configurations indicates its great transferability makes it a good choice for atomistic simulations sampling a large configuration space.


title: Entanglement percolation and spheres in $\mathbb{Z}^d$

abstract: We obtain a new lower bound of 0.06576 for the 1-entanglement critical probability (in dimension 3), and prove that the critical point for the existence of a sphere surrounding the origin and intersecting only closed bonds in $\mathbb{Z}^d$ is greater than $\frac1{8(d-1)}$, $d \geq 3$. This substantially improves the previous lower bounds and gives the correct order of magnitude for large $d$.


title: A Function-Based Approach to Model the Measurement Error in Wearable Devices

abstract: Physical activity (PA) is an important risk factor for many health outcomes. Wearable-devices such as accelerometers are increasingly used in biomedical studies to understand the associations between PA and health outcomes. Statistical analyses involving accelerometer data are challenging due to the following three characteristics: (i) high-dimensionality, (ii) temporal dependence, and (iii) measurement error. To address these challenges we treat accelerometer-based measures of physical activity as a single function-valued covariate prone to measurement error. Specifically, in order to determine the relationship between PA and a health outcome of interest, we propose a regression model with a functional covariate that accounts for measurement error. Using regression calibration, we develop a two-step estimation method for the model parameters and establish their consistency. A test is also proposed to test the significance of the estimated model parameters. Simulation studies are conducted to compare the proposed methods with existing alternative approaches under varying scenarios. Finally, the developed methods are used to assess the relationship between PA intensity and BMI obtained from the National Health and Nutrition Examination Survey data.


title: A theory of optimal convex regularization for low-dimensional recovery

abstract: We consider the problem of recovering elements of a low-dimensional model from under-determined linear measurements. To perform recovery, we consider the minimization of a convex regularizer subject to a data fit constraint. Given a model, we ask ourselves what is the "best" convex regularizer to perform its recovery. To answer this question, we define an optimal regularizer as a function that maximizes a compliance measure with respect to the model. We introduce and study several notions of compliance. We give analytical expressions for compliance measures based on the best-known recovery guarantees with the restricted isometry property. These expressions permit to show the optimality of the ${\ell}$1-norm for sparse recovery and of the nuclear norm for low-rank matrix recovery for these compliance measures. We also investigate the construction of an optimal convex regularizer using the examples of sparsity in levels and of sparse plus low-rank models.


title: Predicting the Travel Distance of Patients to Access Healthcare using Deep Neural Networks

abstract: Objective: Improving geographical access remains a key issue in determining the sufficiency of regional medical resources during health policy design. However, patient choices can be the result of the complex interactivity of various factors. The aim of this study is to propose a deep neural network approach to model the complex decision of patient choice in travel distance to access care, which is an important indicator for policymaking in allocating resources. Method: We used the 4-year nationwide insurance data of Taiwan and accumulated the possible features discussed in earlier literature. This study proposes the use of a convolutional neural network (CNN)-based framework to make predictions. The model performance was tested against other machine learning methods. The proposed framework was further interpreted using Integrated Gradients (IG) to analyze the feature weights. Results: We successfully demonstrated the effectiveness of using a CNN-based framework to predict the travel distance of patients, achieving an accuracy of 0.968, AUC of 0.969, sensitivity of 0.960, and specificity of 0.989. The CNN-based framework outperformed all other methods. In this research, the IG weights are potentially explainable; however, the relationship does not correspond to known indicators in public health, similar to common consensus. Conclusions: Our results demonstrate the feasibility of the deep learning-based travel distance prediction model. It has the potential to guide policymaking in resource allocation.


title: Lower bounds for the spectral gap and an extension of the Bonnet-Myers theorem

abstract: On a fairly general class of Riemannian manifolds M, we prove lower estimates in terms of the Ricci curvature for the spectral bound (when M has infinite volume) and for the spectral gap (when M has finite volume) for the Laplace-Beltrami operator. As a byproduct of our results we obtain an extension of the Bonnet-Myers theorem on the compactness of the manifold. We also prove lower bounds for the spectral gap for Ornstein-Uhlenbeck type operators on weighted manifolds. As an application we prove lower bounds for the spectral gap of perturbations of some radial measures on R n .


title: Phase Transition of the 3-Majority Dynamics with Uniform Communication Noise

abstract: Communication noise is a common feature in several real-world scenarios where systems of agents need to communicate in order to pursue some collective task. In particular, many biologically inspired systems that try to achieve agreements on some opinion must implement resilient dynamics that are not strongly affected by noisy communications. In this work, we study the popular 3-Majority dynamics, an opinion dynamics which has been proved to be an efficient protocol for the majority consensus problem, in which we introduce a simple feature of uniform communication noise, following (d'Amore et al. 2020). We prove that in the fully connected communication network of n agents and in the binary opinion case, the process induced by the 3-Majority dynamics exhibits a phase transition. For a noise probability $p < 1/3$, the dynamics reaches in logarithmic time an almost-consensus metastable phase which lasts for a polynomial number of rounds with high probability. Furthermore, departing from previous analyses, we further characterize this phase by showing that there exists an attractive equilibrium value $s_{\text{eq}} \in [n]$ for the bias of the system, i.e. the difference between the majority community size and the minority one. Moreover, the agreement opinion turns out to be the initial majority one if the bias towards it is of magnitude $\Omega(\sqrt{n\log n})$ in the initial configuration. If, instead, $p > 1/3$, no form of consensus is possible, and any information regarding the initial majority opinion is lost in logarithmic time with high probability. Despite more communications per-round are allowed, the 3-Majority dynamics surprisingly turns out to be less resilient to noise than the Undecided-State dynamics (d'Amore et al. 2020), whose noise threshold value is $p = 1/2$.


title: A double-period oscillation signal in millimeter emission of the radio galaxy NGC 1275

abstract: The nearby Seyfert type galaxy NGC 1275 contains a bright radio nucleus at its center, revealed through high-spatial resolution imaging to be the source of the jets emanating from the galaxy. Coincident with the emergence of a new component C3 in the nucleus since 2005, flux densities from NGC 1275, at least at radio, millimeter (mm), and gamma-ray frequencies, had been increasing up through 2017 and leveled off afterwards. We analyze the long-term light curves of the nucleus that span the rising trend to 2015 July, and find a pair of approximately year-long quasi-periodic oscillations, with periods of $P_l\simeq 345$\,d and $P_h\simeq 386$\,d respectively, in emission at 1.3-mm wavelength. We discuss the case that there would be a long precession period $P_{\rm prec}\simeq 9$\,yr, causing the appearance of $P_h$ that is slightly higher than $P_l$. The accretion disk around the central supermassive black hole (SMBH) would be precessing at $P_{\rm prec}$, induced by either the Lense-Thirring effect or the existence of a companion SMBH. In the two scenarios, $P_l$ would be the jet wobbling timescale or the SMBH binary period respectively. The finding, which could be verified through high-spatial resolution mm imaging, would not only identify the nature of the jet variation but also help reveal the full features of the galaxy.


title: Global well-posedness and long-time asymptotics of a general nonlinear non-local Burgers Equation

abstract: This paper is concerned with the study of a nonlinear non-local equation that has a commutator structure. The equation reads $\partial_t u-F(u) (-\Delta)^{s/2} u+(-\Delta)^{s/2} (uF(u))=0$, $x\in \mathbb{T}^d$, with s $\in$ (0, 1]. We are interested in solutions stemming from periodic positive bounded initial data. The given function $F \in C^\infty (R^+)$ must satisfy $F' > 0$ a.e. on (0, +$\infty$). For instance, all the functions $F (u) = u^n$ with n $\in$ N * are admissible non-linearities. We construct global classical solutions starting from smooth positive data, and global weak solutions starting from positive data in $L^\infty$. We show that any weak solution is instantaneously regularized into $C^\infty$. We also describe the long-time asymptotics of all solutions. Our methods follow several recent advances in the regularity theory of parabolic integro-differential equations.


title: Beyond network centrality: Individual-level behavioral traits for predicting information superspreaders in social media

abstract: Understanding the heterogeneous role of individuals in large-scale information spreading is essential to manage online behavior as well as its potential offline consequences. To this end, most existing studies from diverse research domains focus on the disproportionate role played by highly-connected ``hub" individuals. However, we demonstrate here that information superspreaders in online social media are best understood and predicted by simultaneously considering two individual-level behavioral traits: influence and susceptibility. Specifically, we derive a nonlinear network-based algorithm to quantify individuals' influence and susceptibility from multiple spreading event data. By applying the algorithm to large-scale data from Twitter and Weibo, we demonstrate that individuals' estimated influence and susceptibility scores enable predictions of future superspreaders above and beyond network centrality, and reveal new insights on the network position of the superspreaders.


title: Self-Organized Polynomial-Time Coordination Graphs

abstract: Coordination graph is a promising approach to model agent collaboration in multi-agent reinforcement learning. It conducts a graph-based value factorization and induces explicit coordination among agents to complete complicated tasks. However, one critical challenge in this paradigm is the complexity of greedy action selection with respect to the factorized values. It refers to the decentralized constraint optimization problem (DCOP), which and whose constant-ratio approximation are NP-hard problems. To bypass this systematic hardness, this paper proposes a novel method, named Self-Organized Polynomial-time Coordination Graphs (SOP-CG), which uses structured graph classes to guarantee the accuracy and the computational efficiency of collaborated action selection. SOP-CG employs dynamic graph topology to ensure sufficient value function expressiveness. The graph selection is unified into an end-to-end learning paradigm. In experiments, we show that our approach learns succinct and well-adapted graph topologies, induces effective coordination, and improves performance across a variety of cooperative multi-agent tasks.


title: Private Robust Estimation by Stabilizing Convex Relaxations

abstract: We give the first polynomial time and sample $(\epsilon, \delta)$-differentially private (DP) algorithm to estimate the mean, covariance and higher moments in the presence of a constant fraction of adversarial outliers. Our algorithm succeeds for families of distributions that satisfy two well-studied properties in prior works on robust estimation: certifiable subgaussianity of directional moments and certifiable hypercontractivity of degree 2 polynomials. Our recovery guarantees hold in the "right affine-invariant norms": Mahalanobis distance for mean, multiplicative spectral and relative Frobenius distance guarantees for covariance and injective norms for higher moments. Prior works obtained private robust algorithms for mean estimation of subgaussian distributions with bounded covariance. For covariance estimation, ours is the first efficient algorithm (even in the absence of outliers) that succeeds without any condition-number assumptions. Our algorithms arise from a new framework that provides a general blueprint for modifying convex relaxations for robust estimation to satisfy strong worst-case stability guarantees in the appropriate parameter norms whenever the algorithms produce witnesses of correctness in their run. We verify such guarantees for a modification of standard sum-of-squares (SoS) semidefinite programming relaxations for robust estimation. Our privacy guarantees are obtained by combining stability guarantees with a new "estimate dependent" noise injection mechanism in which noise scales with the eigenvalues of the estimated covariance. We believe this framework will be useful more generally in obtaining DP counterparts of robust estimators. Independently of our work, Ashtiani and Liaw [AL21] also obtained a polynomial time and sample private robust estimation algorithm for Gaussian distributions.


title: GaTector: A Unified Framework for Gaze Object Prediction

abstract: Gaze object prediction is a newly proposed task that aims to discover the objects being stared at by humans. It is of great application significance but still lacks a unified solution framework. An intuitive solution is to incorporate an object detection branch into an existing gaze prediction method. However, previous gaze prediction methods usually use two different networks to extract features from scene image and head image, which would lead to heavy network architecture and prevent each branch from joint optimization. In this paper, we build a novel framework named GaTector to tackle the gaze object prediction problem in a unified way. Particularly, a specific-general-specific (SGS) feature extractor is firstly proposed to utilize a shared backbone to extract general features for both scene and head images. To better consider the specificity of inputs and tasks, SGS introduces two input-specific blocks before the shared backbone and three task-specific blocks after the shared backbone. Specifically, a novel Defocus layer is designed to generate object-specific features for the object detection task without losing information or requiring extra computations. Moreover, the energy aggregation loss is introduced to guide the gaze heatmap to concentrate on the stared box. In the end, we propose a novel wUoC metric that can reveal the difference between boxes even when they share no overlapping area. Extensive experiments on the GOO dataset verify the superiority of our method in all three tracks, i.e. object detection, gaze estimation, and gaze object prediction.


title: Tensor network approach to the two-dimensional fully frustrated XY model and a chiral ordered phase

abstract: A general framework is proposed to solve the two-dimensional fully frustrated XY model for the Josephson junction arrays in a perpendicular magnetic field. The essential idea is to encode the ground-state local rules induced by frustrations in the local tensors of the partition function. The partition function is then expressed in terms of a product of one-dimensional transfer matrix operator, whose eigen-equation can be solved by an algorithm of matrix product states rigorously. The singularity of the entanglement entropy for the one-dimensional quantum analogue provides a stringent criterion to distinguish various phase transitions without identifying any order parameter a prior. Two very close phase transitions are determined at $T_{c1}\approx 0.4459$ and $T_{c2}\approx 0.4532$, respectively. The former corresponding to a Berezinskii-Kosterlitz-Thouless phase transition describing the phase coherence of XY spins, and the latter is an Ising-like continuous phase transition below which a chirality order with spontaneously broken $Z_2$ symmetry is established.


title: Optimal Scheduling of Energy Storage for Power System with Capability of Sensing Short-term Future PV Power Production

abstract: Constant rise in energy consumption that comes with the population growth and introduction of new technologies has posed critical issues such as efficient energy management on the consumer side. That has elevated the importance of the use of renewable energy sources, particularly photovoltaic (PV) system and wind turbine. This work models and discusses design options based on the hybrid power system of grid and battery storage. The effects of installed capacity on renewable penetration (RP) and cost of electricity (COE) are investigated for each modality. For successful operation of hybrid power system and electricity trading in power market, accurate predictions of PV power production and load demand are taken into account. A machine learning (ML) model is introduced for scheduling, and predicting variations of the PV power production and load demand. Fitness of the ML model shows, when employing a linear regression model, the mean squared error (MSE) of 0.000012, root mean square error (RMSE) of 0.003560 and R2 of 0.999379. Using predicted PV power production and load demand, reduction of electricity cost is 37.5 % when PV and utility grid are utilized, and is 43.06% when PV, utility grid, and storage system are utilized.


title: Bootstrapping ViTs: Towards Liberating Vision Transformers from Pre-training

abstract: Recently, vision Transformers (ViTs) are developing rapidly and starting to challenge the domination of convolutional neural networks (CNNs) in the realm of computer vision (CV). With the general-purpose Transformer architecture replacing the hard-coded inductive biases of convolution, ViTs have surpassed CNNs, especially in data-sufficient circumstances. However, ViTs are prone to over-fit on small datasets and thus rely on large-scale pre-training, which expends enormous time. In this paper, we strive to liberate ViTs from pre-training by introducing CNNs' inductive biases back to ViTs while preserving their network architectures for higher upper bound and setting up more suitable optimization objectives. To begin with, an agent CNN is designed based on the given ViT with inductive biases. Then a bootstrapping training algorithm is proposed to jointly optimize the agent and ViT with weight sharing, during which the ViT learns inductive biases from the intermediate features of the agent. Extensive experiments on CIFAR-10/100 and ImageNet-1k with limited training data have shown encouraging results that the inductive biases help ViTs converge significantly faster and outperform conventional CNNs with even fewer parameters. Our code is publicly available at https://github.com/zhfeing/Bootstrapping-ViTs-pytorch.


title: ADD: Frequency Attention and Multi-View based Knowledge Distillation to Detect Low-Quality Compressed Deepfake Images

abstract: Despite significant advancements of deep learning-based forgery detectors for distinguishing manipulated deepfake images, most detection approaches suffer from moderate to significant performance degradation with low-quality compressed deepfake images. Because of the limited information in low-quality images, detecting low-quality deepfake remains an important challenge. In this work, we apply frequency domain learning and optimal transport theory in knowledge distillation (KD) to specifically improve the detection of low-quality compressed deepfake images. We explore transfer learning capability in KD to enable a student network to learn discriminative features from low-quality images effectively. In particular, we propose the Attention-based Deepfake detection Distiller (ADD), which consists of two novel distillations: 1) frequency attention distillation that effectively retrieves the removed high-frequency components in the student network, and 2) multi-view attention distillation that creates multiple attention vectors by slicing the teacher's and student's tensors under different views to transfer the teacher tensor's distribution to the student more efficiently. Our extensive experimental results demonstrate that our approach outperforms state-of-the-art baselines in detecting low-quality compressed deepfake images.


title: Combining optimal control and learning for autonomous aerial navigation in novel indoor environments

abstract: This report proposes a combined optimal control and perception framework for Micro Aerial Vehicle (MAV) autonomous navigation in novel indoor enclosed environments, relying exclusively on on-board sensor data. We use privileged information from a simulator to generate optimal waypoints in 3D space that our perception system learns to imitate. The trained learning based perception module in turn is able to generate similar obstacle avoiding waypoints from sensor data (RGB + IMU) alone. We demonstrate the efficacy of the framework across novel scenes in the iGibson simulation environment.


title: FedDAG: Federated DAG Structure Learning

abstract: To date, most directed acyclic graphs (DAGs) structure learning approaches require data to be stored in a central server. However, due to the consideration of privacy protection, data owners gradually refuse to share their personalized raw data to avoid private information leakage, making this task more troublesome by cutting off the first step. Thus, a puzzle arises: \textit{how do we discover the underlying DAG structure from decentralized data?} In this paper, focusing on the additive noise models (ANMs) assumption of data generation, we take the first step in developing a gradient-based learning framework named FedDAG, which can learn the DAG structure without directly touching the local data and also can naturally handle the data heterogeneity. Our method benefits from a two-level structure of each local model. The first level structure learns the edges and directions of the graph and communicates with the server to get the model information from other clients during the learning procedure, while the second level structure approximates the mechanisms among variables and personally updates on its own data to accommodate the data heterogeneity. Moreover, FedDAG formulates the overall learning task as a continuous optimization problem by taking advantage of an equality acyclicity constraint, which can be solved by gradient descent methods to boost the searching efficiency. Extensive experiments on both synthetic and real-world datasets verify the efficacy of the proposed method.


title: AstroSat view of the newly discovered X-ray transient MAXI~J1803--298 in the Hard-intermediate state

abstract: We perform comprehensive temporal and spectral analysis of the newly discovered X-ray transient MAXI~J1803--298 using an AstroSat target of opportunity observation on May 11, 2021 during its outburst. The source was found to be in the hard intermediate state. We detect type C quasi-periodic oscillations (QPOs) at the frequencies of $\sim5.4$ Hz and $\sim6.3$ Hz along with a sub-harmonic at $\sim2.8$ Hz in the $3-15$ keV band. The frequency and fractional rms amplitude of the QPO in the $15-30$ keV band are found to be higher than those in the $3-15$ keV band. We find soft lags of $\sim3.8$ ms and $\sim6.8$ ms for the respective QPOs at $\sim5.4$ Hz and $\sim6.3$ Hz, whereas soft lag of $\sim4.7$ ms is found at the sub-harmonic frequency. The increase in the soft lags at the QPO frequencies with energy is also observed in other black hole transients and is attributed to the inclination dependence of the lags. The rms-energy spectra indicate the power-law component to be more variable than the disk and the reflection components. We find a broad iron line with an equivalent width of $\sim0.17-0.19$ keV and a reflection hump above $\sim12$ keV in the energy spectrum. Based on the X-ray spectroscopy and considering the distance to the source as 8 kpc, the estimated mass ($\sim8.5-16$ M$_\odot$) and spin ($a\gtrsim0.7$) of the black hole suggest that the source is likely to be a stellar mass Kerr black hole X-ray binary.


title: Multi-speaker Emotional Text-to-speech Synthesizer

abstract: We present a methodology to train our multi-speaker emotional text-to-speech synthesizer that can express speech for 10 speakers' 7 different emotions. All silences from audio samples are removed prior to learning. This results in fast learning by our model. Curriculum learning is applied to train our model efficiently. Our model is first trained with a large single-speaker neutral dataset, and then trained with neutral speech from all speakers. Finally, our model is trained using datasets of emotional speech from all speakers. In each stage, training samples of each speaker-emotion pair have equal probability to appear in mini-batches. Through this procedure, our model can synthesize speech for all targeted speakers and emotions. Our synthesized audio sets are available on our web page.


title: Graph Neural Controlled Differential Equations for Traffic Forecasting

abstract: Traffic forecasting is one of the most popular spatio-temporal tasks in the field of machine learning. A prevalent approach in the field is to combine graph convolutional networks and recurrent neural networks for the spatio-temporal processing. There has been fierce competition and many novel methods have been proposed. In this paper, we present the method of spatio-temporal graph neural controlled differential equation (STG-NCDE). Neural controlled differential equations (NCDEs) are a breakthrough concept for processing sequential data. We extend the concept and design two NCDEs: one for the temporal processing and the other for the spatial processing. After that, we combine them into a single framework. We conduct experiments with 6 benchmark datasets and 20 baselines. STG-NCDE shows the best accuracy in all cases, outperforming all those 20 baselines by non-trivial margins.


title: Dynamics of two dark solitons in a polariton condensate under non-resonant pumping

abstract: We theoretically investigate the dynamics of two dark solitons in a polariton condensate under nonresonant pumping, based on driven dissipative Gross-Pitaevskii equations coupled to the rate equation. In particular, the analytical expression of the effective potential between two dark solitons is given. The resulting equation of motion captures how the open-dissipative character of a polariton Bose-Einstein condensate affects the properties of dynamics of two-dark soliton, i.e., two-dark soliton relax by blending with the background at a finite time. We further simulate the relative motion of two dark solitons numerically with the emphasis on how two solitons' motion being manipulated the initial velocity, which are in excellent agreement with the analytical results. The prediction of this work is sufficient for the experimental observations within current facilities.


title: Gravitational-Wave Geodesy: Defining False Alarm Probabilities with Respect to Correlated Noise

abstract: Future searches for a gravitational-wave background using Earth-based gravitational-wave detectors might be impacted by correlated noise sources. A well known example are the Schumann resonances, which are extensively studied in the context of searches for a gravitational-wave background. Earlier work has shown that a technique termed "gravitational-wave geodesy" can be used to generically differentiate observations of a gravitational-wave background from signals due to correlated terrestrial effects, requiring true observations to be consistent with the known geometry of our detector network. The key result of this test is a Bayes factor between the hypotheses that a candidate signal is astrophysical or terrestrial in origin. Here, we further formalize the geodesy test, mapping distributions of false-alarm and false-acceptance probabilities to quantify the degree with which a given Bayes factor will boost or diminish our confidence in an apparent detection of the gravitational-wave background. To define the false alarm probability of a given Bayes factor, we must have knowledge of our null hypothesis: the space of all possible correlated terrestrial signals. Since we do not have this knowledge we instead construct a generic space of smooth functions in the frequency domain using Gaussian processes, which we tailor to be conservative. This enables us to use draws from our Gaussian processes as a proxy for all possible non-astrophysical signals. As a demonstration, we apply the tool to the SNR = 1.25 excess observed for a 2/3-power law by the LIGO and Virgo collaborations during their second observing run.


title: A_6 invariant curves of genera 10 and 19

abstract: We study smooth curves on which the alternating group $\mathfrak{A}_{6}$ acts faithfully. Let $\mathcal{V} \subset PGL(3, \mathbb{C})$ be the Valentiner group, which is isomorphic to $\mathfrak{A}_{6}$. We see that there are integral $\mathcal{V}$-invariant curves of degree $12$ which have geometric genera $10$ and $19$. On the other hand, if $\mathfrak{A}_{6}$ acts faithfully on a curve $C$ of genus $10$ or $19$, then we give an explicit description of the extension $k(C / \mathfrak{A}_{5}) \rightarrow k(C / \mathfrak{A}_{6})$ for any icosahedral subgroup $\mathfrak{A}_{5}$. Using this, we show the uniqueness of smooth projective curves of genera $10$ and $19$ whose automorphism groups contain $\mathfrak{A}_{6}$.


title: CMA-CLIP: Cross-Modality Attention CLIP for Image-Text Classification

abstract: Modern Web systems such as social media and e-commerce contain rich contents expressed in images and text. Leveraging information from multi-modalities can improve the performance of machine learning tasks such as classification and recommendation. In this paper, we propose the Cross-Modality Attention Contrastive Language-Image Pre-training (CMA-CLIP), a new framework which unifies two types of cross-modality attentions, sequence-wise attention and modality-wise attention, to effectively fuse information from image and text pairs. The sequence-wise attention enables the framework to capture the fine-grained relationship between image patches and text tokens, while the modality-wise attention weighs each modality by its relevance to the downstream tasks. In addition, by adding task specific modality-wise attentions and multilayer perceptrons, our proposed framework is capable of performing multi-task classification with multi-modalities. We conduct experiments on a Major Retail Website Product Attribute (MRWPA) dataset and two public datasets, Food101 and Fashion-Gen. The results show that CMA-CLIP outperforms the pre-trained and fine-tuned CLIP by an average of 11.9% in recall at the same level of precision on the MRWPA dataset for multi-task classification. It also surpasses the state-of-the-art method on Fashion-Gen Dataset by 5.5% in accuracy and achieves competitive performance on Food101 Dataset. Through detailed ablation studies, we further demonstrate the effectiveness of both cross-modality attention modules and our method's robustness against noise in image and text inputs, which is a common challenge in practice.


title: Electrocatalytic reduction of nitrogen to ammonia in ionic liquids

abstract: Ammonia NH3 is an important raw material for nitrogen fertilizer production and is widely used in industry. It is also a carbon free renewable fuel and an excellent hydrogen storage material. Reaction conditions of traditional Haber Bosch process are very harsh although it supports most of todays NH3 production. Recently, electrocatalytic nitrogen reduction reaction NRR has become one of the effective alternative methods to the traditional Haber Bosch process due to the advantages of mild operation conditions and almost no environmental pollutions. Ionic liquids ILs act as one of green solvents possess a lot of unique features and have shown excellent performance in electrocatalytic NRR process. In this review, we summarize fundamentals of the electrocatalytic NRR, the role of ILs in several typical electrocatalytic processes, and the possible role of ILs in the electrocatalytic NRR process. Moreover, the selection principles and issues of the application of ILs, as well as the future development direction for the electrocatalytic NRR process are concluded.


title: Radio Galaxy Zoo: Giant Radio Galaxy Classification using Multi-Domain Deep Learning

abstract: In this work, we explore the potential of multi-domain multi-branch convolutional neural networks (CNNs) for identifying comparatively rare giant radio galaxies from large volumes of survey data, such as those expected for new-generation radio telescopes like the SKA and its precursors. The approach presented here allows models to learn jointly from multiple survey inputs, in this case NVSS and FIRST, as well as incorporating numerical redshift information. We find that the inclusion of multi-resolution survey data results in correction of 39% of the misclassifications seen from equivalent single domain networks for the classification problem considered in this work. We also show that the inclusion of redshift information can moderately improve the classification of giant radio galaxies.


title: Spiking Control Systems

abstract: Spikes and rhythms organize control and communication in the animal world, in contrast to the bits and clocks of digital technology. As continuous-time signals that can be counted, spikes have a mixed nature. This paper reviews ongoing efforts to develop a control theory of spiking systems. The central thesis is that the mixed nature of spiking results from a mixed feedback principle, and that a control theory of mixed feedback can be grounded in the operator theoretic concept of maximal monotonicity. As a nonlinear generalization of passivity, maximal monotonicity acknowledges at once the physics of electrical circuits, the algorithmic tractability of convex optimization, and the feedback control theory of incremental passivity. We discuss the relevance of a theory of spiking control systems in the emerging age of event-based technology.


title: More layers! End-to-end regression and uncertainty on tabular data with deep learning

abstract: This paper attempts to analyze the effectiveness of deep learning for tabular data processing. It is believed that decision trees and their ensembles is the leading method in this domain, and deep neural networks must be content with computer vision and so on. But the deep neural network is a framework for building gradient-based hierarchical representations, and this key feature should be able to provide the best processing of generic structured (tabular) data, not just image matrices and audio spectrograms. This problem is considered through the prism of the Weather Prediction track in the Yandex Shifts challenge (in other words, the Yandex Shifts Weather task). This task is a variant of the classical tabular data regression problem. It is also connected with another important problem: generalization and uncertainty in machine learning. This paper proposes an end-to-end algorithm for solving the problem of regression with uncertainty on tabular data, which is based on the combination of four ideas: 1) deep ensemble of self-normalizing neural networks, 2) regression as parameter estimation of the Gaussian target error distribution, 3) hierarchical multitask learning, and 4) simple data preprocessing. Three modifications of the proposed algorithm form the top-3 leaderboard of the Yandex Shifts Weather challenge respectively. This paper considers that this success has occurred due to the fundamental properties of the deep learning algorithm, and tries to prove this.


title: Lattice walks confined to an octant in dimension 3: (non-)rationality of the second critical exponent

abstract: In the field of enumeration of walks in cones, it is known how to compute asymptotically the number of excursions (finite paths in the cone with fixed length, starting and ending points, using jumps from a given step set). As it turns out, the associated critical exponent is related to the eigenvalues of a certain Dirichlet problem on a spherical domain. An important underlying question is to decide whether this asymptotic exponent is a (non-)rational number, as this has important consequences on the algebraic nature of the associated generating function. In this paper, we ask whether such an excursion sequence might admit an asymptotic expansion with a first rational exponent and a second non-rational exponent. While the current state of the art does not give any access to such many-term expansions, we look at the associated continuous problem, involving Brownian motion in cones. Our main result is to prove that in dimension three, there exists a cone such that the heat kernel (the continuous analogue of the excursion sequence) has the desired rational/non-rational asymptotic property. Our techniques come from spectral theory and perturbation theory. More specifically, our main tool is a new Hadamard formula, which has an independent interest and allows us to compute the derivative of eigenvalues of spherical triangles along infinitesimal variations of the angles.


title: Unsupervised Learning of Compositional Scene Representations from Multiple Unspecified Viewpoints

abstract: Visual scenes are extremely rich in diversity, not only because there are infinite combinations of objects and background, but also because the observations of the same scene may vary greatly with the change of viewpoints. When observing a visual scene that contains multiple objects from multiple viewpoints, humans are able to perceive the scene in a compositional way from each viewpoint, while achieving the so-called "object constancy" across different viewpoints, even though the exact viewpoints are untold. This ability is essential for humans to identify the same object while moving and to learn from vision efficiently. It is intriguing to design models that have the similar ability. In this paper, we consider a novel problem of learning compositional scene representations from multiple unspecified viewpoints without using any supervision, and propose a deep generative model which separates latent representations into a viewpoint-independent part and a viewpoint-dependent part to solve this problem. To infer latent representations, the information contained in different viewpoints is iteratively integrated by neural networks. Experiments on several specifically designed synthetic datasets have shown that the proposed method is able to effectively learn from multiple unspecified viewpoints.


title: A Study of Lightning Activity over Different Ecological Zones of Nepal

abstract: In the present work, occurrence of lightning activity over different ecological zones of Nepal has been studied. It has been observed that Lower Tropical zone receives lightning strikes with largest value of density of strikes whereas the Trans-Himalayan zone receives lightning strikes with least value of density of strikes. The density of lightning strikes over the Lower Tropical zone is 0.199 per square km per year whereas, that over the Trans-Himalayan is 0.02 per square km per year. Other three zones whose values were observed to be in the higher side were Upper Tropical, Sub-tropical and Water Body with annual densities of lightning strikes of 0.145 per square km, 0.121 per square km and 0.12 per square km respectively. During a year, 0.026 per square km and 0.022 per square km are densities of lightning strikes for Alpine and Nival Zones respectively which are close to the lowest value of Trans-Himalayan zone. Remaining two zones, Sub-alpine and Temperate, respectively experienced lightning strikes with densities 0.061 per square km and 0.088 per square km per year.


title: Membership Inference Attacks From First Principles

abstract: A membership inference attack allows an adversary to query a trained machine learning model to predict whether or not a particular example was contained in the model's training dataset. These attacks are currently evaluated using average-case "accuracy" metrics that fail to characterize whether the attack can confidently identify any members of the training set. We argue that attacks should instead be evaluated by computing their true-positive rate at low (e.g., <0.1%) false-positive rates, and find most prior attacks perform poorly when evaluated in this way. To address this we develop a Likelihood Ratio Attack (LiRA) that carefully combines multiple ideas from the literature. Our attack is 10x more powerful at low false-positive rates, and also strictly dominates prior attacks on existing metrics.


title: Neural Networks for Infectious Diseases Detection: Prospects and Challenges

abstract: Artificial neural network (ANN) ability to learn, correct errors, and transform a large amount of raw data into useful medical decisions for treatment and care have increased its popularity for enhanced patient safety and quality of care. Therefore, this paper reviews the critical role of ANNs in providing valuable insights for patients' healthcare decisions and efficient disease diagnosis. We thoroughly review different types of ANNs presented in the existing literature that advanced ANNs adaptation for complex applications. Moreover, we also investigate ANN's advances for various disease diagnoses and treatments such as viral, skin, cancer, and COVID-19. Furthermore, we propose a novel deep Convolutional Neural Network (CNN) model called ConXNet for improving the detection accuracy of COVID-19 disease. ConXNet is trained and tested using different datasets, and it achieves more than 97% detection accuracy and precision, which is significantly better than existing models. Finally, we highlight future research directions and challenges such as complexity of the algorithms, insufficient available data, privacy and security, and integration of biosensing with ANNs. These research directions require considerable attention for improving the scope of ANNs for medical diagnostic and treatment applications.


title: Question Answering Survey: Directions, Challenges, Datasets, Evaluation Matrices

abstract: The usage and amount of information available on the internet increase over the past decade. This digitization leads to the need for automated answering system to extract fruitful information from redundant and transitional knowledge sources. Such systems are designed to cater the most prominent answer from this giant knowledge source to the user query using natural language understanding (NLU) and thus eminently depends on the Question-answering(QA) field. Question answering involves but not limited to the steps like mapping of user question to pertinent query, retrieval of relevant information, finding the best suitable answer from the retrieved information etc. The current improvement of deep learning models evince compelling performance improvement in all these tasks. In this review work, the research directions of QA field are analyzed based on the type of question, answer type, source of evidence-answer, and modeling approach. This detailing followed by open challenges of the field like automatic question generation, similarity detection and, low resource availability for a language. In the end, a survey of available datasets and evaluation measures is presented.


title: The GBS code for the self-consistent simulation of plasma turbulence and kinetic neutral dynamics in the tokamak boundary

abstract: A new version of GBS (Ricci et al. Plasma Phys. Control. Fusion 54, 124047, 2012; Halpern et al. J. Comput. Phys. 315, 388-408, 2016; Paruta et al. Phys. Plasmas 25, 112301, 2018) is described. GBS is a three-dimensional, flux-driven, global, two-fluid turbulence code developed for the self-consistent simulation of plasma turbulence and kinetic neutral dynamics in the tokamak boundary. In the new version presented here, the simulation domain is extended to encompass the whole plasma volume, avoiding an artificial boundary with the core, hence retaining the core-edge-SOL interplay. A new toroidal coordinate system is introduced to increase the code flexibility, allowing for the simulation of arbitrary magnetic configurations (e.g. single-null, double-null and snowflake configurations), which can also be the result of the equilibrium reconstruction of an experimental discharge. The implementation of a new iterative solver for the Poisson and Amp\`ere equations is presented, leading to a remarkable speed-up of the code with respect to the use of direct solvers, therefore allowing for efficient electromagnetic simulations that avoid the use of the Boussinesq approximation. The self-consistent kinetic neutral model, initially developed for limited configurations, is ported to the magnetic configurations considered by the present version of GBS and carefully optimized. A new MPI parallelisation is implemented to evolve the plasma and neutral models in parallel, thus improving the code scalability. The numerical implementation of the plasma and neutral models is verified by means of the method of manufactured solutions. As an example of the simulation capabilities of the new version of GBS, a simulation of a TCV tokamak discharge is presented.


title: The Fundamental Plane in the hierarchical context

abstract: Context. The Fundamental Plane (FP) relation and the distribution of early-type galaxies (ETGs) in the FP projections, cannot be easily explained in the hierarchical framework, where galaxies grow up by merging and star formation episodes. Aims. We want to show here that both the FP and its projections arise naturally from the combination of the Virial Theorem (VT) and a new time-dependent relation, describing how luminosity and stellar velocity dispersion change during galaxy evolution. This relation has the form of the Faber-Jackson (FJ) relation but a different physical meaning: the new relation is $L = L'_0(t) \sigma^{\beta(t)}$, where its coefficients $L'_0$ and $\beta$ are time-dependent and can vary considerably from object to object, at variance with those obtained from the fit of the $L - \sigma$ plane. Methods. We derive the equations of the FP and its projections as a function of $\beta$ and $L'_0$, by combining the VT and the $L = L'_0(t) \sigma^{\beta(t)}$ law. Then, from their combination we derive the expression of the FP as a function of $\beta$ and the solutions for $\beta$ and $L'_0$. Results. We demonstrate that the observed properties of ETGs in the FP and its projections can be understood in terms of variations of $\beta$ and $L'_0$. These two parameters encrypt the history of galaxy evolution across the cosmic epochs and determine the future aspect of the FP and its projections. Using the solutions found for $\beta$ and $L'_0$ for each galaxy at the present epoch, we derive the coefficients of the FP (and FJ relation) and show that, the values of the coefficients coming form the fit, obtained in the literature, originate from the average of the single FP coefficients derived for each galaxy. In addition, we show that the variations of beta naturally explain the curvature observed in the FP projections and the correct position of the Zone of Exclusion.


title: MESA: Offline Meta-RL for Safe Adaptation and Fault Tolerance

abstract: Safe exploration is critical for using reinforcement learning (RL) in risk-sensitive environments. Recent work learns risk measures which measure the probability of violating constraints, which can then be used to enable safety. However, learning such risk measures requires significant interaction with the environment, resulting in excessive constraint violations during learning. Furthermore, these measures are not easily transferable to new environments. We cast safe exploration as an offline meta-RL problem, where the objective is to leverage examples of safe and unsafe behavior across a range of environments to quickly adapt learned risk measures to a new environment with previously unseen dynamics. We then propose MEta-learning for Safe Adaptation (MESA), an approach for meta-learning a risk measure for safe RL. Simulation experiments across 5 continuous control domains suggest that MESA can leverage offline data from a range of different environments to reduce constraint violations in unseen environments by up to a factor of 2 while maintaining task performance. See https://tinyurl.com/safe-meta-rl for code and supplementary material.


title: Signatures of the Many Supermassive Black Hole Mergers in a Cosmologically Forming Massive Early-Type Galaxy

abstract: We model here the merger histories of the supermassive black hole (SMBH) population in the late stages of a cosmological simulation of a $\sim 2 \times 10^{13} M_\odot$ galaxy group. The gravitational dynamics around the several tens of SMBHs ($M_{\bullet} \gtrsim 7.5\times 10^7 M_\odot$) hosted by the galaxies in the group is computed at high accuracy using regularized integration with the KETJU code. The 11 SMBHs which form binaries and hierarchical triplets eventually merge after hardening through dynamical friction, stellar scattering, and gravitational wave (GW) emission. The binaries form at eccentricities of $e \sim 0.3$-$0.9$, with one system evolving to a very high eccentricity of $e = 0.998$, and merge on timescales of a few tens to several hundred megayears. During the simulation the merger-induced GW recoil kicks eject one SMBH remnant from the central host galaxy. This temporarily drives the galaxy off the $M_{\bullet}$-$\sigma_{\star}$ relation, however the galaxy returns to the relation due to subsequent galaxy mergers, which bring in new SMBHs. This showcases a possible mechanism contributing to the observed scatter of the $M_{\bullet}$-$\sigma_{\star}$ relation. Finally, we show that Pulsar Timing Arrays and LISA would be able to detect parts of the GW signals from the SMBH mergers that occur during the $\sim 4\,\mathrm{Gyr}$ time span simulated with KETJU.


title: Pragmatic Implementation of Reinforcement Algorithms For Path Finding On Raspberry Pi

abstract: In this paper, pragmatic implementation of an indoor autonomous delivery system that exploits Reinforcement Learning algorithms for path planning and collision avoidance is audited. The proposed system is a cost-efficient approach that is implemented to facilitate a Raspberry Pi controlled four-wheel-drive non-holonomic robot map a grid. This approach computes and navigates the shortest path from a source key point to a destination key point to carry out the desired delivery. Q learning and Deep-Q learning are used to find the optimal path while avoiding collision with static obstacles. This work defines an approach to deploy these two algorithms on a robot. A novel algorithm to decode an array of directions into accurate movements in a certain action space is also proposed. The procedure followed to dispatch this system with the said requirements is described, ergo presenting our proof of concept for indoor autonomous delivery vehicles.


title: Collective self-optimization of communicating active particles

abstract: The quest on how to collectively self-organize in order to maximize the survival chances of the members of a social group requires finding an optimal compromise between maximizing the well-being of an individual and that of the group. Here we develop a minimal model describing active individuals which consume or produce, and respond to a shared resource, such as the oxygen concentration for aerotactic bacteria or the temperature field for penguins, while urging for an optimal resource value. Notably, this model can be approximated by an attraction-repulsion model, but in general it features many-body interactions. While the former prevents some individuals from closely approaching the optimal value of the shared resource field, the collective many-body interactions induce aperiodic patterns, allowing the group to collectively self-optimize. Arguably, the proposed optimal-field-based collective interactions represent a generic concept at the interface of active matter physics, collective behavior, and microbiological chemotaxis. This concept might serve as a useful ingredient to optimize ensembles of synthetic active agents or to help unveiling aspects of the communication rules which certain social groups use to maximize their survival chances.

categories: cond-mat.soft nlin.AO nlin.PS physics.bio-ph


title: Gamma dose rate monitoring using a Silicon Photomultiplier-based plastic scintillation detector

abstract: Plastic scintillation detectors represent an efficient, cost-effective, customizable solution for assessment of gamma radiation fields in the context of nuclear security, environmental radiation survey, radiological and nuclear incidents response (RNe) and dosimetry for radiation protection purposes. Solid state light readout technologies such as Silicon Photomultiplier diodes (SiPM) are characterized by low operational voltage, mechanical robustness, compact dimensions, and fast pulse rise-time. Due to these intrinsic advantages, Silicon Photomultiplier diodes have been progressively replacing Photomultiplier Tube-based gamma detection technologies in a great part of these applications. In this experimental study, a gamma energy calibration and a dose rate calculation algorithm are discussed and implemented onto the SiPM-based Flat Panel Gamma detector (FPG) developed by Arktis Radiation Detectors Ltd (Zurich, Switzerland). The FPG detector has been deployed and studied in the framework of research projects on RNe technologies, involving its use on unmanned aerial and ground vehicle such as drones and robots. This work moved from the need for end users to have an accurate and reliable dose rate assessment when operating in the field, especially in the context of RNe response. Results are presented in terms of gamma dose rate accuracy obtained by laboratory measurements using radionuclide sources emitting in the 0.059 - 1.333 MeV gamma energy range, compared to theoretical dose rate calculations.


title: Disability and Library Services: Global Research Trend

abstract: The research on differently abled persons, and their use of library is getting global attention in recent years. The field has shown a modest, continuous but wide-scale growth. This research paper aimed at capturing the dynamics of the field using various bibliometrics and text mining tools. The bibliographic data of journal articles published in the field were collected from the Web of Science (WoS) database. The records were collected form the year 1991 to 2021 and analysed to observed the trends of literature growth, core journals, institutes from where most of the literature is being published, prominent keywords and so on. The results show that there is a significant growth of publications since the year 2000. The trends shows that the research in these areas is mostly emerging from developed countries. The developing countries should also pay more attention to do research in this area because differently abled peoples need in developed countries may vary with respect to developed countries.


title: Kantorovich-Rubinstein distance and barycenter for finitely supported measures: Foundations and Algorithms

abstract: The purpose of this paper is to provide a systematic discussion of a generalized barycenter based on a variant of unbalanced optimal transport (UOT) that defines a distance between general non-negative, finitely supported measures by allowing for mass creation and destruction modeled by some cost parameter. They are denoted as Kantorovich-Rubinstein (KR) barycenter and distance. In particular, we detail the influence of the cost parameter to structural properties of the KR barycenter and the KR distance. For the latter we highlight a closed form solution on ultra-metric trees. The support of such KR barycenters of finitely supported measures turns out to be finite in general and its structure to be explicitly specified by the support of the input measures. Additionally, we prove the existence of sparse KR barycenters and discuss potential computational approaches. The performance of the KR barycenter is compared to the OT barycenter on a multitude of synthetic datasets. We also consider barycenters based on the recently introduced Gaussian Hellinger-Kantorovich and Wasserstein-Fisher-Rao distances.


title: On a 2-relative entropy

abstract: We construct a 2-categorical extension of the relative entropy functor of Baez and Fritz, and show that our construction is functorial with respect to vertical morphisms. Moreover, we show such a `2-relative entropy' satisfies natural 2-categorial analogues of convex linearity, vanishing under optimal hypotheses, and lower semicontinuity. While relative entropy is a relative measure of information between probability distributions, we view our construction as a relative measure of information between channels.


title: Derivation of Stokes-Plate-Equations modeling fluid flow interaction with thin porous elastic layers

abstract: In this paper we investigate the interaction of fluid flow with a thin porous elastic layer. We consider two fluid-filled bulk domains which are separated by a thin periodically perforated layer consisting of a fluid and an elastic solid part. Thickness and periodicity of the layer are of order $\epsilon$, where $\epsilon$ is small compared to the size of the bulk domains. The fluid flow is described by an instationary Stokes equation and the solid via linear elasticity. The main contribution of this paper is the rigorous homogenization of the porous structure in the layer and the reduction of the layer to an interface $\Sigma$ in the limit $\epsilon \to 0$ using two-scale convergence. The effective model consists of the Stokes equation coupled to a time dependent plate equation on the interface $\Sigma$ including homogenized elasticity coefficients carrying information about the micro structure of the layer. In the zeroth order approximation we obtain continuity of the velocities at the interface, where only a vertical movement occurs and the tangential components vanish. The tangential movement in the solid is of order $\epsilon$ and given as a Kirchhoff-Love displacement. Additionally, we derive higher order correctors for the fluid in the thin layer.


title: Pokemon: Protected Logic Qubit Derived from the 0-$\pi$ Qubit

abstract: We propose a new protected logic qubit called pokemon, which is derived from the 0-$\pi$ qubit by harnessing one capacitively shunted inductor and two capacitively shunted Josephson junctions embedded in a superconducting loop. Similar to the 0-$\pi$ qubit, the two basis states of the proposed qubit are separated by a high barrier, but their wave functions are highly localized along both axis directions of the two-dimensional parameter space, instead of the highly localized wave functions along only one axis direction in the 0-$\pi$ qubit. This makes the pokemon qubit more protected. For instance, the relaxation of the pokemon qubit is exponentially reduced by two equally important factors, while the relaxation of the 0-$\pi$ qubit is exponentially reduced by only one factor. Moreover, we show that the inductor in the pokemon can be replaced by a nonlinear inductor using, e.g., a pair or two pairs of Josephson junctions. This offers an experimentally promising way to implement next-generation superconducting qubits with even higher quantum coherence.


title: Quantum readout error mitigation via deep learning

abstract: Quantum computing devices are inevitably subject to errors. To leverage quantum technologies for computational benefits in practical applications, quantum algorithms and protocols must be implemented reliably under noise and imperfections. Since noise and imperfections limit the size of quantum circuits that can be realized on a quantum device, developing quantum error mitigation techniques that do not require extra qubits and gates is of critical importance. In this work, we present a deep learning-based protocol for reducing readout errors on quantum hardware. Our technique is based on training an artificial neural network with the measurement results obtained from experiments with simple quantum circuits consisting of singe-qubit gates only. With the neural network and deep learning, non-linear noise can be corrected, which is not possible with the existing linear inversion methods. The advantage of our method against the existing methods is demonstrated through quantum readout error mitigation experiments performed on IBM five-qubit quantum devices.


title: Pion-pole contribution to HLbL from twisted mass lattice QCD at the physical point

abstract: We report on our computation of the pion transition form factor ${\cal F}_{P\rightarrow \gamma^*\gamma^*}$ from twisted mass lattice QCD in order to determine the numerically dominant light pseudoscalar pole contribution in the hadronic light-by-light scattering contribution to the anomalous magnetic moment of the muon $a_\mu =(g-2)_\mu$. The pion transition form factor is computed directly at the physical point. We present first results for our estimate of the pion-pole contribution with kinematic setup for the pion at rest.


title: TCGL: Temporal Contrastive Graph for Self-supervised Video Representation Learning

abstract: Video self-supervised learning is a challenging task, which requires significant expressive power from the model to leverage rich spatial-temporal knowledge and generate effective supervisory signals from large amounts of unlabeled videos. However, existing methods fail to increase the temporal diversity of unlabeled videos and ignore elaborately modeling multi-scale temporal dependencies in an explicit way. To overcome these limitations, we take advantage of the multi-scale temporal dependencies within videos and proposes a novel video self-supervised learning framework named Temporal Contrastive Graph Learning (TCGL), which jointly models the inter-snippet and intra-snippet temporal dependencies for temporal representation learning with a hybrid graph contrastive learning strategy. Specifically, a Spatial-Temporal Knowledge Discovering (STKD) module is first introduced to extract motion-enhanced spatial-temporal representations from videos based on the frequency domain analysis of discrete cosine transform. To explicitly model multi-scale temporal dependencies of unlabeled videos, our TCGL integrates the prior knowledge about the frame and snippet orders into graph structures, i.e., the intra-/inter- snippet Temporal Contrastive Graphs (TCG). Then, specific contrastive learning modules are designed to maximize the agreement between nodes in different graph views. To generate supervisory signals for unlabeled videos, we introduce an Adaptive Snippet Order Prediction (ASOP) module which leverages the relational knowledge among video snippets to learn the global context representation and recalibrate the channel-wise features adaptively. Experimental results demonstrate the superiority of our TCGL over the state-of-the-art methods on large-scale action recognition and video retrieval benchmarks.The code is publicly available at https://github.com/YangLiu9208/TCGL.


title: A deep language model to predict metabolic network equilibria

abstract: We show that deep learning models, and especially architectures like the Transformer, originally intended for natural language, can be trained on randomly generated datasets to predict to very high accuracy both the qualitative and quantitative features of metabolic networks. Using standard mathematical techniques, we create large sets (40 million elements) of random networks that can be used to train our models. These trained models can predict network equilibrium on random graphs in more than 99% of cases. They can also generalize to graphs with different structure than those encountered at training. Finally, they can predict almost perfectly the equilibria of a small set of known biological networks. Our approach is both very economical in experimental data and uses only small and shallow deep-learning model, far from the large architectures commonly used in machine translation. Such results pave the way for larger use of deep learning models for problems related to biological networks in key areas such as quantitative systems pharmacology, systems biology, and synthetic biology.


title: Kirchberger's Theorem for Complexes of Oriented Matroids

abstract: The separation theorem of Kirchberger can be proven using a combination of Farkas' Lemma and Caratheodory's Theorem. Since those theorems are at the heart of oriented matroids, we are interested in a generalization of Kirchberger's Theorem to them. This has already been done for rank 3 oriented matroids. Here we prove it for complexes of oriented matroids, which are a generalization of oriented matroids.


title: Contrastive Learning from Extremely Augmented Skeleton Sequences for Self-supervised Action Recognition

abstract: In recent years, self-supervised representation learning for skeleton-based action recognition has been developed with the advance of contrastive learning methods. The existing contrastive learning methods use normal augmentations to construct similar positive samples, which limits the ability to explore novel movement patterns. In this paper, to make better use of the movement patterns introduced by extreme augmentations, a Contrastive Learning framework utilizing Abundant Information Mining for self-supervised action Representation (AimCLR) is proposed. First, the extreme augmentations and the Energy-based Attention-guided Drop Module (EADM) are proposed to obtain diverse positive samples, which bring novel movement patterns to improve the universality of the learned representations. Second, since directly using extreme augmentations may not be able to boost the performance due to the drastic changes in original identity, the Dual Distributional Divergence Minimization Loss (D$^3$M Loss) is proposed to minimize the distribution divergence in a more gentle way. Third, the Nearest Neighbors Mining (NNM) is proposed to further expand positive samples to make the abundant information mining process more reasonable. Exhaustive experiments on NTU RGB+D 60, PKU-MMD, NTU RGB+D 120 datasets have verified that our AimCLR can significantly perform favorably against state-of-the-art methods under a variety of evaluation protocols with observed higher quality action representations. Our code is available at https://github.com/Levigty/AimCLR.


title: Two-Dimensional Terahertz Spectroscopy of Condensed-Phase Molecular Systems

abstract: Nonlinear terahertz (THz) spectroscopy relies on the interaction of matter with few-cycle THz pulses of electric field amplitudes up to megavolts/centimeter (MV/cm). In condensed-phase molecular systems, both resonant interactions with elementary excitations at low frequency such as intra- and intermolecular vibrations and nonresonant field-driven processes are relevant. Two-dimensional THz (2D-THz) spectroscopy is a key method for following nonequilibrium processes and dynamics of excitations to decipher the underlying interactions and molecular couplings. This article addresses the state of the art in 2D-THz spectroscopy by discussing the main concepts and illustrating them with recent results. The latter include the response of vibrational excitations in molecular crystals up to the nonperturbative regime of light-matter interaction and field-driven ionization processes and electron transport in liquid water.