title: Engineered Octave Frequency Comb in Integrated Chalcogenide Dual-ring Microresonators

abstract: Broadband Kerr combs with a flat comb spectral profile are expected in a number of applications, such as high-capacity optical communication. Here, we propose novel concentric dual-ring microresonators (DRMs) for advanced dispersion engineering to tailor the comb spectral profile. The dispersion can be flexibly engineered not only by the cross-section of the DRMs, but also by the gap between concentric dual-ring microresonators, which provides a new path to geometrically control the spectral profile of the soliton Kerr combs. An octave-spanning dissipative Kerr soliton comb with superior spectral flatness has been achieved numerically, covering from the telecommunication band to the mid-infrared (MIR) band region with a -40 dB bandwidth of 1265 nm (99.82 THz). Our results are promising to fully understand the nonlinear dynamics in hybrid modes in DRMs, which helps control broadband comb formation.


title: Gravitational waves as waveguides

abstract: We show that gravitational waves can act as waveguides for electromagnetic radiation, that is if the latter is initially aligned with the gravitational waves, then the alignment will survive during the propagation. The analysis is performed using the Hamiltonian formalism and the Jacobi equation for null geodesics and conditions for certain cases of polarization of the waves are obtained. The effect of waveguiding by the gravitational waves can influence the interpretation of associated gravitational and electromagnetic wave events, since the latter cannot necessarily obey the inverse square decay law for intensity.


title: Fine-mixing: Mitigating Backdoors in Fine-tuned Language Models

abstract: Deep Neural Networks (DNNs) are known to be vulnerable to backdoor attacks. In Natural Language Processing (NLP), DNNs are often backdoored during the fine-tuning process of a large-scale Pre-trained Language Model (PLM) with poisoned samples. Although the clean weights of PLMs are readily available, existing methods have ignored this information in defending NLP models against backdoor attacks. In this work, we take the first step to exploit the pre-trained (unfine-tuned) weights to mitigate backdoors in fine-tuned language models. Specifically, we leverage the clean pre-trained weights via two complementary techniques: (1) a two-step Fine-mixing technique, which first mixes the backdoored weights (fine-tuned on poisoned data) with the pre-trained weights, then fine-tunes the mixed weights on a small subset of clean data; (2) an Embedding Purification (E-PUR) technique, which mitigates potential backdoors existing in the word embeddings. We compare Fine-mixing with typical backdoor mitigation methods on three single-sentence sentiment classification tasks and two sentence-pair classification tasks and show that it outperforms the baselines by a considerable margin in all scenarios. We also show that our E-PUR method can benefit existing mitigation methods. Our work establishes a simple but strong baseline defense for secure fine-tuned NLP models against backdoor attacks.


title: An Improved Structured Mesh Generation Method Based on Physics-informed Neural Networks

abstract: Mesh generation remains a key technology in many areas where numerical simulations are required. As numerical algorithms become more efficient and computers become more powerful, the percentage of time devoted to mesh generation becomes higher. In this paper, we present an improved structured mesh generation method. The method formulates the meshing problem as a global optimization problem related to a physics-informed neural network. The mesh is obtained by intelligently solving the physical boundary-constrained partial differential equations. To improve the prediction accuracy of the neural network, we also introduce a novel auxiliary line strategy and an efficient network model during meshing. The strategy first employs a priori auxiliary lines to provide ground truth data and then uses these data to construct a loss term to better constrain the convergence of the subsequent training. The experimental results indicate that the proposed method is effective and robust. It can accurately approximate the mapping (transformation) from the computational domain to the physical domain and enable fast high-quality structured mesh generation.


title: Random flat bundles and equidistribution

abstract: Each signature $\underline{\lambda}(n)=(\lambda_1(n),\dots,\lambda_n(n))$, where $\lambda_1(n)\geq\dots\geq\lambda_n(n)$ are integers, gives an irreducible representation $\pi_{\underline{\lambda}(n)}:U(n)\rightarrow\text{GL}(V_{\underline{\lambda}(n)})$ of the unitary group $U(n)$. Suppose $X$ is a finite-area cusped hyperbolic surface, $\chi$ is a random surface representation in $\text{Hom}(\pi_1(X),U(n))$ equipped with a Haar unitary probability measure, and $(\underline{\lambda}(n))_{n=1}^{\infty}$ is a sequence of signatures. Let $|\underline{\lambda}(n)|:=\sum_i|\lambda_i(n)|$. We show that there is an absolute constant $c>0$ such that if $0\neq |\underline{\lambda}(n)|\leq c\frac{\log n}{\log\log n}$ for sufficiently large $n$, then the Laplacians $\Delta_{\chi,\underline{\lambda}(n)}$ acting on sections of the flat unitary bundles associated to the surface representations \[\pi_1(X)\xrightarrow{\chi} U(n)\xrightarrow{\pi_{\underline{\lambda}(n)}}\text{GL}(V_{\underline{\lambda}(n)})\] have the property that for every $\varepsilon>0$ \[\mathbb{P}\left[\chi:\inf\text{Spec}(\Delta_{\chi,\underline{\lambda}(n)})\geq\frac{1}{4}-\varepsilon\right]\xrightarrow{n\rightarrow\infty}1,\] where $\text{Spec}(\Delta_{\chi,\underline{\lambda}(n)})$ is the spectrum of $\Delta_{\chi,\underline{\lambda}(n)}$. A special case of this is that flat unitary bundles associated to $\chi:\pi_1(X)\rightarrow U(n)$ asymptotically almost surely as $n\rightarrow\infty$ have least eigenvalue at least $\frac{1}{4}-\varepsilon$, irrespective of the spectral gap of $X$ itself. This is proved using the Hide--Magee method. Using the spectral theorem above and proving a probabilistic prime geodesic theorem, we also obtain a probabilistic equidistribution theorem for the images under $\chi$ of geodesics of lengths dependent on the rank $n$.


title: Observation of uniaxial strain tuned spin cycloid in a freestanding BiFeO3 film

abstract: Non-collinear spin order that breaks space inversion symmetry and allows efficient electric-field control of magnetism makes BiFeO$_3$ a promising candidate for applications in low-power spintronic devices. Epitaxial strain effects have been intensively studied and exhibit significant modulation of the magnetic order in BiFeO$_3$, but tuning its spin structure with continuously varied uniaxial strain is still lacking up to date. Here, we apply \emph{in situ} uniaxial strain to a freestanding BiFeO$_3$ film and use scanning NV microscope to image the nanoscale magnetic order in real-space. The strain is continuously increased from 0\% to 1.5\% and four images under different strains are acquired during this period. The images show that the spin cycloid tilts by $\sim 12.6^\circ$ when strain approaches 1.5\%. A first principle calculation has been processed to show that the tilting is energetically favorable under such strain. Our \emph{in situ} strain applying method in combination with scanning NV microscope real-space imaging ability paves a new way in studying the coupling between magnetic order and strain in BiFeO$_3$ films.


title: Swinv2-Imagen: Hierarchical Vision Transformer Diffusion Models for Text-to-Image Generation

abstract: Recently, diffusion models have been proven to perform remarkably well in text-to-image synthesis tasks in a number of studies, immediately presenting new study opportunities for image generation. Google's Imagen follows this research trend and outperforms DALLE2 as the best model for text-to-image generation. However, Imagen merely uses a T5 language model for text processing, which cannot ensure learning the semantic information of the text. Furthermore, the Efficient UNet leveraged by Imagen is not the best choice in image processing. To address these issues, we propose the Swinv2-Imagen, a novel text-to-image diffusion model based on a Hierarchical Visual Transformer and a Scene Graph incorporating a semantic layout. In the proposed model, the feature vectors of entities and relationships are extracted and involved in the diffusion model, effectively improving the quality of generated images. On top of that, we also introduce a Swin-Transformer-based UNet architecture, called Swinv2-Unet, which can address the problems stemming from the CNN convolution operations. Extensive experiments are conducted to evaluate the performance of the proposed model by using three real-world datasets, i.e., MSCOCO, CUB and MM-CelebA-HQ. The experimental results show that the proposed Swinv2-Imagen model outperforms several popular state-of-the-art methods.


title: Probing Cross-modal Semantics Alignment Capability from the Textual Perspective

abstract: In recent years, vision and language pre-training (VLP) models have advanced the state-of-the-art results in a variety of cross-modal downstream tasks. Aligning cross-modal semantics is claimed to be one of the essential capabilities of VLP models. However, it still remains unclear about the inner working mechanism of alignment in VLP models. In this paper, we propose a new probing method that is based on image captioning to first empirically study the cross-modal semantics alignment of VLP models. Our probing method is built upon the fact that given an image-caption pair, the VLP models will give a score, indicating how well two modalities are aligned; maximizing such scores will generate sentences that VLP models believe are of good alignment. Analyzing these sentences thus will reveal in what way different modalities are aligned and how well these alignments are in VLP models. We apply our probing method to five popular VLP models, including UNITER, ROSITA, ViLBERT, CLIP, and LXMERT, and provide a comprehensive analysis of the generated captions guided by these models. Our results show that VLP models (1) focus more on just aligning objects with visual words, while neglecting global semantics; (2) prefer fixed sentence patterns, thus ignoring more important textual information including fluency and grammar; and (3) deem the captions with more visual words are better aligned with images. These findings indicate that VLP models still have weaknesses in cross-modal semantics alignment and we hope this work will draw researchers' attention to such problems when designing a new VLP model.


title: DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text Generation

abstract: Prompt learning with immensely large Casual Language Models (CLMs) has been shown promising for attribute-controllable text generation (CTG). However, vanilla prompt tuning tends to imitate training corpus characteristics beyond the control attributes, resulting in a poor generalization ability. Moreover, it is less able to capture the relationship between different attributes, further limiting the control performance. In this paper, we propose a new CTG approach, namely DisCup, which incorporates the attribute knowledge of discriminator to optimize the control-prompts, steering a frozen CLM to produce attribute-specific texts. Specifically, the frozen CLM model, capable of producing multitudinous texts, is first used to generate the next-token candidates based on the context, so as to ensure the diversity of tokens to be predicted. Then, we leverage an attribute-discriminator to select desired/undesired tokens from those candidates, providing the inter-attribute knowledge. Finally, we bridge the above two traits by an unlikelihood objective for prompt-tuning. Extensive experimental results show that DisCup can achieve a new state-of-the-art control performance while maintaining an efficient and high-quality text generation, only relying on around 10 virtual tokens.


title: A robust lower order mixed finite element method for a strain gradient elasticity model

abstract: A robust nonconforming mixed finite element method is developed for a strain gradient elasticity (SGE) model. In two and three dimensional cases, a lower order $C^0$-continuous $H^2$-nonconforming finite element is constructed for the displacement field through enriching the quadratic Lagrange element with bubble functions. This together with the linear Lagrange element is exploited to discretize a mixed formulation of the SGE model. The robust discrete inf-sup condition is established. The sharp and uniform error estimates with respect to both the small size parameter and the Lam\'{e} coefficient are achieved, which is also verified by numerical results. In addition, the uniform regularity of the SGE model is derived under two reasonable assumptions.


title: Title detection: a novel approach to automatically finding retractions and other editorial notices in the scholarly literature

abstract: Despite being a key element in the process of disseminating scientific knowledge, editorial notices are often obscured and not clearly linked to the papers to which they refer. In the present paper, we describe established methods of aggregating notice data, and introduce a novel method of finding editorial notices in the scientific literature. Specifically, we describe how article titles denote notices to existing publications, and how this information can be used to tie notices to papers in an automated fashion. Finally, as part of a broader movement to make science more transparent, we make notices detected through this and other methods publicly available and describe this dataset and how it can be accessed.


title: A novel statistical methodology for quantifying the spatial arrangements of axons in peripheral nerves

abstract: A thorough understanding of the neuroanatomy of peripheral nerves is required for a better insight into their function and the development of neuromodulation tools and strategies. In biophysical modeling, it is commonly assumed that the complex spatial arrangement of myelinated and unmyelinated axons in peripheral nerves is random, however, in reality the axonal organization is inhomogeneous and anisotropic. Present quantitative neuroanatomy methods analyze peripheral nerves in terms of the number of axons and the morphometric characteristics of the axons, such as area and diameter. In this study, we employed spatial statistics and point process models to describe the spatial arrangement of axons and Sinkhorn distances to compute the similarities between these arrangements (in terms of first- and second-order statistics) in various vagus and pelvic nerve cross-sections. We utilized high-resolution TEM images that have been segmented using a custom-built high-throughput deep learning system based on a highly modified U-Net architecture. Our findings show a novel and innovative approach to quantifying similarities between spatial point patterns using metrics derived from the solution to the optimal transport problem. We also present a generalizable pipeline for quantitative analysis of peripheral nerve architecture. Our data demonstrate differences between male- and female-originating samples and similarities between the pelvic and abdominal vagus nerves.


title: First Test Results of the Trans-Impedance Amplifier Stage of the Ultra-fast HPSoC ASIC

abstract: We present the first results from the HPSoC ASIC designed for readout of Ultra-fast Silicon Detectors. The 4-channel ASIC manufactured in 65 nm CMOS by TSMC has been optimized for 50 um thick AC-LGAD. The evaluation of the analog front end with \b{eta}-particles impinging on 3x3 AC-LGAD arrays (500 um pitch, 200x200 um2 metal) confirms a fast output rise time of 600 ps and good timing performance with a jitter of 45 ps. Further calibration experiments and TCT laser studies indicate some gain limitations that are being investigated and are driving the design of the second-generation pre-amplification stages to reach a jitter of 15 ps.


title: Discrete Cross-Modal Alignment Enables Zero-Shot Speech Translation

abstract: End-to-end Speech Translation (ST) aims at translating the source language speech into target language text without generating the intermediate transcriptions. However, the training of end-to-end methods relies on parallel ST data, which are difficult and expensive to obtain. Fortunately, the supervised data for automatic speech recognition (ASR) and machine translation (MT) are usually more accessible, making zero-shot speech translation a potential direction. Existing zero-shot methods fail to align the two modalities of speech and text into a shared semantic space, resulting in much worse performance compared to the supervised ST methods. In order to enable zero-shot ST, we propose a novel Discrete Cross-Modal Alignment (DCMA) method that employs a shared discrete vocabulary space to accommodate and match both modalities of speech and text. Specifically, we introduce a vector quantization module to discretize the continuous representations of speech and text into a finite set of virtual tokens, and use ASR data to map corresponding speech and text to the same virtual token in a shared codebook. This way, source language speech can be embedded in the same semantic space as the source language text, which can be then transformed into target language text with an MT module. Experiments on multiple language pairs demonstrate that our zero-shot ST method significantly improves the SOTA, and even performers on par with the strong supervised ST baselines.


title: Reading the tea leaves in the $M_{\rm bh}$-$M_{\rm *,sph}$ and $M_{\rm bh}$-$R_{\rm e,sph}$ diagrams: dry and gaseous mergers with remnant angular momentum

abstract: We recently revealed that bulges and elliptical galaxies broadly define distinct, super-linear relations in the $M_{\rm bh}$-$M_{\rm *,sph}$ diagram, with the order-of-magnitude lower $M_{\rm bh}/M_{\rm *,sph}$ ratios in the elliptical galaxies due to major (disc-destroying, elliptical-building) dry mergers. Here we present a more nuanced picture. Galaxy mergers, in which the net orbital angular momentum does not cancel, can lead to systems with a rotating disc. This situation can occur with either wet (gas-rich) mergers involving one or two spiral galaxies, e.g., NGC~5128, or dry (relatively gas-poor) collisions involving one or two lenticular galaxies, e.g., NGC~5813. The spheroid and disc masses of the progenitor galaxies and merger remnant dictate the shift in the $M_{\rm bh}$-$M_{\rm *,sph}$ and $M_{\rm bh}$-$R_{\rm e,sph}$ diagrams. We show how this explains the (previously excluded merger remnant) Sersic S0 galaxies near the bottom of the elliptical sequence and core-Sersic S0 galaxies at the top of the bulge sequence, neither of which are faded spiral galaxies. Different evolutionary pathways in the scaling diagrams are discussed. We also introduce two ellicular (ES) galaxy types, explore the location of brightest cluster galaxies and stripped `compact elliptical' galaxies in the $M_{\rm bh}$-$M_{\rm *,sph}$ diagram, and present a new merger-built $M_{\rm bh}$-$M_{\rm *,sph}$ relation which may prove helpful for studies of nanohertz gravitational waves. This work effectively brings into the fold many systems previously considered outliers with either overly massive or undermassive black holes relative to the near-linear $M_{\rm bh}$-$M_{\rm *,sph}$ `red sequence' patched together with select bulges and elliptical galaxies.


title: Bag of Tricks for Developing Diabetic Retinopathy Analysis Framework to Overcome Data Scarcity

abstract: Recently, diabetic retinopathy (DR) screening utilizing ultra-wide optical coherence tomography angiography (UW-OCTA) has been used in clinical practices to detect signs of early DR. However, developing a deep learning-based DR analysis system using UW-OCTA images is not trivial due to the difficulty of data collection and the absence of public datasets. By realistic constraints, a model trained on small datasets may obtain sub-par performance. Therefore, to help ophthalmologists be less confused about models' incorrect decisions, the models should be robust even in data scarcity settings. To address the above practical challenging, we present a comprehensive empirical study for DR analysis tasks, including lesion segmentation, image quality assessment, and DR grading. For each task, we introduce a robust training scheme by leveraging ensemble learning, data augmentation, and semi-supervised learning. Furthermore, we propose reliable pseudo labeling that excludes uncertain pseudo-labels based on the model's confidence scores to reduce the negative effect of noisy pseudo-labels. By exploiting the proposed approaches, we achieved 1st place in the Diabetic Retinopathy Analysis Challenge.


title: Unsupervised Inference of Data-Driven Discourse Structures using a Tree Auto-Encoder

abstract: With a growing need for robust and general discourse structures in many downstream tasks and real-world applications, the current lack of high-quality, high-quantity discourse trees poses a severe shortcoming. In order the alleviate this limitation, we propose a new strategy to generate tree structures in a task-agnostic, unsupervised fashion by extending a latent tree induction framework with an auto-encoding objective. The proposed approach can be applied to any tree-structured objective, such as syntactic parsing, discourse parsing and others. However, due to the especially difficult annotation process to generate discourse trees, we initially develop such method to complement task-specific models in generating much larger and more diverse discourse treebanks.


title: A Bayesian Convolutional Neural Network-based Generalized Linear Model

abstract: Convolutional neural networks (CNNs) provide flexible function approximations for a wide variety of applications when the input variables are in the form of images or spatial data. Although CNNs often outperform traditional statistical models in prediction accuracy, statistical inference, such as estimating the effects of covariates and quantifying the prediction uncertainty, is not trivial due to the highly complicated model structure and overparameterization. To address this challenge, we propose a new Bayesian approach by embedding CNNs within the generalized linear models (GLMs) framework. We use extracted nodes from the last hidden layer of CNN with Monte Carlo (MC) dropout as informative covariates in GLM. This improves accuracy in prediction and regression coefficient inference, allowing for the interpretation of coefficients and uncertainty quantification. By fitting ensemble GLMs across multiple realizations from MC dropout, we can account for uncertainties in extracting the features. We apply our methods to biological and epidemiological problems, which have both high-dimensional correlated inputs and vector covariates. Specifically, we consider malaria incidence data, brain tumor image data, and fMRI data. By extracting information from correlated inputs, the proposed method can provide an interpretable Bayesian analysis. The algorithm can be broadly applicable to image regressions or correlated data analysis by enabling accurate Bayesian inference quickly.


title: Measurement of the absolute branching fraction of the inclusive decay $\bar{\Lambda}_{c}^{-} \to \bar{n} + X$

abstract: Based on $e^+e^-$ collision data corresponding to an integrated luminosity of 4.5 $fb^{-1}$ collected at the center-of-mass energies between 4.600 and 4.699 GeV with the BESIII detector at BEPCII, the absolute branching fraction of the inclusive decay $\Lambda^{+}_{c}\to n + X$, where $X$ refers to any possible final state particles, is measured. The absolute branching fraction is determined to be $\mathcal{B}(\Lambda^{+}_{c}\to n + X) = (32.4 \pm 0.7 \pm 1.5)\% $, where the first uncertainty is statistical and the second systematic. Assuming $CP$ symmetry, the measurement indicates that about one-fourth of $\Lambda^{+}_{c}$ ($\bar{\Lambda}_{c}^-$) decay modes with a neutron (an anti-neutron) in the final state have not been observed.


title: Microscopic imaging homogeneous and single phase superfluid density in UTe$_2$

abstract: The spin-triplet superconductor UTe$_2$ shows spontaneous time-reversal symmetry breaking and multiple superconducting phases in some crystals, implying chiral superconductivity. Here we microscopically image the local magnetic fields and magnetic susceptibility near the surface of UTe$_2$, observing a homogeneous superfluid density $n_s$ and homogeneous pinned vortices. The temperature dependence of $n_s$ is consistent with an anisotropic gap and shows no evidence for an additional kink that would be expected at any second phase transition. Our findings are consistent with a dominant $B_{3u}$ superconducting order parameter in the case of a quasi-2D Fermi surface and provide no evidence for multiple phase transitions in $n_s(T)$ in UTe$_2$.


title: FedForgery: Generalized Face Forgery Detection with Residual Federated Learning

abstract: With the continuous development of deep learning in the field of image generation models, a large number of vivid forged faces have been generated and spread on the Internet. These high-authenticity artifacts could grow into a threat to society security. Existing face forgery detection methods directly utilize the obtained public shared or centralized data for training but ignore the personal privacy and security issues when personal data couldn't be centralizedly shared in real-world scenarios. Additionally, different distributions caused by diverse artifact types would further bring adverse influences on the forgery detection task. To solve the mentioned problems, the paper proposes a novel generalized residual Federated learning for face Forgery detection (FedForgery). The designed variational autoencoder aims to learn robust discriminative residual feature maps to detect forgery faces (with diverse or even unknown artifact types). Furthermore, the general federated learning strategy is introduced to construct distributed detection model trained collaboratively with multiple local decentralized devices, which could further boost the representation generalization. Experiments conducted on publicly available face forgery detection datasets prove the superior performance of the proposed FedForgery. The designed novel generalized face forgery detection protocols and source code would be publicly available.


title: Input Regularization for Integer Optimal Control in BV with Applications to Control of Poroelastic and Poroviscoelastic Systems

abstract: We revisit a class of integer optimal control problems for which a trust-region method has been proposed and analyzed in arXiv:2106.13453v3 [math.OC]. While the algorithm proposed in arXiv:2106.13453v3 [math.OC] successfully solves the class of optimization problems under consideration, its convergence analysis requires restrictive regularity assumptions. There are many examples of integer optimal control problems involving partial differential equations where these regularity assumptions are not satisfied. In this article we provide a way to bypass the restrictive regularity assumptions by introducing an additional partial regularization of the control inputs by means of mollification and proving a $\Gamma$-convergence-type result when the support parameter of the mollification is driven to zero. We highlight the applicability of this theory in the case of fluid flows through deformable porous media equations that arise in biomechanics. We show that the regularity assumptions are violated in the case of poro-visco-elastic systems, and thus one needs to use the regularization of the control input introduced in this article. Associated numerical results show that while the homotopy can help to find better objective values and points of lower instationarity, the practical performance of the algorithm without the input regularization may be on par with the homotopy.


title: Towards Domain-Independent Supervised Discourse Parsing Through Gradient Boosting

abstract: Discourse analysis and discourse parsing have shown great impact on many important problems in the field of Natural Language Processing (NLP). Given the direct impact of discourse annotations on model performance and interpretability, robustly extracting discourse structures from arbitrary documents is a key task to further improve computational models in NLP. To this end, we present a new, supervised paradigm directly tackling the domain adaptation issue in discourse parsing. Specifically, we introduce the first fully supervised discourse parser designed to alleviate the domain dependency through a staged model of weak classifiers by introducing the gradient boosting framework.


title: Simple Emergent Action Representations from Multi-Task Policy Training

abstract: The low-level sensory and motor signals in deep reinforcement learning, which exist in high-dimensional spaces such as image observations or motor torques, are inherently challenging to understand or utilize directly for downstream tasks. While sensory representations have been extensively studied, the representations of motor actions are still an area of active exploration. Our work reveals that a space containing meaningful action representations emerges when a multi-task policy network takes as inputs both states and task embeddings. Moderate constraints are added to improve its representation ability. Therefore, interpolated or composed embeddings can function as a high-level interface within this space, providing instructions to the agent for executing meaningful action sequences. Empirical results demonstrate that the proposed action representations are effective for intra-action interpolation and inter-action composition with limited or no additional learning. Furthermore, our approach exhibits superior task adaptation ability compared to strong baselines in Mujoco locomotion tasks. Our work sheds light on the promising direction of learning action representations for efficient, adaptable, and composable RL, forming the basis of abstract action planning and the understanding of motor signal space. Project page: https://sites.google.com/view/emergent-action-representation/


title: Almost optimal polynomial approximation on convex sets in $\mathbb{C}$

abstract: For a function $f$, continuous on a compact convex set $K$ and analytic in its interior we construct a sequence of almost optimal polynomials that converge with a geometric rate at points of analyticity of $f$.


title: On Einstein submanifolds of Euclidean space

abstract: Let the warped product $M^n=L^m\times_\varphi F^{n-m}$, $n\geq m+3\geq 8$, of Riemannian manifolds be an Einstein manifold with Ricci curvature $\rho$ that admits an isometric immersion into Euclidean space with codimension two. Under the assumption that $L^m$ is also Einstein, but not of constant sectional curvature, it is shown that $\rho=0$ and that the submanifold is locally a cylinder with an Euclidean factor of dimension at least $n-m$. Hence $L^m$ is also Ricci flat. If $M^n$ is complete, then the same conclusion holds globally if the assumption on $L^m$ is replaced by the much weaker condition that either its scalar curvature $S_L$ is constant or that $S_L\leq (2m-n)\rho$.


title: ModSandbox: Facilitating Online Community Moderation Through Error Prediction and Improvement of Automated Rules

abstract: Despite the common use of rule-based tools for online content moderation, human moderators still spend a lot of time monitoring them to ensure that they work as intended. Based on surveys and interviews with Reddit moderators who use AutoModerator, we identified the main challenges in reducing false positives and false negatives of automated rules: not being able to estimate the actual effect of a rule in advance and having difficulty figuring out how the rules should be updated. To address these issues, we built ModSandbox, a novel virtual sandbox system that detects possible false positives and false negatives of a rule to be improved and visualizes which part of the rule is causing issues. We conducted a user study with online content moderators, finding that ModSandbox can support quickly finding possible false positives and false negatives of automated rules and guide moderators to update those to reduce future errors.


title: Water surface swimming dynamics in lightweight centipedes

abstract: Study of the locomotion of a centipede (L. forficatus) at the air-water interface reveals that it does not predominantly use its 14 leg pairs to locomote; unlike most swimmers which propagate head-to-tail body bending waves, this species propels via tail-to-head waves. Its low mass and body-fluid contact yield locomotion dynamics in which fluid wave drag forces dominate inertia. Microorganism-inspired wave drag resistive force theory captures swimming performance of the macroscale animal, motivating a control hypothesis for the animals self-propulsion body and limb kinematics.


title: On Relations Between Tight Bounds for Symmetric $f$-Divergences and Binary Divergences

abstract: Minimizing divergence measures under a constraint is an important problem. We derive a sufficient condition that binary divergence measures provide lower bounds for symmetric divergence measures under a given triangular discrimination or given means and variances. Assuming this sufficient condition, the former bounds are always tight, and the latter bounds are tight when two probability measures have the same variance. An application of these results for nonequilibrium physics is provided.


title: Spatio-Temporal-based Context Fusion for Video Anomaly Detection

abstract: Video anomaly detection aims to discover abnormal events in videos, and the principal objects are target objects such as people and vehicles. Each target in the video data has rich spatio-temporal context information. Most existing methods only focus on the temporal context, ignoring the role of the spatial context in anomaly detection. The spatial context information represents the relationship between the detection target and surrounding targets. Anomaly detection makes a lot of sense. To this end, a video anomaly detection algorithm based on target spatio-temporal context fusion is proposed. Firstly, the target in the video frame is extracted through the target detection network to reduce background interference. Then the optical flow map of two adjacent frames is calculated. Motion features are used multiple targets in the video frame to construct spatial context simultaneously, re-encoding the target appearance and motion features, and finally reconstructing the above features through the spatio-temporal dual-stream network, and using the reconstruction error to represent the abnormal score. The algorithm achieves frame-level AUCs of 98.5% and 86.3% on the UCSDped2 and Avenue datasets, respectively. On the UCSDped2 dataset, the spatio-temporal dual-stream network improves frames by 5.1% and 0.3%, respectively, compared to the temporal and spatial stream networks. After using spatial context encoding, the frame-level AUC is enhanced by 1%, which verifies the method's effectiveness.


title: ViTCoD: Vision Transformer Acceleration via Dedicated Algorithm and Accelerator Co-Design

abstract: Vision Transformers (ViTs) have achieved state-of-the-art performance on various vision tasks. However, ViTs' self-attention module is still arguably a major bottleneck, limiting their achievable hardware efficiency. Meanwhile, existing accelerators dedicated to NLP Transformers are not optimal for ViTs. This is because there is a large difference between ViTs and NLP Transformers: ViTs have a relatively fixed number of input tokens, whose attention maps can be pruned by up to 90% even with fixed sparse patterns; while NLP Transformers need to handle input sequences of varying numbers of tokens and rely on on-the-fly predictions of dynamic sparse attention patterns for each input to achieve a decent sparsity (e.g., >=50%). To this end, we propose a dedicated algorithm and accelerator co-design framework dubbed ViTCoD for accelerating ViTs. Specifically, on the algorithm level, ViTCoD prunes and polarizes the attention maps to have either denser or sparser fixed patterns for regularizing two levels of workloads without hurting the accuracy, largely reducing the attention computations while leaving room for alleviating the remaining dominant data movements; on top of that, we further integrate a lightweight and learnable auto-encoder module to enable trading the dominant high-cost data movements for lower-cost computations. On the hardware level, we develop a dedicated accelerator to simultaneously coordinate the enforced denser/sparser workloads and encoder/decoder engines for boosted hardware utilization. Extensive experiments and ablation studies validate that ViTCoD largely reduces the dominant data movement costs, achieving speedups of up to 235.3x, 142.9x, 86.0x, 10.1x, and 6.8x over general computing platforms CPUs, EdgeGPUs, GPUs, and prior-art Transformer accelerators SpAtten and Sanger under an attention sparsity of 90%, respectively.


title: Integrative Pan-Cancer Analysis of RNMT: a Potential Prognostic and Immunological Biomarker

abstract: Background: RNA guanine-7 methyltransferase (RNMT) is one of the main regulators of N7-methylguanosine, and the deregulation of RNMT correlated with tumor development and immune metabolism. However, the specific function of RNMT in pan-cancer remains unclear. Methods: RNMT expression in different cancers was analyzed using multiple databases, including Cancer Cell Line Encyclopedia (CCLE), Genotype-Tissue Expression Project (GTEx), and The Cancer Genome Atlas (TCGA). Cox regression analysis and Kaplan-Meier analysis were used to estimate the correlation of RNMT expression to prognosis. The data was also used to research the relationship between RNMT expression and common immunoregulators, tumor mutation burden (TMB), microsatellite instability (MSI), mismatch repair (MMR), and DNA methyltransferase (DNMT). Additionally, the cBioPortal website was used to evaluate the characteristics of RNMT alteration. The TISDB database was used to obtain the expression of different subtypes. The Tumor Immune Estimation Resource (TIMER) database was used to analyze the association between RNMT and tumor immune infiltration. Gene set enrichment analysis (GSEA) was used to identify the relevant pathways. Results: RNMT was ubiquitously highly expressed across cancers and survival analysis revealed that its expression was highly associated with the clinical prognosis of various cancer types. Remarkably, RNMT participates in immune regulation and plays a crucial part in the tumor microenvironment. A positive association was found between RNMT expression and six immune cell types expression in colon adenocarcinoma, kidney renal clear cell carcinoma, and liver hepatocellular carcinoma. Moreover, RNMT expression was highly associated with immunoregulators in most cancer types, and correlated to TMB, MSI, MMR, and DNMT. Finally, GSEA indicated that RNMT may correlate with tumor immunity.


title: Monotonicity and critical points of the period function for potential system

abstract: This paper is concerned with the analytic behaviors (monotonicity, isochronicity and the number of critical points) of period function for potential system $\ddot{x}+g(x)=0$.We give some sufficient criteria to determine the monotonicity and upper bound to the number of critical periods. The conclusion is based on the semi-group properties of (Riemann-Liouville) fractional integral operator of order $\frac{1}{2}$ and Rolle's Theorem. In polynomial potential settings, bounding the the number of critical periods of potential center can be reduced to counting the real zeros of a semi-algebraic system. From which we prove that if nonlinear potential $g$ is odd, the potential center has at most $\frac{deg(g)-3}{2}$ critical periods. To illustrate its applicability some known results are proved in more efficient way, and the critical periods of some hyper-elliptic Hamiltonian systems of degree five with complex critical points are discussed, it is proved the system can have exactly two critical periods.


title: Connected $(n,m)$-Point Functions of Diagonal $2$-BKP Tau-Functions, and Spin Double Hurwitz Numbers

abstract: We derive an explicit formula for the connected $(n,m)$-point functions associated to an arbitrary diagonal tau-function of the $2$-BKP hierarchy using computation of neutral fermions and boson-fermion correspondence of type $B$, and then apply this formula to the computation of connected spin double Hurwitz numbers. This is the type $B$ analogue of \cite{wy2}.


title: Existence of a Moore graph of degree 57 is still open

abstract: In 2020, a paper [arXiv:2010.13443] appeared in the arXiv claiming to prove that a Moore graph of diameter 2 and degree 57 does not exist. (The paper is in Russian; we include a link to a translation of this paper kindly provided to us by Konstantin Selivanov.) The proof technique is reasonable. It employs the fact that such a graph must be distance regular and that there exists a large set of relations which such a graph must satisfy. The argument proceeds by a case analysis that shows that this set of relations cannot be satisfied. We show that this seems not to be correct. The system of equations factors into small diagonal blocks all of which have solutions. As an alternative, we show that there is a family of systems of permutations with the property that the Moore graph exists if and only if there is a member of the family with no solutions.


title: Fast same-step forecast in SUTSE model and its theoretical properties

abstract: We consider the problem of forecasting multivariate time series by a Seemingly Unrelated Time Series Equations (SUTSE) model. The SUTSE model usually assumes that error variables are correlated. A crucial issue is that the model estimation requires heavy computational loads because of a large matrix computation, especially for high-dimensional data. To alleviate the computational issue, we propose a two-stage procedure for forecasting. First, we perform the Kalman filter as if error variables are uncorrelated; that is, univariate time-series analyses are conducted separately to avoid a large matrix computation. Next, the forecast value is computed by using a distribution of forecast error. The proposed algorithm is much faster than the ordinary SUTSE model because we do not require a large matrix computation. Some theoretical properties of our proposed estimator are presented. Monte Carlo simulation is performed to investigate the effectiveness of our proposed method. The usefulness of our proposed procedure is illustrated through a bus congestion data application.


title: Unpacking Reward Shaping: Understanding the Benefits of Reward Engineering on Sample Complexity

abstract: Reinforcement learning provides an automated framework for learning behaviors from high-level reward specifications, but in practice the choice of reward function can be crucial for good results -- while in principle the reward only needs to specify what the task is, in reality practitioners often need to design more detailed rewards that provide the agent with some hints about how the task should be completed. The idea of this type of ``reward-shaping'' has been often discussed in the literature, and is often a critical part of practical applications, but there is relatively little formal characterization of how the choice of reward shaping can yield benefits in sample complexity. In this work, we build on the framework of novelty-based exploration to provide a simple scheme for incorporating shaped rewards into RL along with an analysis tool to show that particular choices of reward shaping provably improve sample efficiency. We characterize the class of problems where these gains are expected to be significant and show how this can be connected to practical algorithms in the literature. We confirm that these results hold in practice in an experimental evaluation, providing an insight into the mechanisms through which reward shaping can significantly improve the complexity of reinforcement learning while retaining asymptotic performance.


title: A Novel Feature Representation for Malware Classification

abstract: In this study we have presented a novel feature representation for malicious programs that can be used for malware classification. We have shown how to construct the features in a bottom-up approach, and analyzed the overlap of malicious and benign programs in terms of their components. We have shown that our method of analysis offers an increase in feature resolution that is descriptive of data movement in comparison to tf-idf features.


title: Sticky Kakeya sets and the sticky Kakeya conjecture

abstract: A Kakeya set is a compact subset of $\mathbb{R}^n$ that contains a unit line segment pointing in every direction. The Kakeya conjecture asserts that such sets must have Hausdorff and Minkowski dimension $n$. There is a special class of Kakeya sets, called sticky Kakeya sets. Sticky Kakeya sets exhibit an approximate multi-scale self-similarity, and sets of this type played an important role in Katz, {\L}aba, and Tao's groundbreaking 1999 work on the Kakeya problem. We propose a special case of the Kakeya conjecture, which asserts that sticky Kakeya sets must have Hausdorff and Minkowski dimension $n$. We prove this conjecture in three dimensions.


title: NADI 2022: The Third Nuanced Arabic Dialect Identification Shared Task

abstract: We describe findings of the third Nuanced Arabic Dialect Identification Shared Task (NADI 2022). NADI aims at advancing state of the art Arabic NLP, including on Arabic dialects. It does so by affording diverse datasets and modeling opportunities in a standardized context where meaningful comparisons between models and approaches are possible. NADI 2022 targeted both dialect identification (Subtask 1) and dialectal sentiment analysis (Subtask 2) at the country level. A total of 41 unique teams registered for the shared task, of whom 21 teams have actually participated (with 105 valid submissions). Among these, 19 teams participated in Subtask 1 and 10 participated in Subtask 2. The winning team achieved 27.06 F1 on Subtask 1 and F1=75.16 on Subtask 2, reflecting that the two subtasks remain challenging and motivating future work in this area. We describe methods employed by participating teams and offer an outlook for NADI.


title: A new presentation of the osp(1|2)-polynomial link invariant and categorification

abstract: There is a known connection between the osp(1|2n) polynomial knot invariant $J_K^n$ and the so(2n+1) knot invariant ${}_{so} J_K^n$ studied by Clark in arXiv:1509.03533 and Blumen in arXiv:0901.3232. In the rank one case, the uncolored $U_{q}(osp(1|2))$ link invariant is equal to the $U_{t^{-1}q}(sl_2)$ link invariant where $t^2=-1$. We define a skein relation similar to the Kauffman bracket, and use that to recover an oriented link invariant which coincides with Clark's uncolored osp(1|2)-link invariant. This definition also comes from the representation theory of $U_{q,\pi}(sl_2)$, but using different methods from Clark. We show that our invariant is easily categorified by a slightly modified version of Khovanov homology equipped with an extra $\mathbb{Z}_4$-grading. We also construct a similarly modified version of Putyra's covering Khovanov homology from arXiv:1310.1895. This suggests that the similarity between the two invariants holds at the categorified level as well.


title: Effect of rotation on turbulent mixing driven by the Faraday instability

abstract: The effect of the rotation on the turbulent mixing of two miscible fluids of small contrasting density, produced by Faraday instability, is investigated using direct numerical simulations (DNS). We demonstrate that at lower forcing amplitudes, the t.k.e. increases with an increase in f till (f/\omega\right)^2<0.25, where \omega is the forcing frequency, during the sub-harmonic instability phase. The increase in t.k.e. increases B_V, which increases the total potential energy (TPE). A portion of TPE is the APE. Some parts of APE can convert to $t.k.e.$ via B_V, whereas the rest converts to internal energy, increasing BPE through \phi_i. The remaining TPE also converts to BPE through the diapycnal flux \phi_d resulting in irreversible mixing. With the saturation of the instability, irreversible mixing ceases. When (f/\omega\right)^2 > 0.25, the Coriolis force significantly delays the onset of the sub-harmonic instabilities. During this period, the initial concentration profile diffuses to increase TPE, which eventually expends in BPE. The strong rotational effects suppress t.k.e.. Therefore, B_V and APE become small, and the bulk of the TPE expends to BPE. Since the instability never saturates for $\left(f/\omega\right)^2 > 0.25$, the $B_V$ remains non-zero, resulting in a continuous increase in TPE. Conversion of TPE to BPE via $\phi_d$ continues, and we find prolonged irreversible mixing. At higher forcing amplitudes, the stabilizing effect of rotation is negligible, and the turbulence is less intense and short-lived. Therefore, the irreversible mixing phenomenon also ends quickly for $\left(f/\omega\right)^2<0.25$. However, when $\left(f/\omega\right)^2>0.25$ a continuous mixing is observed. We find that the turbulent mixing is efficient at lower forcing amplitudes and rotation rates of (f/\omega)^2 > 0.25.


title: Stability of electromagnetic solitons]{Electromagnetic solitons and their stability in relativistic degenerate dense plasmas with two electron species

abstract: The evolution of electromagnetic (EM) solitons due to nonlinear coupling of circularly polarized intense laser pulses with low-frequency electron-acoustic perturbations is studied in relativistic degenerate dense astrophysical plasmas with two groups of electrons: a sparse population of classical relativistic electrons and a dense population of relativistic degenerate electron gas. Different forms of localized stationary solutions are obtained and their properties are analyzed. Using the Vakhitov-Kolokolov stability criterion, the conditions for the existence and stability of a moving EM soliton are also studied. It is noted that the stable and unstable regions shift around the plane of soliton eigenfrequency and the soliton velocity due to the effects of relativistic degeneracy, the fraction of classical to degenerate electrons and the EM wave frequency. Furthermore, while the standing solitons exhibit stable profiles for a longer time, the moving solitons, however, can be stable or unstable depending on the degree of electron degeneracy, the soliton eigenfrequency and the soliton velocity. The latter with an enhanced value can eventually lead to a soliton collapse. The results should be useful for understanding the formation of solitons in the coupling of highly intense laser pulses with slow response of degenerate dense plasmas in the next generation laser-plasma interaction experiments as well as the novel features of $x$-ray and $\gamma$-ray pulses that originate from compact astrophysical objects.


title: Deep Deterministic Policy Gradient to Minimize the Age of Information in Cellular V2X Communications

abstract: This paper studies the problem of minimizing the age of information (AoI) in cellular vehicle-to-everything communications. To provide minimal AoI and high reliability for vehicles' safety information, NOMA is exploited. We reformulate a resource allocation problem that involves half-duplex transceiver selection, broadcast coverage optimization, power allocation, and resource block scheduling. First, to obtain the optimal solution, we formulate the problem as a mixed-integer nonlinear programming problem and then study its NP-hardness. The NP-hardness result motivates us to design simple solutions. Consequently, we model the problem as a single-agent Markov decision process to solve the problem efficiently using fingerprint deep reinforcement learning techniques such as deep-Q-network (DQN) methods. Nevertheless, applying DQN is not straightforward due to the curse of dimensionality implied by the large and mixed action space that contains discrete and continuous optimization decisions. Therefore, to solve this mixed discrete/continuous problem efficiently, simply and elegantly, we propose a decomposition technique that consists of first solving the discrete subproblem using a matching algorithm based on state-of-the-art stable roommate matching and then solving the continuous subproblem using DRL algorithm that is based on deep deterministic policy gradient DDPG. We validate our proposed method through Monte Carlo simulations where we show that the decomposed matching and DRL algorithm successfully minimizes the AoI and achieves almost 66% performance gain compared to the best benchmarks for various vehicles' speeds, transmission power, or packet sizes. Further, we prove the existence of an optimal value of broadcast coverage at which the learning algorithm provides the optimal AoI.


title: Summary Workbench: Unifying Application and Evaluation of Text Summarization Models

abstract: This paper presents Summary Workbench, a new tool for developing and evaluating text summarization models. New models and evaluation measures can be easily integrated as Docker-based plugins, allowing to examine the quality of their summaries against any input and to evaluate them using various evaluation measures. Visual analyses combining multiple measures provide insights into the models' strengths and weaknesses. The tool is hosted at \url{https://tldr.demo.webis.de} and also supports local deployment for private resources.


title: Synergy with Translation Artifacts for Training and Inference in Multilingual Tasks

abstract: Translation has played a crucial role in improving the performance on multilingual tasks: (1) to generate the target language data from the source language data for training and (2) to generate the source language data from the target language data for inference. However, prior works have not considered the use of both translations simultaneously. This paper shows that combining them can synergize the results on various multilingual sentence classification tasks. We empirically find that translation artifacts stylized by translators are the main factor of the performance gain. Based on this analysis, we adopt two training methods, SupCon and MixUp, considering translation artifacts. Furthermore, we propose a cross-lingual fine-tuning algorithm called MUSC, which uses SupCon and MixUp jointly and improves the performance. Our code is available at https://github.com/jongwooko/MUSC.


title: The Sparse(st) Optimization Problem: Reformulations, Optimality, Stationarity, and Numerical Results

abstract: We consider the sparse optimization problem with nonlinear constraints and an objective function, which is given by the sum of a general smooth mapping and an additional term defined by the $ \ell_0 $-quasi-norm. This term is used to obtain sparse solutions, but difficult to handle due to its nonconvexity and nonsmoothness (the sparsity-improving term is even discontinuous). The aim of this paper is to present two reformulations of this program as a smooth nonlinear program with complementarity-type constraints. We show that these programs are equivalent in terms of local and global minima and introduce a problem-tailored stationarity concept, which turns out to coincide with the standard KKT conditions of the two reformulated problems. In addition, a suitable constraint qualification as well as second-order conditions for the sparse optimization problem are investigated. These are then used to show that three Lagrange-Newton-type methods are locally fast convergent. Numerical results on different classes of test problems indicate that these methods can be used to drastically improve sparse solutions obtained by some other (globally convergent) methods for sparse optimization problems.


title: Neutrino magnetohydrodynamic instabilities in presence of two-flavor oscillations

abstract: The influence of neutrino flavor oscillations on the propagation of magnetohydrodynamic (MHD) waves and instabilities is studied in neutrino-beam driven magnetoplasmas. Using the neutrino MHD model, a general dispersion relation is derived which manifests the resonant interactions of MHD waves, not only with the neutrino beam, but also with the neutrino flavor oscillations. It is found that the latter contribute to the wave dispersion and enhance the magnitude of the instability of oblique magnetosonic waves. However, the shear-Alfv{\'e}n wave remains unaffected by the neutrino beam and neutrino flavor oscillations. Such an enhancement of the magnitude of the instability of magnetosonic waves can be significant for relatively long-wavelength perturbations in the regimes of high neutrino number density and/or strong magnetic field, giving a convincing mechanism for type-II core-collapse supernova explosion.


title: Evidence of fresh cosmic ray in galactic plane based on DAMPE measurement of B/C and B/O ratios

abstract: More and more experiments have identified that the energy spectra of both primary and secondary cosmic-rays exhibit a hardening above $\sim 200$ GV. Most recently, the DAMPE experiment has reported a hardening of boron-to-carbon ratio at $200$ GV. These signs call for modifications of the conventional cosmic-ray (CR) picture. In this work, we propose that the plethoric secondary cosmic rays, for example, boron, antiprotons, originate from the hadronic interactions of freshly accelerated cosmic rays with the interstellar gas near the sources. We find that secondary-to-primary ratios, for example, boron-to-carbon, boron-to-oxygen and antiproton-to-proton ratios, could be well described. The measurements of electrons and positrons could also be accounted for.


title: Search for continuous gravitational waves from HESS~J1427-608 with a hidden Markov model

abstract: We present a search for continuous gravitational wave signals from an unidentified pulsar potentially powering HESS~J1427-608, a spatially unresolved TeV point source detected by the High Energy Stereoscopic System (HESS). The search uses a semi-coherent algorithm, which combines the maximum likelihood $\mathcal{F}$~statistic with a hidden Markov model to efficiently detect and track quasi-monochromatic signals that wander randomly in frequency. It uses data from the second observing run of the Advanced Laser Interferometer Gravitational-Wave Observatory. Multi-wavelength observations of the HESS source are combined with the proprieties of the population of TeV-bright pulsar wind nebulae to constrain the search parameters. We find no evidence of gravitational wave emission from this target. We set upper limits on the characteristic wave strain $h_0^{95\%}$ (for circularly polarized signals) at $95\%$ confidence level in sample sub-bands and interpolate it to estimate the sensitivity in the full band. We find $h_0^{95\%} = 1.3\times 10^{-25}$ near 185~Hz. The implied constraints on the ellipticity and \textit{r}-mode amplitude reach $\epsilon\leq 10^{-5}$ and $\alpha \leq 10^{-3}$ at 200~Hz, respectively.


title: Hessian estimates for Dirichlet and Neumann eigenfunctions of Laplacian

abstract: By methods of stochastic analysis on Riemannian manifolds, we develop two approaches to determine an explicit constant $c(D)$ for an $n$-dimensional compact manifold $D$ with boundary such that $\frac{\lambda}{n}\,\|\phi\|_{\infty} \leq \|{\rm Hess}\ \phi\|_{\infty}\leq c(D)\lambda \,\|\phi\|_{\infty}$ holds for any Dirichlet eigenfunction $\phi$ of $-\Delta$ with eigenvalue $\lambda$. Our results provide the sharp Hessian estimate $\|{\rm Hess}\ \phi\|_{\infty}\lesssim \lambda^{\frac{n+3}{4}}$. Corresponding Hessian estimates for Neumann eigenfunctions are derived in the second part of the paper.


title: Analyses of the contour integral method for time fractional subdiffusion-normal transport equation

abstract: In this work, we theoretically and numerically discuss the time fractional subdiffusion-normal transport equation, which depicts a crossover from sub-diffusion (as $t\rightarrow 0$) to normal diffusion (as $t\rightarrow \infty$). Firstly, the well-posedness and regularities of the model are studied by using the bivariate Mittag-Leffler function. Theoretical results show that after introducing the first-order derivative operator, the regularity of the solution can be improved in substance. Then, a numerical scheme with high-precision is developed no matter the initial value is smooth or non-smooth. More specifically, we use the contour integral method (CIM) with parameterized hyperbolic contour to approximate the temporal local and non-local operators, and employ the standard Galerkin finite element method for spacial discretization. Rigorous error estimates show that the proposed numerical scheme has spectral accuracy in time and optimal convergence order in space. Besides, we further improve the algorithm and reduce the computational cost by using the barycentric Lagrange interpolation. Finally, the obtained theoretical results as well as the acceleration algorithm are verified by several 1-D and 2-D numerical experiments, which also show that the numerical scheme developed in this paper is effective and robust.


title: Magnetohydrodynamic instabilities in a self-gravitating rotating cosmic plasma

abstract: The generation of magnetohydrodynamic (MHD) waves and their instabilities are studied in galactic gaseous rotating plasmas with the effects of the magnetic field, the self gravity, the diffusion-convection of cosmic rays as well as the gas and cosmic-ray pressures. The coupling of the Jeans, Alfv{\'e}n and magnetosonic waves, and the conditions of damping or instability are studied in three different cases, namely when the propagation direction is perpendicular, parallel and oblique to the static magnetic field, and are shown to be significantly modified by the effects of the Coriolis force due to the rotation of cosmic fluids and the cosmic-ray diffusion. The coupled modes can be damped or anti-damped depending on the wave number is above or below the Jeans critical wave number that is reduced by the effects of the Coriolis force and the cosmic-ray pressure. It is found that the deviation of the axis of rotation from the direction of the static magnetic field gives rise to the coupling between the Alfv{\'e}n wave and the classical Jeans mode which otherwise results into the modified slow and fast Alfv{\'e}n waves as well as the modified classical Jeans modes. Furthermore, due to the effects of the cosmic rays diffusion, there appears a new wave mode (may be called the fast Jeans mode) in the intermediate frequency regimes of the slow and fast Alfv{\'e}n waves, which seems to be dispersionless in the long-wavelength propagation and has a lower growth rate of instability in the high density regimes of galaxies. The dispersion properties and the instabilities of different kinds of MHD waves reported here can play pivotal roles in the formation of various galactic structures at different length scales.


title: Theory of generating spaces of convex sets and their applications to solvability of convex programs in Banach spaces

abstract: When optimization theorists consider optimization problems in infinite dimensional spaces, they need to deal with closed convex subsets(usually cones) which mostly have empty interior. These subsets often prevent optimization theorists from applying powerful techniques to study these optimization problems. In this paper, by nonsupport point, we present generating spaces which are relative to a Banach space and a nonsupport point of its convex closed subset. Then for optimization problems in infinite dimensional spaces, in some general cases, we replace original spaces by generating spaces while containing solutions. Thus this method enable us to apply powerful classical techniques to optimization problems in very general class of infinite dimensional spaces. Based on functional analysis, from classical Banach spaces to separable Banach spaces, from Banach lattice to latticization, we give characterizations of generating spaces and conclude that they are actually linearly isometric to $L_\infty$($\ell _\infty$) or their closed subspaces. Thus continuous linear functional involved in these techniques could be chosen from $L_\infty^*$($\ell_\infty^*$). After that, applications in Penalty principle, Lagrange duality and scalarization function are further studied by this method.


title: Soft-Labeled Contrastive Pre-training for Function-level Code Representation

abstract: Code contrastive pre-training has recently achieved significant progress on code-related tasks. In this paper, we present \textbf{SCodeR}, a \textbf{S}oft-labeled contrastive pre-training framework with two positive sample construction methods to learn functional-level \textbf{Code} \textbf{R}epresentation. Considering the relevance between codes in a large-scale code corpus, the soft-labeled contrastive pre-training can obtain fine-grained soft-labels through an iterative adversarial manner and use them to learn better code representation. The positive sample construction is another key for contrastive pre-training. Previous works use transformation-based methods like variable renaming to generate semantically equal positive codes. However, they usually result in the generated code with a highly similar surface form, and thus mislead the model to focus on superficial code structure instead of code semantics. To encourage SCodeR to capture semantic information from the code, we utilize code comments and abstract syntax sub-trees of the code to build positive samples. We conduct experiments on four code-related tasks over seven datasets. Extensive experimental results show that SCodeR achieves new state-of-the-art performance on all of them, which illustrates the effectiveness of the proposed pre-training method.


title: Planning for Sample Efficient Imitation Learning

abstract: Imitation learning is a class of promising policy learning algorithms that is free from many practical issues with reinforcement learning, such as the reward design issue and the exploration hardness. However, the current imitation algorithm struggles to achieve both high performance and high in-environment sample efficiency simultaneously. Behavioral Cloning (BC) does not need in-environment interactions, but it suffers from the covariate shift problem which harms its performance. Adversarial Imitation Learning (AIL) turns imitation learning into a distribution matching problem. It can achieve better performance on some tasks but it requires a large number of in-environment interactions. Inspired by the recent success of EfficientZero in RL, we propose EfficientImitate (EI), a planning-based imitation learning method that can achieve high in-environment sample efficiency and performance simultaneously. Our algorithmic contribution in this paper is two-fold. First, we extend AIL into the MCTS-based RL. Second, we show the seemingly incompatible two classes of imitation algorithms (BC and AIL) can be naturally unified under our framework, enjoying the benefits of both. We benchmark our method not only on the state-based DeepMind Control Suite, but also on the image version which many previous works find highly challenging. Experimental results show that EI achieves state-of-the-art results in performance and sample efficiency. EI shows over 4x gain in performance in the limited sample setting on state-based and image-based tasks and can solve challenging problems like Humanoid, where previous methods fail with small amount of interactions. Our code is available at https://github.com/zhaohengyin/EfficientImitate.


title: Denoising Enhanced Distantly Supervised Ultrafine Entity Typing

abstract: Recently, the task of distantly supervised (DS) ultra-fine entity typing has received significant attention. However, DS data is noisy and often suffers from missing or wrong labeling issues resulting in low precision and low recall. This paper proposes a novel ultra-fine entity typing model with denoising capability. Specifically, we build a noise model to estimate the unknown labeling noise distribution over input contexts and noisy type labels. With the noise model, more trustworthy labels can be recovered by subtracting the estimated noise from the input. Furthermore, we propose an entity typing model, which adopts a bi-encoder architecture, is trained on the denoised data. Finally, the noise model and entity typing model are trained iteratively to enhance each other. We conduct extensive experiments on the Ultra-Fine entity typing dataset as well as OntoNotes dataset and demonstrate that our approach significantly outperforms other baseline methods.


title: Moment estimates and well-posedness of the binary-ternary Boltzmann equation

abstract: In this paper, we show generation and propagation of polynomial and exponential moments, as well as global well-posedness of the homogeneous binary-ternary Boltzmann equation. We also show that the co-existence of binary and ternary collisions yields better generation properties and time decay, than when only binary or ternary collisions are considered. To address these questions, we develop for the first time angular averaging estimates for ternary interactions. This is the first paper which discusses this type of questions for the binary-ternary Boltzmann equation and opens the door for studying moments properties of gases with higher collisional density.


title: Observation of the $J/\psi$ and $\psi(3686)$ decays into $\eta\Sigma^{+}\bar{\Sigma}^{-}$

abstract: The decays $J/\psi\to\eta\Sigma^{+}\bar{\Sigma}{}^-$ and $\psi(3686)\to\eta\Sigma^{+}\bar{\Sigma}{}^-$ are observed for the first time, using $(10087 \pm 44)\times 10^{6}$ $J/\psi$ and $(448.1 \pm 2.9)\times 10^{6}$ $\psi(3686)$ events collected with the BESIII detector at the BEPCII collider. We determine the branching fractions of these two decays to be ${\cal B}(J/\psi\to\eta\Sigma^{+}\bar{\Sigma}{}^-)=(6.34 \pm 0.21 \pm 0.37)\times 10^{-5}$ and ${\cal B}(\psi(3686)\to\eta\Sigma^{+}\bar{\Sigma}{}^-)=(9.59 \pm 2.37 \pm 0.61)\times 10^{-6}$, where the first uncertainties are statistical and the second are systematic. The ratio of these two branching fractions is determined to be $\frac{{\cal B}(\psi(3686)\to\eta\Sigma^{+}\bar{\Sigma}{}^-)}{{\cal B}(J/\psi\to\eta\Sigma^{+}\bar{\Sigma}{}^-)}=(15.1 \pm 3.8)\%$, which is in agreement with the "12\% rule."


title: ODEs learn to walk: ODE-Net based data-driven modeling for crowd dynamics

abstract: Predicting the behaviors of pedestrian crowds is of critical importance for a variety of real-world problems. Data driven modeling, which aims to learn the mathematical models from observed data, is a promising tool to construct models that can make accurate predictions of such systems. In this work, we present a data-driven modeling approach based on the ODE-Net framework, for constructing continuous-time models of crowd dynamics. We discuss some challenging issues in applying the ODE-Net method to such problems, which are primarily associated with the dimensionality of the underlying crowd system, and we propose to address these issues by incorporating the social-force concept in the ODE-Net framework. Finally application examples are provided to demonstrate the performance of the proposed method.


title: Hidet: Task-Mapping Programming Paradigm for Deep Learning Tensor Programs

abstract: As deep learning models nowadays are widely adopted by both cloud services and edge devices, reducing the latency of deep learning model inferences becomes crucial to provide efficient model serving. However, it is challenging to develop efficient tensor programs for deep learning operators due to the high complexity of modern accelerators and the rapidly growing number of operators. Deep learning compilers, such as Apache TVM, adopt declarative scheduling primitives to lower the bar of developing tensor programs. However, we show that this approach is insufficient to cover state-of-the-art tensor program optimizations. In this paper, we propose to embed the scheduling process into tensor programs and use dedicated mappings, called task mappings, to define the computation assignment and ordering. This new approach greatly enriches the expressible optimizations by allowing developers to manipulate tensor programs at a much finer granularity. We call the proposed method the task-mapping programming paradigm. In addition, we propose a new post-scheduling fusion optimization that allows developers to focus on scheduling every single operator and automates the fusion after scheduling. It greatly reduces the engineering efforts for operator fusion. Our proposed paradigm also constructs an efficient hardware-centric schedule space, which is agnostic to the program input size and greatly reduces the tuning time. With the proposed paradigm, we implement a deep learning compiler Hidet. Extensive experiments on modern convolution and transformer models show that Hidet outperforms state-of-the-art DNN inference framework, ONNX Runtime, and compiler, TVM equipped with scheduler AutoTVM and Ansor, by up to 1.48x (1.22x on average). It also reduces the tuning time by 20x and 11x compared with AutoTVM and Ansor, respectively. We open-sourced hidet at https://www.github.com/hidet-org/hidet.


title: Perceptual Multi-Exposure Fusion

abstract: As an ever-increasing demand for high dynamic range (HDR) scene shooting, multi-exposure image fusion (MEF) technology has abounded. In recent years, multi-scale exposure fusion approaches based on detail-enhancement have led the way for improvement in highlight and shadow details. Most of such methods, however, are too computationally expensive to be deployed on mobile devices. This paper presents a perceptual multi-exposure fusion method that not just ensures fine shadow/highlight details but with lower complexity than detailenhanced methods. We analyze the potential defects of three classical exposure measures in lieu of using detail-enhancement component and improve two of them, namely adaptive Wellexposedness (AWE) and the gradient of color images (3-D gradient). AWE designed in YCbCr color space considers the difference between varying exposure images. 3-D gradient is employed to extract fine details. We build a large-scale multiexposure benchmark dataset suitable for static scenes, which contains 167 image sequences all told. Experiments on the constructed dataset demonstrate that the proposed method exceeds existing eight state-of-the-art approaches in terms of visually and MEF-SSIM value. Moreover, our approach can achieve a better improvement for current image enhancement techniques, ensuring fine detail in bright light.


title: Optimal Phase Design for RIS Channel Estimation

abstract: We develop an optimal version of a prior two-stage channel estimation protocol for RIS-assisted channels. The new design uses a modified DFT matrix (MDFT) for the training phases at the RIS and is shown to minimize the total channel estimation error variance. In conjunction with interpolation (estimating fewer RIS channels), the MDFT approach accelerates channel estimation even when the channel from base station to RIS is line-of-sight. In contrast, prior two-stage techniques required a full-rank channel for efficient estimation. We investigate the resulting channel estimation errors by comparing different training phase designs for a variety of propagation conditions using a ray-based channel model. To examine the overall performance, we simulate the spectral efficiency with MRC processing for a single-user RIS-assisted system using an existing optimal design for the RIS transmission phases. Results verify the optimality of MDFT while simulations and analysis show that the performance is more dependent on the user-to-RIS channel correlation and the coarseness of the interpolation used, rather than the training phase design. For example, under a scenario with more highly correlated channels, the procedure accelerates channel estimation by a factor of 16, while the improvement is a factor of 5 in a less correlated case. The overall procedure is extremely robust, with a maximum performance loss of 1.5bits/sec/Hz compared to that with perfect channel state information for the considered channel conditions.


title: Degradation-invariant Enhancement of Fundus Images via Pyramid Constraint Network

abstract: As an economical and efficient fundus imaging modality, retinal fundus images have been widely adopted in clinical fundus examination. Unfortunately, fundus images often suffer from quality degradation caused by imaging interferences, leading to misdiagnosis. Despite impressive enhancement performances that state-of-the-art methods have achieved, challenges remain in clinical scenarios. For boosting the clinical deployment of fundus image enhancement, this paper proposes the pyramid constraint to develop a degradation-invariant enhancement network (PCE-Net), which mitigates the demand for clinical data and stably enhances unknown data. Firstly, high-quality images are randomly degraded to form sequences of low-quality ones sharing the same content (SeqLCs). Then individual low-quality images are decomposed to Laplacian pyramid features (LPF) as the multi-level input for the enhancement. Subsequently, a feature pyramid constraint (FPC) for the sequence is introduced to enforce the PCE-Net to learn a degradation-invariant model. Extensive experiments have been conducted under the evaluation metrics of enhancement and segmentation. The effectiveness of the PCE-Net was demonstrated in comparison with state-of-the-art methods and the ablation study. The source code of this study is publicly available at https://github.com/HeverLaw/PCENet-Image-Enhancement.


title: Second Order Bismut formulae and applications to Neumann semigroups on manifolds

abstract: Let $M$ be a complete connected Riemannian manifold with boundary $\partial M$, and let $P_t$ be the Neumann semigroup generated by $\frac{ 1}{ 2} L$ where $L=\Delta+Z$ for a $C^1$-vector field $Z$ on $M$. We establish Bismut type formulae for $LP_t f$ and ${\rm Hess}_{P_tf}$ and present estimates of these quantities under suitable curvature conditions. In case when $P_t$ is symmetric in $L^2(\mu)$ for some probability measure $\mu$, a new type of log-Sobolev inequality is established which links the relative entropy $H$, the Stein discrepancy $S$, and relative Fisher information $I$, generalizing the authors' recent work in the case without boundary.


title: Spin re-orientation induced anisotropic magnetoresistance switching in LaCo$_{0.5}$Ni$_{0.5}$O$_{3-\delta}$ thin films

abstract: Realization of novel functionalities by tuning magnetic interactions in rare earth perovskite oxide thin films opens up exciting technological prospects. Strain-induced tuning of magnetic interactions in rare earth cobaltates and nickelates is of central importance due to their versatility in electronic transport properties. Here we reported the spin re-orientation induced switching of anisotropic magnetoresistance (AMR) and its tunability with strain in epitaxial LaCo$_{0.5}$Ni$_{0.5}$O$_{3-\delta}$ thin films across the ferromagnetic transition. Moreover, with strain tuning, we could observe a two-fold to four-fold symmetry crossover in AMR across the magnetic transition temperature. The magnetization measurements revealed an onset of ferromagnetic transition around 50 K, and a further reduction in temperature showed a subtle change in the magnetization dynamics, which reduced the ferromagnetic long-range ordering and introduced glassiness in the system. X-ray absorption and X-ray magnetic circular dichroism spectroscopy measurements over Co and Ni L edges revealed the Co spin state transition below the magnetic transition temperature leading to the AMR switching and also the presence of Ni$^{2+}$ and Co$^{4+}$ ions evidencing the charge transfer from Ni to Co ions. Our work demonstrated the tunability of magnetic interactions mediated electronic transport in cobaltate-nickelate thin films, which is relevant in understanding Ni-Co interactions in oxides for their technological applications such as in AMR sensors.


title: SA-MLP: Distilling Graph Knowledge from GNNs into Structure-Aware MLP

abstract: The message-passing mechanism helps Graph Neural Networks (GNNs) achieve remarkable results on various node classification tasks. Nevertheless, the recursive nodes fetching and aggregation in message-passing cause inference latency when deploying GNNs to large-scale graphs. One promising inference acceleration direction is to distill the GNNs into message-passing-free student multi-layer perceptrons (MLPs). However, the MLP student cannot fully learn the structure knowledge due to the lack of structure inputs, which causes inferior performance in the heterophily and inductive scenarios. To address this, we intend to inject structure information into MLP-like students in low-latency and interpretable ways. Specifically, we first design a Structure-Aware MLP (SA-MLP) student that encodes both features and structures without message-passing. Then, we introduce a novel structure-mixing knowledge distillation strategy to enhance the learning ability of MLPs for structure information. Furthermore, we design a latent structure embedding approximation technique with two-stage distillation for inductive scenarios. Extensive experiments on eight benchmark datasets under both transductive and inductive settings show that our SA-MLP can consistently outperform the teacher GNNs, while maintaining faster inference as MLPs. The source code of our work can be found in https://github.com/JC-202/SA-MLP.


title: Majorana corner states on the dice lattice

abstract: Lattice geometry continues providing exotic topological phases in condensed matter physics. Exciting recent examples are the higher-order topological phases, manifesting via localized lower-dimensional boundary states. Moreover, flat electronic bands with a non-trivial topology arise in various lattices and can hold a finite superfluid density, bounded by the Chern number $C$. Here we consider attractive interaction in the dice lattice that hosts flat bands with $C=\pm2$ and show that the induced superconducting state exhibits a second-order topological phase with mixed singlet-triplet pairing. The second-order nature of the topological superconducting phase is revealed by the zero-energy Majorana bound states at the lattice corners. Hence, the topology of the normal state dictates the nature of the Majorana localization. These findings suggest that flat bands with a higher Chern number provide feasible platforms for inducing higher-order topological superconductivity.


title: Relationships between patenting trends and research activity for green energy technologies

abstract: Green technology is viewed as a means of creating a sustainable society and a catalyst for sustainable development by the global community. It is responsible for both the potential reduction of production waste and the reduction of carbon footprint and CO2 emissions. However, alongside with the growing popularity of green technologies, there is an emerging skepticism about their contribution to solving environmental challenges. This article focuses on three areas of eco-innovation in green technology: renewable energy, hydrogen power, and decarbonization. Our main goal is to analyze the relationship between publication activity and the number of patented research results, thus shedding light on the real-world applicability of scientific outcomes. We used several bibliometric methods for analyzing global publication and patent activity, applied to the Scopus citation database and the European Patent Office's patent database. Our results show that the advancement of research in all three areas of eco-innovation does not automatically lead to the increase in the number of patents. We offer possible reasons for such dependency based on the observations of the worldwide tendencies in green innovation sphere.


title: Probing the Epoch of Reionization using synergies of line intensity mapping

abstract: The Epoch of Reionization (EoR) remains a poorly understood cosmic era for the most part. Yet, efforts are still going on to probe and understand this epoch. We present a review of the latest developments in the techniques (especially line-intensity mapping) to study the EoR and try to highlight the contribution of the Indian community in this field. Line-emissions like [H I]$_{\rm 21cm}$, Lyman-$\alpha$, [C II]$_{\text{158}\mu\text{m}}$ and their role as tracers in probing the EoR are discussed. While the [H I]$_{\rm 21cm}$ is an excellent probe of the early IGM, the others are mainly targeted to do an unresolved and large-scale survey of the reionizing sources. Techniques to model these signals include simulations and machine learning approaches, along with the challenge to tackle foregrounds or interlopers. We also discuss synergy opportunities among the various tracers that we mention. Synergy addresses different aspects of the problem, which otherwise is difficult or impossible to tackle. They include statistics like cross-power spectrum, cross-bispectrum, and other techniques such as follow-up studies. We present updates on the relevant experiments; these include the upper limits on the [H I]$_{\rm 21cm}$ power spectrum, along with some highlights on high-redshift galaxy surveys. Finally, we highlight what can be improved further within the community: applying machine learning and simulations based on hydrodynamic and radiative-transfer techniques. Next-generation experiments also need to be conceived to address issues currently beyond our reach.


title: Nonlinear electro-hydrodynamics of liquid crystals

abstract: We present nonlinear dynamic equations for nematic and smectic $A$ liquid crystals in the presence of an alternating electric field and explain their derivation in detail. The local electric field acting in any liquid-crystalline system is expressed as a sum of external electric field and the fields originating from feedback of liquid crystal order parameter, and a field, created by charged impurities. The system tends to decrease the total electric field, because it lowers the energy density. This basically nonlinear problem is not a pure academic interest. In the realm of liquid crystals and their applications, utilized nowadays modern experimental techniques have progressed to the point where even small deviations from the linear behavior can be observed and measured with a high accuracy. Hydrodynamics is the macroscopic description of condensed matter systems in the low frequency, long wavelength limit. Nonlinear hydrodynamic equations are well established to describe simple fluids. Similar approaches (with degrees of freedom related to the broken orientational or translational symmetry included) have been used also for liquid crystals. However to study behavior of strongly perturbed well above the thresholds of various electro-hydrodynamic instabilities of liquid crystals the nonlinear equations should include soft electromagnetic degrees of freedom as well. The self-consistent derivation of the complete set of the nonlinear electro-hydrodynamic equations for liquid crystals became an actual task. The aim of our work is to present these equations, which is a mandatory step to handle any nonlinear phenomenon in liquid crystals.


title: The popularity gap

abstract: Suppose that $A$ is a finite, nonempty subset of a cyclic group of either infinite or prime order. We show that if the difference set $A-A$ is ``not too large'', then there is a nonzero group element with at least as many as $(2+o(1))|A|^2/|A-A|$ representations as a difference of two elements of $A$; that is, the second largest number of representations is, essentially, twice the average. Here the coefficient $2$ is the best possible. We also prove continuous and multidimensional versions of this result, and obtain similar results for sufficiently dense subsets of an arbitrary abelian group.


title: Homogeneous Multi-modal Feature Fusion and Interaction for 3D Object Detection

abstract: Multi-modal 3D object detection has been an active research topic in autonomous driving. Nevertheless, it is non-trivial to explore the cross-modal feature fusion between sparse 3D points and dense 2D pixels. Recent approaches either fuse the image features with the point cloud features that are projected onto the 2D image plane or combine the sparse point cloud with dense image pixels. These fusion approaches often suffer from severe information loss, thus causing sub-optimal performance. To address these problems, we construct the homogeneous structure between the point cloud and images to avoid projective information loss by transforming the camera features into the LiDAR 3D space. In this paper, we propose a homogeneous multi-modal feature fusion and interaction method (HMFI) for 3D object detection. Specifically, we first design an image voxel lifter module (IVLM) to lift 2D image features into the 3D space and generate homogeneous image voxel features. Then, we fuse the voxelized point cloud features with the image features from different regions by introducing the self-attention based query fusion mechanism (QFM). Next, we propose a voxel feature interaction module (VFIM) to enforce the consistency of semantic information from identical objects in the homogeneous point cloud and image voxel representations, which can provide object-level alignment guidance for cross-modal feature fusion and strengthen the discriminative ability in complex backgrounds. We conduct extensive experiments on the KITTI and Waymo Open Dataset, and the proposed HMFI achieves better performance compared with the state-of-the-art multi-modal methods. Particularly, for the 3D detection of cyclist on the KITTI benchmark, HMFI surpasses all the published algorithms by a large margin.


title: A Simple Electronic Circuit Demonstrating Hopf Bifurcation for an Advanced Undergraduate Laboratory

abstract: A nonlinear electronic circuit comprising of three nodes with a feedback loop is analyzed. The system has two stable states, a uniform state and a sinusoidal oscillating state, and it transitions from one to another by means of a Hopf bifurcation. The stability of this system is analyzed with nonlinear equations derived from a repressilator-like transistor circuit. The apparatus is simple and inexpensive, and the experiment demonstrates aspects of nonlinear dynamical systems in an advanced undergraduate laboratory setting.


title: Protecting Split Learning by Potential Energy Loss

abstract: As a practical privacy-preserving learning method, split learning has drawn much attention in academia and industry. However, its security is constantly being questioned since the intermediate results are shared during training and inference. In this paper, we focus on the privacy leakage from the forward embeddings of split learning. Specifically, since the forward embeddings contain too much information about the label, the attacker can either use a few labeled samples to fine-tune the top model or perform unsupervised attacks such as clustering to infer the true labels from the forward embeddings. To prevent such kind of privacy leakage, we propose the potential energy loss to make the forward embeddings become more 'complicated', by pushing embeddings of the same class towards the decision boundary. Therefore, it is hard for the attacker to learn from the forward embeddings. Experiment results show that our method significantly lowers the performance of both fine-tuning attacks and clustering attacks.


title: Object Recognition in Different Lighting Conditions at Various Angles by Deep Learning Method

abstract: Existing computer vision and object detection methods strongly rely on neural networks and deep learning. This active research area is used for applications such as autonomous driving, aerial photography, protection, and monitoring. Futuristic object detection methods rely on rectangular, boundary boxes drawn over an object to accurately locate its location. The modern object recognition algorithms, however, are vulnerable to multiple factors, such as illumination, occlusion, viewing angle, or camera rotation as well as cost. Therefore, deep learning-based object recognition will significantly increase the recognition speed and compatible external interference. In this study, we use convolutional neural networks (CNN) to recognize items, the neural networks have the advantages of end-to-end, sparse relation, and sharing weights. This article aims to classify the name of the various object based on the position of an object's detected box. Instead, under different distances, we can get recognition results with different confidence. Through this study, we find that this model's accuracy through recognition is mainly influenced by the proportion of objects and the number of samples. When we have a small proportion of an object on camera, then we get higher recognition accuracy; if we have a much small number of samples, we can get greater accuracy in recognition. The epidemic has a great impact on the world economy where designing a cheaper object recognition system is the need of time.


title: Sector-wise analysis of Indian stock market: Long and short-term risk and stability analysis

abstract: This paper, for the first time, focuses on the sector-wise analysis of a stock market through multifractal analysis. We have considered Bombay Stock Exchange, India, and identified two time scales, short ($<200$ days) and long time-scale ($>200$ days) for investment. We infer that long-term investment will be more profitable. For long time scale, sectors can be separated into two categories based on the Hurst exponent values; one corresponds to stable sectors with small fluctuations, and the other with dominance of large fluctuations leading to possible downturns in those sectors.


title: The Volumetric Star Formation Law in the Almost Edge-on Galaxy NGC 4302 Revealed by ALMA

abstract: We observe the almost edge-on (i $\sim$ 90 degrees) galaxy NGC 4302 using ALMA (CO) and VLA (H I) to measure the gas disk thickness for investigating the volumetric star formation law (SFL). The recent star formation rate (SFR) is estimated based on a linear combination of IR 24 micron and H$\alpha$ emissions. The measured scale heights of CO and H I increase significantly with radius. Using the scale heights along with the vertically integrated surface densities, we derive the mid-plane volume densities of the gas ($\rho_{\rm HI}$, $\rho_{\rm H_2}$, and $\rho_{\rm gas}$ = $\rho_{\rm HI}$+$\rho_{\rm H_2}$) and the SFR ($\rho_{\rm SFR}$) and compare the volumetric SFL ($\rho_{\rm SFR} \propto \rho_{\rm gas}^n$) with the vertically integrated SFL ($\Sigma_{\rm SFR} \propto \Sigma_{\rm gas}^N$). We find tight power-law correlations between the SFR and the gas (H I, H$_2$, and the total gas) in both volume and surface densities. The power-law indices of the total gas and H I for the volumetric SFL are noticeably smaller than the indices for the vertically integrated SFL while the H$_2$ indices for both cases are similar to each other. In terms of the star formation efficiency (SFE), we find that the molecular and total gas SFEs are roughly constant, while the atomic SFE is clearly decreasing with radius in both cases.


title: Dust extinction map of the Galactic plane based on the VVV survey data

abstract: Dust extinction is one of the most reliable tracers of the gas distribution in the Milky Way. The near-infrared (NIR) Vista Variables in the Via Lactea (VVV) survey enables extinction mapping based on stellar photometry over a large area in the Galactic plane. We devise a novel extinction mapping approach, XPNICER, by bringing together VVV photometric catalogs, stellar parameter data from StarHorse catalogs, and previously published Xpercentile and PNICER extinction mapping techniques. We apply the approach to the VVV survey area, resulting in an extinction map that covers the Galactic disk between 295 and 350 degrees at longitude and -2 to 2 degrees at latitude, and the Galactic bulge between -10 and 5 degrees at latitude. The map has 30 arcseconds spatial resolution and it traces extinctions typically up to about 10-20 mag of visual extinction and maximally up to Av~30 mag. We compare our map to previous dust based maps, concluding that it provides a high-fidelity extinction-based map, especially in its ability to recover both the diffuse dust component of the Galaxy and moderately extincted giant molecular cloud regions. The map is especially useful as independent, extinction-based data on the Galactic dust distribution and applicable for a wide range of studies from individual molecular clouds to the studies of the Galactic stellar populations.


title: Deep Black-Box Reinforcement Learning with Movement Primitives

abstract: \Episode-based reinforcement learning (ERL) algorithms treat reinforcement learning (RL) as a black-box optimization problem where we learn to select a parameter vector of a controller, often represented as a movement primitive, for a given task descriptor called a context. ERL offers several distinct benefits in comparison to step-based RL. It generates smooth control trajectories, can handle non-Markovian reward definitions, and the resulting exploration in parameter space is well suited for solving sparse reward settings. Yet, the high dimensionality of the movement primitive parameters has so far hampered the effective use of deep RL methods. In this paper, we present a new algorithm for deep ERL. It is based on differentiable trust region layers, a successful on-policy deep RL algorithm. These layers allow us to specify trust regions for the policy update that are solved exactly for each state using convex optimization, which enables policies learning with the high precision required for the ERL. We compare our ERL algorithm to state-of-the-art step-based algorithms in many complex simulated robotic control tasks. In doing so, we investigate different reward formulations - dense, sparse, and non-Markovian. While step-based algorithms perform well only on dense rewards, ERL performs favorably on sparse and non-Markovian rewards. Moreover, our results show that the sparse and the non-Markovian rewards are also often better suited to define the desired behavior, allowing us to obtain considerably higher quality policies compared to step-based RL.