title: Learning Temporally-Consistent Representations for Data-Efficient Reinforcement Learning

abstract: Deep reinforcement learning (RL) agents that exist in high-dimensional state spaces, such as those composed of images, have interconnected learning burdens. Agents must learn an action-selection policy that completes their given task, which requires them to learn a representation of the state space that discerns between useful and useless information. The reward function is the only supervised feedback that RL agents receive, which causes a representation learning bottleneck that can manifest in poor sample efficiency. We present $k$-Step Latent (KSL), a new representation learning method that enforces temporal consistency of representations via a self-supervised auxiliary task wherein agents learn to recurrently predict action-conditioned representations of the state space. The state encoder learned by KSL produces low-dimensional representations that make optimization of the RL task more sample efficient. Altogether, KSL produces state-of-the-art results in both data efficiency and asymptotic performance in the popular PlaNet benchmark suite. Our analyses show that KSL produces encoders that generalize better to new tasks unseen during training, and its representations are more strongly tied to reward, are more invariant to perturbations in the state space, and move more smoothly through the temporal axis of the RL problem than other methods such as DrQ, RAD, CURL, and SAC-AE.


title: Topological phonons in an inhomogeneously strained silicon-1: Evidence of long-distance spin transport and unidirectional magnetoresistance of phonons

abstract: Transverse acoustic waves in an inhomogeneous medium are analogues to electromagnetic waves and will exhibit topological behavior due to the Berry gauge potential in the momentum space due to inhomogeneity. The inhomogeneous (or gradient) medium can be created using an applied strain gradient in a semiconductor thin film (silicon) since the phonon frequency and dispersion will be a function of the local strain along the strain gradient direction. As a consequence, topological phonon mediated spin and heat transport can be engineered in the semiconductor thin films. Here, we present evidence of a long-distance (100 um) spin transport in the freestanding Si thin film sample under an applied strain gradient using transverse spin-Nernst effect measurement. The long-distance spin transport was attributed to the topological spin-Hall effect of phonons in an inhomogeneous medium. The inhomogeneous medium was validated using unidirectional magnetoresistance of phonons where the magnitude of the coefficient of the non-reciprocal response at room temperature was as large as reported in the BiTeBr at low temperatures. The topological phonons also manifested the topological Nernst effect. This work not only enhances the current understanding of inhomogeneous systems but also lays the foundation of the topological and spin phononics.


title: Topological phonons in an inhomogeneously strained silicon-2: Evidence of spin-momentum locking

abstract: In this study, we report first experimental evidence of spin-momentum locking in the topological phonons in an inhomogeneously strained Si thin film. The spin-momentum locking in the topological phonons lead to a longitudinal spin texture or spatially inhomogeneous spin distribution in the freestanding sample structure. The spin texture was uncovered using location dependent Hall effect and planar Hall effect measurement. The charge carrier density and anomalous Hall resistance showed a linear behavior along the length of the sample. Similarly, the planar Hall resistance related with the spin dependent scattering was also found to be different at two different location along the length of the sample. The spin-momentum locking also gave rise to transverse thermal spin current and spin-Nernst magneto thermopower response, which was uncovered using angle dependent longitudinal second harmonic measurement. The magneto thermopower response was also a function of crystallography of the Si sample where the sign of the response was opposite for <110> and <100> aligned samples. The spin-momentum locking in topological phonons may give rise to large spin dependent response at and above room temperature, which can pave the way for energy efficient spintronics and spin-caloritronics devices.


title: Flexoelectronic doping of the degenerate silicon and the correlated electron behavior

abstract: In metal/degenerately doped silicon bilayer structure, the interfacial flexoelectric effect due to strain gradient leads to charge carrier transfer from metal layer to the silicon layer. This excess charge carrier concentration is called flexoelectronic doping or flexoelectronic charge transfer, which gives rise to an electronically polarized (order of magnitude larger than ferroelectric materials) silicon layer. In the transport measurements, the charge carrier concentration in silicon is found to increase by two orders of magnitude due to flexoelectronic doping, which changes the Fermi level and the Hall response. The flexoelectronic charge accumulation modifies the electron-electron and the electron phonon coupling, which gives rise to Mott metal-insulator transition and magnetism of phonons, respectively. The coexistence of flexoelectronic polarization and magnetism gives rise to a new class of materials called electronic multiferroics. By controlling the flexoelectronic doping, material behavior can potentially be engineered for quantum, spintronics and electronics applications in semiconductor materials.


title: Topological phonons in an inhomogeneously strained silicon-4: Large spin dependent thermoelectric response and thermal spin transfer torque due to topological electronic magnetism of phonons

abstract: The superposition of flexoelectronic doping and topological phonons give rise to topological electronic magnetism of phonon in an inhomogeneously strained Si in the bilayer structure with metal. In case of ferromagnetic metal and Si bilayer structure, the flexoelectronic doping will also give rise to larger spin current, which will lead to large spin to charge conversion due to topological electronic magnetism of phonon. By applying a temperature difference to ferromagnetic metal/Si bilayer structure under an applied strain gradient, a large thermoelectric response can be generated. In this experimental study, we report a large spin dependent thermoelectric response at Ni80Fe20/Si bilayer structure. The spin dependent response is found to be an order of magnitude larger than that in Pt thin films and similar to topological insulators surface states in spite of negligible intrinsic spin-orbit coupling of Si. This large response is attributed to the flexoelectronic doping and topological electronic magnetism of phonons, which was uncovered using topological Nernst effect measurement. This alternative and novel approach of using inhomogeneous strain engineering to address both spin current density and spin to charge conversion can open a new window to the realization of spintronics and spin-caloritronics devices using metal and doped-semiconductor layered materials.


title: Topological phonons in an inhomogeneously strained silicon-5: Inhomogeneous magnetoelectronic effect in a conductor

abstract: The spatially inhomogeneity in a magnetic crystal give rise to electric polarization, which is known as inhomogeneous magnetoelectric effect. Similarly, an inhomogeneous magnetoelectronic effect in a conducting multiferroic material give rise to spatially inhomogeneous magnetic moment and spin distribution due to spatially inhomogeneity in the charge carrier concentration. In this study, we present experimental evidence of inhomogeneous magnetoelectronic effect in Py/p-Si layered structure. The Py/p-Si layered structure exhibit electronic multiferroicity due to superposition of flexoelectronic charge carrier doping and topological phonons. It gives rise to spatially modulations in the spin density and magnetic moment, which are discovered using the Hall effect measurement. The charge carrier density as well as type of the charge carrier are found to be a function of spatial coordinate as well as direction of magnetic field. The observed modulations can also be interpreted as incommensurate SDW with wavelength of ~142 um. The inhomogeneous magnetoelectronic effect also give rise to magnetocaloric effect, which is uncovered using thermal hysteresis in the magnetoresistance measurement. This is a first experimental evidence of inhomogeneous magnetoelectronic effect, which is electronic counterpart of the magnetoelectric effect.


title: Data on One-dimensional Vertical Free Swelling Potential of Soils and Related Soil Properties

abstract: Most of the damaging geo-hazards recorded in modern history are caused by soil swelling or expansion. Therefore, proper evaluation of a soils capacity to swell is very crucial for the achievement of a secure and safe foundation for civil infrastructure. Hence, in this brief, a dataset of standardised one-dimensional soil swelling on laboratory engineered and natural soils is reported. Corresponding properties of these soils such as moisture content, void ratio, specific gravity, unit weight, Atterberg limits, size fractions, soil activity index including the state of compaction of the soils where applicable, are also presented. The dataset is made up of a total of 395 data on soil swelling potential are reported. With regards to the corresponding soil properties, a total of 219 data records of soil specific gravity, 321 data of initial moisture content, 163 data of void ratio, 273 data of dry unit weight, 347 data of liquid limit, 347 data of plastic limit, 395 data of plasticity index, 209 data of activity index, 339 data of clay content, 174 data of silt content, 246 data of optimum moisture content, 228 data of maximum dry density and 347 data of Unified Soil Classification System (USCS). The procedures followed for the determination of soil swelling and related soil properties are mostly contained in American Standards for Testing of Materials (ASTM D 4546, ASTM D 698, ASTM D 1557 and ASTM D698), American Association of State Highways Transport Officials (AASHTO T 258 and AASHTO-T99) and Turkish Standards (TS1900). Finally, the dataset described herein are intended to aid geotechnical engineers and researchers who are involved in statistical correlation studies, data analytics, machine learning predictions using soft computing methods mostly aimed at evaluating soil expansion especially during the preliminary phases of soil investigation and foundation design.


title: Application of Neural Network in Optimization of Chemical Process

abstract: Artificial neural network (ANN) has been widely used due to its strong nonlinear mapping ability, fault tolerance and self-learning ability. This article summarizes the development history of artificial neural networks, introduces three common neural network types, BP neural network, RBF neural network and convolutional neural network, and focuses on the practical application in chemical process optimization, especially the results achieved in multi-objective control optimization and process parameter improvement.


title: SCEHR: Supervised Contrastive Learning for Clinical Risk Prediction using Electronic Health Records

abstract: Contrastive learning has demonstrated promising performance in image and text domains either in a self-supervised or a supervised manner. In this work, we extend the supervised contrastive learning framework to clinical risk prediction problems based on longitudinal electronic health records (EHR). We propose a general supervised contrastive loss $\mathcal{L}_{\text{Contrastive Cross Entropy} } + \lambda \mathcal{L}_{\text{Supervised Contrastive Regularizer}}$ for learning both binary classification (e.g. in-hospital mortality prediction) and multi-label classification (e.g. phenotyping) in a unified framework. Our supervised contrastive loss practices the key idea of contrastive learning, namely, pulling similar samples closer and pushing dissimilar ones apart from each other, simultaneously by its two components: $\mathcal{L}_{\text{Contrastive Cross Entropy} }$ tries to contrast samples with learned anchors which represent positive and negative clusters, and $\mathcal{L}_{\text{Supervised Contrastive Regularizer}}$ tries to contrast samples with each other according to their supervised labels. We propose two versions of the above supervised contrastive loss and our experiments on real-world EHR data demonstrate that our proposed loss functions show benefits in improving the performance of strong baselines and even state-of-the-art models on benchmarking tasks for clinical risk predictions. Our loss functions work well with extremely imbalanced data which are common for clinical risk prediction problems. Our loss functions can be easily used to replace (binary or multi-label) cross-entropy loss adopted in existing clinical predictive models. The Pytorch code is released at \url{https://github.com/calvin-zcx/SCEHR}.


title: On the Representation of Integers by Binary Forms Defined by Means of the Relation $(x + yi)^n = R_n(x, y) + J_n(x, y)i$

abstract: Let $F$ be a binary form with integer coefficients, non-zero discriminant and degree $d \geq 3$. Let $R_F(Z)$ denote the number of integers of absolute value at most $Z$ which are represented by $F$. In 2019 Stewart and Xiao proved that $R_F(Z) \sim C_FZ^{2/d}$ for some positive number $C_F$. We compute $C_{R_n}$ and $C_{J_n}$ for the binary forms $R_n(x, y)$ and $J_n(x, y)$ defined by means of the relation $ (x + yi)^n = R_n(x, y) + J_n(x, y)i$, where the variables $x$ and $y$ are real.


title: NFT-K: Non-Fungible Tangent Kernels

abstract: Deep neural networks have become essential for numerous applications due to their strong empirical performance such as vision, RL, and classification. Unfortunately, these networks are quite difficult to interpret, and this limits their applicability in settings where interpretability is important for safety, such as medical imaging. One type of deep neural network is neural tangent kernel that is similar to a kernel machine that provides some aspect of interpretability. To further contribute interpretability with respect to classification and the layers, we develop a new network as a combination of multiple neural tangent kernels, one to model each layer of the deep neural network individually as opposed to past work which attempts to represent the entire network via a single neural tangent kernel. We demonstrate the interpretability of this model on two datasets, showing that the multiple kernels model elucidates the interplay between the layers and predictions.


title: LaughNet: synthesizing laughter utterances from waveform silhouettes and a single laughter example

abstract: Emotional and controllable speech synthesis is a topic that has received much attention. However, most studies focused on improving the expressiveness and controllability in the context of linguistic content, even though natural verbal human communication is inseparable from spontaneous non-speech expressions such as laughter, crying, or grunting. We propose a model called LaughNet for synthesizing laughter by using waveform silhouettes as inputs. The motivation is not simply synthesizing new laughter utterances, but testing a novel synthesis-control paradigm that uses an abstract representation of the waveform. We conducted basic listening test experiments, and the results showed that LaughNet can synthesize laughter utterances with moderate quality and retain the characteristics of the training example. More importantly, the generated waveforms have shapes similar to the input silhouettes. For future work, we will test the same method on other types of human nonverbal expressions and integrate it into more elaborated synthesis systems.


title: Towards Demystifying Representation Learning with Non-contrastive Self-supervision

abstract: Non-contrastive methods of self-supervised learning (such as BYOL and SimSiam) learn representations by minimizing the distance between two views of the same image. These approaches have achieved remarkable performance in practice, but the theoretical understanding lags behind. Tian et al. 2021 explained why the representation does not collapse to zero, however, how the feature is learned still remains mysterious. In our work, we prove in a linear network, non-contrastive methods learn a desirable projection matrix and also reduce the sample complexity on downstream tasks. Our analysis suggests that weight decay acts as an implicit threshold that discards the features with high variance under data augmentations, and keeps the features with low variance. Inspired by our theory, we design a simpler and more computationally efficient algorithm DirectCopy by removing the eigen-decomposition step in the original DirectPred algorithm in Tian et al. 2021. Our experiments show that DirectCopy rivals or even outperforms DirectPred on STL-10, CIFAR-10, CIFAR-100, and ImageNet.


title: Advancing Momentum Pseudo-Labeling with Conformer and Initialization Strategy

abstract: Pseudo-labeling (PL), a semi-supervised learning (SSL) method where a seed model performs self-training using pseudo-labels generated from untranscribed speech, has been shown to enhance the performance of end-to-end automatic speech recognition (ASR). Our prior work proposed momentum pseudo-labeling (MPL), which performs PL-based SSL via an interaction between online and offline models, inspired by the mean teacher framework. MPL achieves remarkable results on various semi-supervised settings, showing robustness to variations in the amount of data and domain mismatch severity. However, there is further room for improving the seed model used to initialize the MPL training, as it is in general critical for a PL-based method to start training from high-quality pseudo-labels. To this end, we propose to enhance MPL by (1) introducing the Conformer architecture to boost the overall recognition accuracy and (2) exploiting iterative pseudo-labeling with a language model to improve the seed model before applying MPL. The experimental results demonstrate that the proposed approaches effectively improve MPL performance, outperforming other PL-based methods. We also present in-depth investigations to make our improvements effective, e.g., with regard to batch normalization typically used in Conformer and LM quality.


title: Highly sensitive strain sensor from topological-structure modulated dielectric elastic nanocomposites

abstract: Flexible strain sensors are critical to several potential intelligent applications, such as human-machine interfaces, soft robotics, human motion detection, and safety monitoring of components. Stretchable functional materials are important components of strain sensors, and they are still major challenges for high performance strain sensors. Herein, we demonstrate a novel strategy of designing and optimizing flexible strain sensor by developing topological structure modulated high permittivity elastic nanocomposite. The topological structure with three-phase percolative nano-nanonetworks produces synergistic effects of space charge enhancement and local electric field modulation, and it gives rise to an ultrahigh dielectric permittivity (113.4, at 1 kHz, over 1500% enhancement than that of commercial elastic polyurethane matrix) and excellent comprehensive electromechanical performance, and the optimal comprehensive electromechanical performance reaches to 542.91 MPa-1, which is over 9-fold than that of commercial polyurethane elastic film. An interdigital capacitive strain sensor is designed using the topological structured elastic dielectric nanocomposite. It possesses high initial capacitance density and positive capacitance response with stain, achieving high signal-to-noise ratio, high capacitance response sensitivity, and wide linear range, and it breaks through disadvantages of negative sensitivity and narrow linear range for conventional interdigital strain sensors. The prepared integrated strain sensor arrays are able to measure local strain of convoluted surfaces and monitor the motion of soft actuators in real time, and they would make conditions for intelligent control systems and the study of morphological intelligence.


title: Planar alignment of Liquid Crystals on h-BN for Near-Eye Displays

abstract: Liquid crystals alignment on 2D materials is known due to their intrinsic van der Waals interaction. Here, we demonstrate that direction of electric field can tune the alignment of liquid crystal adsorbed on 2D surface. Due to degeneracy of alignment liquid crystal on hexagonal surface, it prefers to align in three multiple states. We utilized this concept and control the alignment of grains of chemical vapor deposition grown boron nitride (h-BN) to control the incident light. It was demonstrated that electric field can reorient the direction of liquid crystal alignment on Zigzag and armchair edges of h-BN. The ab initio calculations confirmed the favorable adsorption configurations of liquid crystal molecule on hexagonal boron nitride surface. This concept provides a pathway towards dynamic high-quality pixels with low power consumption and could define a new avenue in near-eye displays.


title: Bug Prediction Using Source Code Embedding Based on Doc2Vec

abstract: Bug prediction is a resource demanding task that is hard to automate using static source code analysis. In many fields of computer science, machine learning has proven to be extremely useful in tasks like this, however, for it to work we need a way to use source code as input. We propose a simple, but meaningful representation for source code based on its abstract syntax tree and the Doc2Vec embedding algorithm. This representation maps the source code to a fixed length vector which can be used for various upstream tasks -- one of which is bug prediction. We measured this approach's validity by itself and its effectiveness compared to bug prediction based solely on code metrics. We also experimented on numerous machine learning approaches to check the connection between different embedding parameters with different machine learning models. Our results show that this representation provides meaningful information as it improves the bug prediction accuracy in most cases, and is always at least as good as only using code metrics as features.


title: Platinum Disulfide (PtS2) and Silicon Pyramids: Efficient 2D/3D Heterojunctions Tunneling and Breakdown Diodes

abstract: The p-n junction constructed from the group-10 TMDCs, or namely, transition metal dichalcogenides with an intrinsic layered structure, is not considerably reported. This study presents a mechanical exfoliation-based technique to prepare PtS2 pyramids Si p-n junctions for an investigation of the tunneling and breakdown diodes. the demonstrated p-n diode exhibited a high rectifying performance reaching a rectification ration (If/Ir) to 7.2 *10^4 at zero gate bias with an ideality factor of 1.5. The zener tunneling was observed at a low reverse bias region of breakdown voltage (from -6 to -1V) at various temperatures (50 to 300K) and it was a negative coefficient of temperature. Conversely, for the greater breakdown voltage regime (-15 to -11 V), the breakdown voltage increased with the increased temperature (150 to 300 K), indicating a positive coefficient of temperature. Therefore, this phenomenon was attributed to the avalanche breakdown. The p-n junctions displayed photovoltaic characteristics under the illumination of visible light (500 nm), such as high responsivity (Rph) and photo gain (G) of 11.88 A/W, and 67.10, respectively. The maximum values for both the open-circuit voltage (VOC) and the short-circuit current (ISC) were observed to be 4.5 V, and 10 uA, respectively, at an input intensity of light 70.32 mW/cm2. The outcome of this study suggest PtS2/pyramids Si p-n junctions may be employed in numerous optoelectronics including photovoltaic cells, Zener tunneling diodes, avalanche breakdown diodes and photodetectors.


title: Compact CNN Models for On-device Ocular-based User Recognition in Mobile Devices

abstract: A number of studies have demonstrated the efficacy of deep learning convolutional neural network (CNN) models for ocular-based user recognition in mobile devices. However, these high-performing networks have enormous space and computational complexity due to the millions of parameters and computations involved. These requirements make the deployment of deep learning models to resource-constrained mobile devices challenging. To this end, only a handful of studies based on knowledge distillation and patch-based models have been proposed to obtain compact size CNN models for ocular recognition in the mobile environment. In order to further advance the state-of-the-art, this study for the first time evaluates five neural network pruning methods and compares them with the knowledge distillation method for on-device CNN inference and mobile user verification using ocular images. Subject-independent analysis on VISOB and UPFR-Periocular datasets suggest the efficacy of layerwise magnitude-based pruning at a compression rate of 8 for mobile ocular-based authentication using ResNet50 as the base model. Further, comparison with the knowledge distillation suggests the efficacy of knowledge distillation over pruning methods in terms of verification accuracy and the real-time inference measured as deep feature extraction time on five mobile devices, namely, iPhone 6, iPhone X, iPhone XR, iPad Air 2 and iPad 7th Generation.


title: Recurrent Attention Models with Object-centric Capsule Representation for Multi-object Recognition

abstract: The visual system processes a scene using a sequence of selective glimpses, each driven by spatial and object-based attention. These glimpses reflect what is relevant to the ongoing task and are selected through recurrent processing and recognition of the objects in the scene. In contrast, most models treat attention selection and recognition as separate stages in a feedforward process. Here we show that using capsule networks to create an object-centric hidden representation in an encoder-decoder model with iterative glimpse attention yields effective integration of attention and recognition. We evaluate our model on three multi-object recognition tasks; highly overlapping digits, digits among distracting clutter and house numbers, and show that it learns to effectively move its glimpse window, recognize and reconstruct the objects, all with only the classification as supervision. Our work takes a step toward a general architecture for how to integrate recurrent object-centric representation into the planning of attentional glimpses.


title: BuildingNet: Learning to Label 3D Buildings

abstract: We introduce BuildingNet: (a) a large-scale dataset of 3D building models whose exteriors are consistently labeled, (b) a graph neural network that labels building meshes by analyzing spatial and structural relations of their geometric primitives. To create our dataset, we used crowdsourcing combined with expert guidance, resulting in 513K annotated mesh primitives, grouped into 292K semantic part components across 2K building models. The dataset covers several building categories, such as houses, churches, skyscrapers, town halls, libraries, and castles. We include a benchmark for evaluating mesh and point cloud labeling. Buildings have more challenging structural complexity compared to objects in existing benchmarks (e.g., ShapeNet, PartNet), thus, we hope that our dataset can nurture the development of algorithms that are able to cope with such large-scale geometric data for both vision and graphics tasks e.g., 3D semantic segmentation, part-based generative models, correspondences, texturing, and analysis of point cloud data acquired from real-world buildings. Finally, we show that our mesh-based graph neural network significantly improves performance over several baselines for labeling 3D meshes.


title: Optimal Stochastic Evasive Maneuvers Using the Schrodinger's Equation

abstract: In this paper, preys with stochastic evasion policies are considered. The stochasticity adds unpredictable changes to the prey's path for avoiding predator's attacks. The prey's cost function is composed of two terms balancing the unpredictability factor (by using stochasticity to make the task of forecasting its future positions by the predator difficult) and energy consumption (the least amount of energy required for performing a maneuver). The optimal probability density functions of the actions of the prey for trading-off unpredictability and energy consumption is shown to be characterized by the stationary Schrodinger's equation.

categories: cs.RO cs.SY eess.SY math.OC physics.data-an quant-ph


title: Provably Stable Full-Spectrum Dispersion Relation Preserving Schemes

abstract: The dispersion error is often the dominant error for computed solutions of wave propagation problems with high-frequency components. In this paper, we define and give explicit examples of $\alpha$-dispersion-relation-preserving schemes. These are dual-pair finite-difference schemes for systems of hyperbolic partial differential equations which preserve the dispersion-relation of the continuous problem uniformly to an $\alpha \%$-error tolerance. We give a general framework to design provably stable finite difference operators that preserve the dispersion relation for hyperbolic systems such as the elastic wave equation. The operators we derive here can resolve the highest frequency ($\pi$-mode) present on any equidistant grid at a tolerance of $5\%$ error. This significantly improves on the current standard that have a tolerance of $100 \%$ error.


title: Antiferromagnetic spin fluctuations and superconductivity in NbRh$_2$B$_2$ and TaRh$_2$B$_2$ with a chiral crystal structure

abstract: We report the $^{11}$B nuclear magnetic resonance (NMR) measurements on non-centrosymmetric superconductors NbRh$_2$B$_2$ (superconducting transition temperature $T_c$ = 7.8 K) and TaRh$_2$B$_2$ ($T_c$ = 5.9 K) with a chiral crystal structure. The nuclear spin-lattice relaxation rate $1/T_1$ shows no coherence peak below $T_{\rm c}$, which suggests unconventional nature of the superconductivity. In the normal state, $1/T_1T$ increases with decreasing temperature $T$ at low temperatures below $T$ = 200 K for TaRh$_2$B$_2$ and $T$ = 15 K for NbRh$_2$B$_2$, while the Knight shift remains constant. These results suggest the presence of antiferromagnetic spin fluctuations in both compounds. The stronger spin fluctuations in TaRh$_2$B$_2$ compared to NbRh$_2$B$_2$ is discussed in the context of spin-orbit coupling.


title: Heterogeneous Stream-reservoir Graph Networks with Data Assimilation

abstract: Accurate prediction of water temperature in streams is critical for monitoring and understanding biogeochemical and ecological processes in streams. Stream temperature is affected by weather patterns (such as solar radiation) and water flowing through the stream network. Additionally, stream temperature can be substantially affected by water releases from man-made reservoirs to downstream segments. In this paper, we propose a heterogeneous recurrent graph model to represent these interacting processes that underlie stream-reservoir networks and improve the prediction of water temperature in all river segments within a network. Because reservoir release data may be unavailable for certain reservoirs, we further develop a data assimilation mechanism to adjust the deep learning model states to correct for the prediction bias caused by reservoir releases. A well-trained temporal modeling component is needed in order to use adjusted states to improve future predictions. Hence, we also introduce a simulation-based pre-training strategy to enhance the model training. Our evaluation for the Delaware River Basin has demonstrated the superiority of our proposed method over multiple existing methods. We have extensively studied the effect of the data assimilation mechanism under different scenarios. Moreover, we show that the proposed method using the pre-training strategy can still produce good predictions even with limited training data.


title: Performance Evaluation of Deep Transfer Learning on Multiclass Identification of Common Weed Species in Cotton Production Systems

abstract: Precision weed management offers a promising solution for sustainable cropping systems through the use of chemical-reduced/non-chemical robotic weeding techniques, which apply suitable control tactics to individual weeds. Therefore, accurate identification of weed species plays a crucial role in such systems to enable precise, individualized weed treatment. This paper makes a first comprehensive evaluation of deep transfer learning (DTL) for identifying common weeds specific to cotton production systems in southern United States. A new dataset for weed identification was created, consisting of 5187 color images of 15 weed classes collected under natural lighting conditions and at varied weed growth stages, in cotton fields during the 2020 and 2021 field seasons. We evaluated 27 state-of-the-art deep learning models through transfer learning and established an extensive benchmark for the considered weed identification task. DTL achieved high classification accuracy of F1 scores exceeding 95%, requiring reasonably short training time (less than 2.5 hours) across models. ResNet101 achieved the best F1-score of 99.1% whereas 14 out of the 27 models achieved F1 scores exceeding 98.0%. However, the performance on minority weed classes with few training samples was less satisfactory for models trained with a conventional, unweighted cross entropy loss function. To address this issue, a weighted cross entropy loss function was adopted, which achieved substantially improved accuracies for minority weed classes. Furthermore, a deep learning-based cosine similarity metrics was employed to analyze the similarity among weed classes, assisting in the interpretation of classifications. Both the codes for model benchmarking and the weed dataset are made publicly available, which expect to be be a valuable resource for future research in weed identification and beyond.


title: Equivalence Analysis between Counterfactual Regret Minimization and Online Mirror Descent

abstract: Follow-the-Regularized-Lead (FTRL) and Online Mirror Descent (OMD) are regret minimization algorithms for Online Convex Optimization (OCO), they are mathematically elegant but less practical in solving Extensive-Form Games (EFGs). Counterfactual Regret Minimization (CFR) is a technique for approximating Nash equilibria in EFGs. CFR and its variants have a fast convergence rate in practice, but their theoretical results are not satisfactory. In recent years, researchers have been trying to link CFRs with OCO algorithms, which may provide new theoretical results and inspire new algorithms. However, existing analysis is restricted to local decision points. In this paper, we show that CFRs with Regret Matching and Regret Matching+ are equivalent to special cases of FTRL and OMD, respectively. According to these equivalences, a new FTRL and a new OMD algorithm, which can be considered as extensions of vanilla CFR and CFR+, are derived. The experimental results show that the two variants converge faster than conventional FTRL and OMD, even faster than vanilla CFR and CFR+ in some EFGs.


title: Uplink Performance of Cell-Free Massive MIMO with Multi-Antenna Users Over Jointly-Correlated Rayleigh Fading Channels

abstract: In this paper, we investigate a cell-free massive MIMO system with both access points (APs) and user equipments (UEs) equipped with multiple antennas over jointly-correlated Rayleigh fading channels. We study four uplink implementations, from fully centralized processing to fully distributed processing, and derive their achievable spectral efficiency (SE) expressions with minimum mean-squared error successive interference cancellation (MMSE-SIC) detectors and arbitrary combining schemes. Furthermore, the global and local MMSE combining schemes are derived based on full and local channel state information (CSI) obtained under pilot contamination, which can maximize the achievable SE for the fully centralized and distributed implementation, respectively. We study a two-layer decoding implementation with an arbitrary combining scheme in the first layer and optimal large-scale fading decoding (LSFD) in the second layer. Besides, we compute novel closed-form SE expressions for the two-layer decoding implementation with maximum ratio (MR) combining. In the numerical results, we compare the SE performance for different implementation levels, combining schemes, and channel models. It is important to note that increasing the number of antennas per UE may degrade the SE performance.


title: Reshaped Weyl fermionic dispersions driven by Coulomb interactions in MoTe2

abstract: We report the direct evidence of impacts of the Coulomb interaction in a prototypical Weyl semimetal, MoTe2, that alter its bare bands in a wide range of energy and momentum. Our quasiparticle interference patterns measured using scanning tunneling microscopy are shown to match the joint density of states of quasiparticle energy bands including momentum-dependent self-energy corrections, while electronic energy bands based on the other simpler local approximations of the Coulomb interaction fail to explain neither the correct number of quasiparticle pockets nor shape of their dispersions observed in our spectrum. With this, we predict a transition between type-I and type-II Weyl fermions with doping and resolve its disparate quantum oscillation experiments, thus highlighting the critical roles of Coulomb interactions in layered Weyl semimetals.


title: Label-Occurrence-Balanced Mixup for Long-tailed Recognition

abstract: Mixup is a popular data augmentation method, with many variants subsequently proposed. These methods mainly create new examples via convex combination of random data pairs and their corresponding one-hot labels. However, most of them adhere to a random sampling and mixing strategy, without considering the frequency of label occurrence in the mixing process. When applying mixup to long-tailed data, a label suppression issue arises, where the frequency of label occurrence for each class is imbalanced and most of the new examples will be completely or partially assigned with head labels. The suppression effect may further aggravate the problem of data imbalance and lead to a poor performance on tail classes. To address this problem, we propose Label-Occurrence-Balanced Mixup to augment data while keeping the label occurrence for each class statistically balanced. In a word, we employ two independent class-balanced samplers to select data pairs and mix them to generate new data. We test our method on several long-tailed vision and sound recognition benchmarks. Experimental results show that our method significantly promotes the adaptability of mixup method to imbalanced data and achieves superior performance compared with state-of-the-art long-tailed learning methods.


title: Cross-feeding shapes both competition and cooperation in microbial ecosystems

abstract: Recent work suggests that cross-feeding -- the secretion and consumption of metabolic biproducts by microbes -- is essential for understanding microbial ecology. Yet how cross-feeding and competition combine to give rise to ecosystem-level properties remains poorly understood. To address this question, we analytically analyze the Microbial Consumer Resource Model (MiCRM), a prominent ecological model commonly used to study microbial communities. Our mean-field solution exploits the fact that unlike replicas, the cavity method does not require the existence of a Lyapunov function. We use our solution to derive new species-packing bounds for diverse ecosystems in the presence of cross-feeding, as well as simple expressions for species richness and the abundance of secreted resources as a function of cross-feeding (metabolic leakage) and competition. Our results show how a complex interplay between competition for resources and cooperation resulting from metabolic exchange combine to shape the properties of microbial ecosystems.

categories: q-bio.PE cond-mat.dis-nn cond-mat.soft cond-mat.stat-mech


title: Revisit Dictionary Learning for Video Compressive Sensing under the Plug-and-Play Framework

abstract: Aiming at high-dimensional (HD) data acquisition and analysis, snapshot compressive imaging (SCI) obtains the 2D compressed measurement of HD data with optical imaging systems and reconstructs HD data using compressive sensing algorithms. While the Plug-and-Play (PnP) framework offers an emerging solution to SCI reconstruction, its intrinsic denoising process is still a challenging problem. Unfortunately, existing denoisers in the PnP framework either suffer limited performance or require extensive training data. In this paper, we propose an efficient and effective shallow-learning-based algorithm for video SCI reconstruction. Revisiting dictionary learning methods, we empower the PnP framework with a new denoiser, the kernel singular value decomposition (KSVD). Benefited from the advent of KSVD, our algorithm retains a good trade-off among quality, speed, and training difficulty. On a variety of datasets, both quantitative and qualitative evaluations of our simulation results demonstrate the effectiveness of our proposed method. In comparison to a typical baseline using total variation, our method achieves around $2$ dB improvement in PSNR and 0.2 in SSIM. We expect that our proposed PnP-KSVD algorithm can serve as a new baseline for video SCI reconstruction.


title: Koopman Operator Based Modeling and Control of Rigid Body Motion Represented by Dual Quaternions

abstract: In this paper, we systematically derive a finite set of Koopman based observables to construct a lifted linear state space model that describes the rigid body dynamics based on the dual quaternion representation. In general, the Koopman operator is a linear infinite dimensional operator, which means that the derived linear state space model of the rigid body dynamics will be infinite-dimensional, which is not suitable for modeling and control design purposes. Recently, finite approximations of the operator computed by means of methods like the Extended Dynamic Mode Decomposition (EDMD) have shown promising results for different classes of problems. However, without using an appropriate set of observables in the EDMD approach, there can be no guarantees that the computed approximation of the nonlinear dynamics is sufficiently accurate. The major challenge in using the Koopman operator for constructing a linear state space model is the choice of observables. State-of-the-art methods in the field compute the approximations of the observables by using neural networks, standard radial basis functions (RBFs), polynomials or heuristic approximations of these functions. However, these observables might not providea sufficiently accurate approximation or representation of the dynamics. In contrast, we first show the pointwise convergence of the derived observable functions to zero, thereby allowing us to choose a finite set of these observables. Next, we use the derived observables in EDMD to compute the lifted linear state and input matrices for the rigid body dynamics. Finally, we show that an LQR type (linear) controller, which is designed based on the truncated linear state space model, can steer the rigid body to a desired state while its performance is commensurate with that of a nonlinear controller. The efficacy of our approach is demonstrated through numerical simulations.


title: Deep Learning for Uplink Spectral Efficiency in Cell-Free Massive MIMO Systems

abstract: In this paper, we introduce a Deep Neural Network (DNN) to maximize the Proportional Fairness (PF) of the Spectral Efficiency (SE) of uplinks in Cell-Free (CF) massive Multiple-Input Multiple-Output (MIMO) systems. The problem of maximizing the PF of the SE is a non-convex optimization problem in the design variables. We will develop a DNN which takes pilot sequences and large-scale fading coefficients of the users as inputs and produces the outputs of optimal transmit powers. By consisting of densely residual connections between layers, the proposed DNN can efficiently exploit the hierarchical features of the input and motivates the feed-forward nature of DNN architecture. Experimental results showed that, compared to the conventional iterative optimization algorithm, the proposed DNN has excessively lower computational complexity with the trade-off of approximately only 1% loss in the sum rate and the fairness performance. This demonstrated that our proposed DNN is reasonably suitable for real-time signal processing in CF massive MIMO systems.


title: Non-perturbative Quantum Propagators in Bounded Spaces

abstract: We outline a new approach to calculating the quantum mechanical propagator in the presence of geometrically non-trivial Dirichlet boundary conditions based upon a generalisation of an integral transform of the propagator studied in previous work (the so-called ``hit function''), and a convergent sequence of Pad\'e approximants. In this paper the generalised hit function is defined as a many-point propagator and we describe its relation to the sum over trajectories in the Feynman path integral. We then show how it can be used to calculate the Feynman propagator. We calculate analytically all such hit functions in $D=1$ and $D=3$ dimensions, giving recursion relations between them in the same or different dimensions and apply the results to the simple cases of propagation in the presence of perfectly conducting planar and spherical plates. We use these results to conjecture a general analytical formula for the propagator when Dirichlet boundary conditions are present in a given geometry, also explaining how it can be extended for application for more general, non-localised potentials. Our work has resonance with previous results obtained by Grosche in the study of path integrals in the presence of delta potentials. We indicate the eventual application in a relativistic context to determining Casimir energies using this technique.


title: Experimental one-step deterministic entanglement purification

abstract: Entanglement purification is to distill high-quality entangled states from low-quality entangled states. It is a key step in quantum repeaters, determines the efficiency and communication rates of quantum communication protocols, and is hence of central importance in long-distance communications and quantum networks. In this work, we report the first experimental demonstration of deterministic entanglement purification using polarization and spatial mode hyperentanglement. After purification, the fidelity of polarization entanglement arises from $0.268\pm0.002$ to $0.989\pm0.001$. Assisted with robust spatial mode entanglement, the total purification efficiency can be estimated as $10^{9}$ times that of the entanglement purification protocols using two copies of entangled states when one uses the spontaneous parametric down-conversion sources. Our work may have the potential to be implemented as a part of full repeater protocols.


title: A Deep Generative Model for Reordering Adjacency Matrices

abstract: Depending on the node ordering, an adjacency matrix can highlight distinct characteristics of a graph. Deriving a "proper" node ordering is thus a critical step in visualizing a graph as an adjacency matrix. Users often try multiple matrix reorderings using different methods until they find one that meets the analysis goal. However, this trial-and-error approach is laborious and disorganized, which is especially challenging for novices. This paper presents a technique that enables users to effortlessly find a matrix reordering they want. Specifically, we design a generative model that learns a latent space of diverse matrix reorderings of the given graph. We also construct an intuitive user interface from the learned latent space by creating a map of various matrix reorderings. We demonstrate our approach through quantitative and qualitative evaluations of the generated reorderings and learned latent spaces. The results show that our model is capable of learning a latent space of diverse matrix reorderings. Most existing research in this area generally focused on developing algorithms that can compute "better" matrix reorderings for particular circumstances. This paper introduces a fundamentally new approach to matrix visualization of a graph, where a machine learning model learns to generate diverse matrix reorderings of a graph.


title: Kernel Learning For Sound Field Estimation With L1 and L2 Regularizations

abstract: A method to estimate an acoustic field from discrete microphone measurements is proposed. A kernel-interpolation-based method using the kernel function formulated for sound field interpolation has been used in various applications. The kernel function with directional weighting makes it possible to incorporate prior information on source directions to improve estimation accuracy. However, in prior studies, parameters for directional weighting have been empirically determined. We propose a method to optimize these parameters using observation values, which is particularly useful when prior information on source directions is uncertain. The proposed algorithm is based on discretization of the parameters and representation of the kernel function as a weighted sum of sub-kernels. Two types of regularization for the weights, $L_1$ and $L_2$, are investigated. Experimental results indicate that the proposed method achieves higher estimation accuracy than the method without kernel learning.


title: Permutation Designs and Sequencing Highly Transitive Group Actions

abstract: We consider an experimental design problem for permutations: given a fixed set $X$, and an integer $t$, construct a list $L$ of permutations of $X$ such that every ordered $t$-tuple of distinct elements of $X$ occurs as a consecutive subsequence of exactly one permutation in $L$. In this paper we focus on solutions based on sharply transitive group actions, in effect generalizing Gordon's notion of group sequencing. We give an explicit construction when $|X|$ is prime for the case $t=3$, and analyze a branching algorithm for the general case which produces, for example, a rare design with $t=6$ based on the Mathieu group $M_{12}$, and suggests that every sharply transitive group action leads to a solution, apart from an explicit list of counterexamples. We state a number of conjectures and indicate directions for future work.


title: Value-Function-based Sequential Minimization for Bi-level Optimization

abstract: Gradient-based Bi-Level Optimization (BLO) methods have been widely applied to handle modern learning tasks. However, most existing strategies are theoretically designed based on restrictive assumptions (e.g., convexity of the lower-level sub-problem), and computationally not applicable for high-dimensional tasks. Moreover, there are almost no gradient-based methods able to solve BLO in those challenging scenarios, such as BLO with functional constraints and pessimistic BLO. In this work, by reformulating BLO into approximated single-level problems, we provide a new algorithm, named Bi-level Value-Function-based Sequential Minimization (BVFSM), to address the above issues. Specifically, BVFSM constructs a series of value-function-based approximations, and thus avoids repeated calculations of recurrent gradient and Hessian inverse required by existing approaches, time-consuming especially for high-dimensional tasks. We also extend BVFSM to address BLO with additional functional constraints. More importantly, BVFSM can be used for the challenging pessimistic BLO, which has never been properly solved before. In theory, we prove the asymptotic convergence of BVFSM on these types of BLO, in which the restrictive lower-level convexity assumption is discarded. To our best knowledge, this is the first gradient-based algorithm that can solve different kinds of BLO (e.g., optimistic, pessimistic, and with constraints) with solid convergence guarantees. Extensive experiments verify the theoretical investigations and demonstrate our superiority on various real-world applications.


title: Universal uncertainty estimation for nuclear detector signals with neural networks and ensemble learning

abstract: Characterizing uncertainty is a common issue in nuclear measurement and has important implications for reliable physical discovery. Traditional methods are either insufficient to cope with the heterogeneous nature of uncertainty or inadequate to perform well with unknown mathematical models. In this paper, we propose using multi-layer convolutional neural networks for empirical uncertainty estimation and feature extraction of nuclear pulse signals. This method is based on deep learning, a recent development of machine learning techniques, which learns the desired mapping function from training data and generalizes to unseen test data. Furthermore, ensemble learning is utilized to estimate the uncertainty originating from trainable parameters of the network and to improve the robustness of the whole model. To evaluate the performance of the proposed method, simulation studies, in comparison with curve fitting, investigate extensive conditions and show its universal applicability. Finally, a case study is made using data from a NICA-MPD electromagnetic calorimeter module exposed to a test beam at DESY, Germany. The uncertainty estimation method successfully detected out-of-distribution samples and also achieved good accuracy in time and energy measurements.


title: Numerical investigation of the logarithmic Schr\"odinger model of quantum decoherence

abstract: A logarithmic Schr\"odinger equation with time-dependent coupling to the non-linearity is presented as a model of collisional decoherence of the wavefunction of a quantum particle in position-space. The particular mathematical form of the logarithmic Schr\"odinger equation has been shown to follow from conditional wave theory, but the validity of the logarithmic Schr\"odinger equation has not yet been investigated numerically for general initial conditions. Using an operator-splitting approach, we solve the non-linear equation of motion for the wavefunction numerically and compare it it to the solution of the standard Joos-Zeh master equation for the density matrix. We find good agreement for the time-dependent behaviour of the ensemble widths between the two approaches, but note curious `zero-pinning' behaviour of the logarithmic Schr\"odinger equation, whereby the zeros of the wavefunction are not erased by continued propagation. By examining the derivation of the logarithmic Schr\"odinger equation from conditional wave theory, we indicate possible avenues of resolution to this zero-pinning problem.


title: A Review on Part-of-Speech Technologies

abstract: Developing an automatic part-of-speech (POS) tagging for any new language is considered a necessary step for further computational linguistics methodology beyond tagging, like chunking and parsing, to be fully applied to the language. Many POS disambiguation technologies have been developed for this type of research and there are factors that influence the choice of choosing one. This could be either corpus-based or non-corpus-based. In this paper, we present a review of POS tagging technologies.


title: Floor, ceiling, slopes, and $K$-theory

abstract: We calculate $\mathrm K_*(k[x]/x^e;\mathbf Z_p)$ by evaluating the syntomic cohomology $\mathbf Z_p(i)(k[x]/x^e)$ introduced by Bhatt-Morrow-Scholze and Bhatt-Scholze. This recovers calculations of Hesselholt-Madsen and Speirs, and generalizes an example of Mathew treating the case $e=2$ and $p>2$. Our main innovation is systematic use of the floor and ceiling functions, which clarifies matters substantially even for $e=2$. We furthermore observe a persistent phenomenon of slopes. As an application, we answer some questions of Hesselholt.


title: Analysis on Tollmien-Schlichting wave in the Prandtl-Hartmann Regime

abstract: In this paper, we study the instability induced by the Tollmien-Schlichting wave governed by the MHD system in the Prandtl-Hartmann regime. The interaction of the inviscid mode and viscous mode that leads to the instability is analyzed by the introduction of a new decomposition of the Orr-Sommerfeld operator on the velocity and magnetic fields. The critical Gevrey index for the instability is justified by constructing the growing mode in the essential frequency and it is shown to be the same as the incompressible Navier-Stokes equations in the Prandtl regime. This result justifies rigorously the physical understanding that the transverse magnetic field to the boundary in the Prandtl-Hartmann regime has no extra stabilizing effect on the Tollmien-Schlichting wave.


title: An Efficient Deep Learning Model for Automatic Modulation Recognition Based on Parameter Estimation and Transformation

abstract: Automatic modulation recognition (AMR) is a promising technology for intelligent communication receivers to detect signal modulation schemes. Recently, the emerging deep learning (DL) research has facilitated high-performance DL-AMR approaches. However, most DL-AMR models only focus on recognition accuracy, leading to huge model sizes and high computational complexity, while some lightweight and low-complexity models struggle to meet the accuracy requirements. This letter proposes an efficient DL-AMR model based on phase parameter estimation and transformation, with convolutional neural network (CNN) and gated recurrent unit (GRU) as the feature extraction layers, which can achieve high recognition accuracy equivalent to the existing state-of-the-art models but reduces more than a third of the volume of their parameters. Meanwhile, our model is more competitive in training time and test time than the benchmark models with similar recognition accuracy. Moreover, we further propose to compress our model by pruning, which maintains the recognition accuracy higher than 90% while has less than 1/8 of the number of parameters comparing with state-of-the-art models.


title: Deterministic Entanglement Distribution on Series-Parallel Quantum Networks

abstract: The performance of distributing entanglement between two distant nodes in a large-scale quantum network (QN) of partially entangled bipartite pure states is generally benchmarked against the classical entanglement percolation (CEP) scheme. Improvements beyond CEP were only achieved by nonscalable strategies for restricted QN topologies. This paper explores and amplifies a new and more effective mapping of a QN, referred to as concurrence percolation theory (ConPT), that suggests using deterministic rather than probabilistic protocols for scalably improving on CEP across arbitrary QN topologies. More precisely, we implement ConPT via a deterministic entanglement transmission (DET) scheme that is fully analogous to resistor network analysis, with the corresponding series and parallel rules represented by deterministic entanglement swapping and concentration protocols, respectively. The main contribution of this paper is to establish a powerful mathematical framework, which is applicable to arbitrary d-dimensional information carriers (qudits), that provides different natural optimality metrics in terms of generalized k-concurrences (a family of fundamental entanglement measures) for different QN topology. In particular, we conclude that the introduced DET scheme (a) is optimal over the well-known nested repeater protocol for distilling entanglement from partially entangled qubits and (b) leads to higher success probabilities of obtaining a maximally entangled state than using CEP. The implementation of the DET scheme is experimentally feasible as tested on IBM's quantum computation platform.


title: Single-particle decomposition of nuclear surface diffuseness

abstract: Nuclear surface diffuseness reflects spectroscopic information near the Fermi level. I propose a way to decompose the surface diffuseness into single-particle (s.p.) contributions in a quantitative way. Systematic behavior of the surface diffuseness of neutron-rich even-even O, Ca, Ni, Sn, and Pb isotopes is analyzed with a phenomenological mean-field approach. The role of the s.p. wave functions near the Fermi level is explored: The nodeless s.p. orbits form a sharp nuclear surface, while the nodal s.p. orbits contribute to diffusing the nuclear surface.


title: Understanding the Safety Requirements for Learning-based Power Systems Operations

abstract: Recent advancements in machine learning and reinforcement learning have brought increased attention to their applicability in a range of decision-making tasks in the operations of power systems, such as short-term emergency control, Volt/VAr control, long-term residential demand response and battery energy management. Despite the promises of providing strong representation of complex system dynamics and fast, efficient learned operation strategies, the safety requirements of such learning paradigms are less discussed. This paper explores the design requirements on both data and model side of such learning algorithms by exploiting the impacts of adversarial attacks on safety critical system operations. Case studies performed on both voltage regulation and topology control tasks demonstrated the potential vulnerabilities of the standard reinforcement learning algorithms, and possible measures of machine learning robustness and security are discussed for power systems operation tasks.


title: Advances in Multi-turn Dialogue Comprehension: A Survey

abstract: Training machines to understand natural language and interact with humans is an elusive and essential task of artificial intelligence. A diversity of dialogue systems has been designed with the rapid development of deep learning techniques, especially the recent pre-trained language models (PrLMs). Among these studies, the fundamental yet challenging type of task is dialogue comprehension whose role is to teach the machines to read and comprehend the dialogue context before responding. In this paper, we review the previous methods from the technical perspective of dialogue modeling for the dialogue comprehension task. We summarize the characteristics and challenges of dialogue comprehension in contrast to plain-text reading comprehension. Then, we discuss three typical patterns of dialogue modeling. In addition, we categorize dialogue-related pre-training techniques which are employed to enhance PrLMs in dialogue scenarios. Finally, we highlight the technical advances in recent years and point out the lessons from the empirical analysis and the prospects towards a new frontier of researches.


title: Constructing Families of Cospectral Regular Graphs

abstract: A set of graphs are called cospectral if their adjacency matrices have the same characteristic polynomial. In this paper we introduce a simple method for constructing infinite families of cospectral regular graphs. The construction is valid for special cases of a property introduced by Schwenk. For the case of cubic (3-regular) graphs, computational results are given which show that the construction generates a large proportion of the cubic graphs, which are cospectral with another cubic graph.


title: COVID-Datathon: Biomarker identification for COVID-19 severity based on BALF scRNA-seq data

abstract: The severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) emergence began in late 2019 and has since spread rapidly worldwide. The characteristics of respiratory immune response to this emerging virus is not clear. Recently, Single-cell RNA sequencing (scRNA-seq) transcriptome profiling of Bronchoalveolar lavage fluid (BALF) cells has been done to elucidate the potential mechanisms underlying in COVID-19. With the aim of better utilizing this atlas of BALF cells in response to the virus, here we propose a bioinformatics pipeline to identify candidate biomarkers of COVID-19 severity, which may help characterize BALF cells to have better mechanistic understanding of SARS-CoV-2 infection. The proposed pipeline is implemented in R and is available at https://github.com/namini94/scBALF_Hackathon.


title: Binary Programming Formulations for the Upper Domination Problem

abstract: We consider Upper Domination, the problem of finding the minimal dominating set of maximum cardinality. Very few exact algorithms have been described for solving Upper Domination. In particular, no binary programming formulations for Upper Domination have been described in literature, although such formulations have proved quite successful for other kinds of domination problems. We introduce two such binary programming formulations, and show that both can be improved with the addition of extra constraints which reduce the number of feasible solutions. We compare the performance of the formulations on various kinds of graphs, and demonstrate that (a) the additional constraints improve the performance of both formulations, and (b) the first formulation outperforms the second in most cases, although the second performs better for very sparse graphs. Also included is a short proof that the upper domination number of any generalized Petersen graph P(n,k) is equal to n.


title: Stereo Hybrid Event-Frame (SHEF) Cameras for 3D Perception

abstract: Stereo camera systems play an important role in robotics applications to perceive the 3D world. However, conventional cameras have drawbacks such as low dynamic range, motion blur and latency due to the underlying frame-based mechanism. Event cameras address these limitations as they report the brightness changes of each pixel independently with a fine temporal resolution, but they are unable to acquire absolute intensity information directly. Although integrated hybrid event-frame sensors (eg., DAVIS) are available, the quality of data is compromised by coupling at the pixel level in the circuit fabrication of such cameras. This paper proposes a stereo hybrid event-frame (SHEF) camera system that offers a sensor modality with separate high-quality pure event and pure frame cameras, overcoming the limitations of each separate sensor and allowing for stereo depth estimation. We provide a SHEF dataset targeted at evaluating disparity estimation algorithms and introduce a stereo disparity estimation algorithm that uses edge information extracted from the event stream correlated with the edge detected in the frame data. Our disparity estimation outperforms the state-of-the-art stereo matching algorithm on the SHEF dataset.


title: The Schwarz Lemma: An Odyssey

abstract: Expository notes on the Schwarz lemma born out of some lectures given on the subject.


title: Interacting Higher-Spin Gauge Models in BRST-antifield Formalism

abstract: Interacting higher-spin gauge models including fermions are derived in the BRST-antifield formalism. We introduce massless totally-symmetric rank-$n$ tensor-spinors, which is Dirac spinors in $D$-dimensional spacetime, as well as massless bosonic totally-symmetric tensors. By applying the BRST deformation scheme, the free higher-spin gauge theory is deformed such that the deformed action $S$ would satisfy the master equation $(S,S)=0$. We obtain interactions of two fermions and one boson, and those of a fermion and a boson in turn. They contain all orders in the deformation parameter and satisfy the master equation exactly. Employing the BRST deformation scheme built on AdS spaces, we derive interacting higher-spin gauge models including fermions on AdS spaces as well. We also consider the case that infinite series contained in our models are convergent.


title: Graphical Assistant Grouped Network Autoregression Model: a Bayesian Nonparametric Recourse

abstract: Vector autoregression model is ubiquitous in classical time series data analysis. With the rapid advance of social network sites, time series data over latent graph is becoming increasingly popular. In this paper, we develop a novel Bayesian grouped network autoregression model to simultaneously estimate group information (number of groups and group configurations) and group-wise parameters. Specifically, a graphically assisted Chinese restaurant process is incorporated under framework of the network autoregression model to improve the statistical inference performance. An efficient Markov chain Monte Carlo sampling algorithm is used to sample from the posterior distribution. Extensive studies are conducted to evaluate the finite sample performance of our proposed methodology. Additionally, we analyze two real datasets as illustrations of the effectiveness of our approach.


title: The Dynamics of Deforming Manifold: A Mathematical Model

abstract: In order to meet the requirements of practical applications, a model of deforming manifold in the embedded space is proposed. The deforming vector and deforming field are presented to precisely describe the deforming process, which have clear physical meanings. The proposed model is a modification of the general differential dynamic model, with constraints of spatial and temporal continuity on the deforming field. The deformation integral and derivative are presented as compact expressions of manifold deforming process. Moreover, a specific autonomous deforming field with flattening effect is defined, which provides a novel geometric viewpoint on data dimension reduction. The effectiveness of this autonomous deforming field is proved by numerical computation simulations, which indicate the promising potential of the proposed model in practical dimension reduction tasks.


title: On the energy landscape of symmetric quantum signal processing

abstract: Symmetric quantum signal processing provides a parameterized representation of a real polynomial, which can be translated into an efficient quantum circuit for performing a wide range of computational tasks on quantum computers. For a given polynomial $f$, the parameters (called phase factors) can be obtained by solving an optimization problem. However, the cost function is non-convex, and has a very complex energy landscape with numerous global and local minima. It is therefore surprising that the solution can be robustly obtained in practice, starting from a fixed initial guess $\Phi^0$ that contains no information of the input polynomial. To investigate this phenomenon, we first explicitly characterize all the global minima of the cost function. We then prove that one particular global minimum (called the maximal solution) belongs to a neighborhood of $\Phi^0$, on which the cost function is strongly convex under the condition ${\left\lVert f\right\rVert}_{\infty}=\mathcal{O}(d^{-1})$ with $d=\mathrm{deg}(f)$. Our result provides a partial explanation of the aforementioned success of optimization algorithms.


title: Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scans

abstract: This paper introduces a pipeline to parametrically sample and render multi-task vision datasets from comprehensive 3D scans from the real world. Changing the sampling parameters allows one to "steer" the generated datasets to emphasize specific information. In addition to enabling interesting lines of research, we show the tooling and generated data suffice to train robust vision models. Common architectures trained on a generated starter dataset reached state-of-the-art performance on multiple common vision tasks and benchmarks, despite having seen no benchmark or non-pipeline data. The depth estimation network outperforms MiDaS and the surface normal estimation network is the first to achieve human-level performance for in-the-wild surface normal estimation -- at least according to one metric on the OASIS benchmark. The Dockerized pipeline with CLI, the (mostly python) code, PyTorch dataloaders for the generated data, the generated starter dataset, download scripts and other utilities are available through our project website, https://omnidata.vision.


title: The Skellam Mechanism for Differentially Private Federated Learning

abstract: We introduce the multi-dimensional Skellam mechanism, a discrete differential privacy mechanism based on the difference of two independent Poisson random variables. To quantify its privacy guarantees, we analyze the privacy loss distribution via a numerical evaluation and provide a sharp bound on the R\'enyi divergence between two shifted Skellam distributions. While useful in both centralized and distributed privacy applications, we investigate how it can be applied in the context of federated learning with secure aggregation under communication constraints. Our theoretical findings and extensive experimental evaluations demonstrate that the Skellam mechanism provides the same privacy-accuracy trade-offs as the continuous Gaussian mechanism, even when the precision is low. More importantly, Skellam is closed under summation and sampling from it only requires sampling from a Poisson distribution -- an efficient routine that ships with all machine learning and data analysis software packages. These features, along with its discrete nature and competitive privacy-accuracy trade-offs, make it an attractive practical alternative to the newly introduced discrete Gaussian mechanism.


title: A Survey of Learning Criteria Going Beyond the Usual Risk

abstract: Virtually all machine learning tasks are characterized using some form of loss function, and "good performance" is typically stated in terms of a sufficiently small average loss, taken over the random draw of test data. While optimizing for performance on average is intuitive, convenient to analyze in theory, and easy to implement in practice, such a choice brings about trade-offs. In this work, we survey and introduce a wide variety of non-traditional criteria used to design and evaluate machine learning algorithms, place the classical paradigm within the proper historical context, and propose a view of learning problems which emphasizes the question of "what makes for a desirable loss distribution?" in place of tacit use of the expected loss.


title: IoT Equipped Intelligent Distributed Framework for Smart Healthcare Systems

abstract: The fundamental aim of the healthcare sector is to incorporate different technologies to observe and keep a track of the various clinical parameters of the patients in day to day life. Distant patient observation applications are becoming popular as economical healthcare services are facilitated by these apps. The process of data management gathered through these applications also require due attention. Although cloud facilitated healthcare applications cater a variety of solutions to store patients record and deliver the required data as per need of all the stakeholders but are affected by security issues, more response time and affecting the continues availability of the system. To overcome these challenges, an intelligent IoT based distributed framework to deploy remote healthcare services is proposed in this chapter. In the proposed model, various entities of the system are interconnected using IoT and Distributed Database Management Systems is used to cater secure and fast data availability to the patients and health care workers. The concept of Blockchain is used to ensure the security of the patient medical records. The proposed model will comprise of intelligent analysis of the clinical records fetched from Distributed Database Management Systems secured with Blockchain. Proposed model is tested with true clinical data and results are discussed in detail.


title: Nonparametric Functional Analysis of Generalized Linear Models Under Nonlinear Constraints

abstract: This article introduces a novel nonparametric methodology for Generalized Linear Models which combines the strengths of the binary regression and latent variable formulations for categorical data, while overcoming their disadvantages. Requiring minimal assumptions, it extends recently published parametric versions of the methodology and generalizes it. If the underlying data generating process is asymmetric, it gives uniformly better prediction and inference performance over the parametric formulation. Furthermore, it introduces a new classification statistic utilizing which I show that overall, it has better model fit, inference and classification performance than the parametric version, and the difference in performance is statistically significant especially if the data generating process is asymmetric. In addition, the methodology can be used to perform model diagnostics for any model specification. This is a highly useful result, and it extends existing work for categorical model diagnostics broadly across the sciences. The mathematical results also highlight important new findings regarding the interplay of statistical significance and scientific significance. Finally, the methodology is applied to various real-world datasets to show that it may outperform widely used existing models, including Random Forests and Deep Neural Networks with very few iterations.

categories: stat.ML cs.LG math.FA math.PR math.ST stat.ME stat.TH


title: Maximal Unramified Tori in Symplectic Groups

abstract: For a reductive group over a $p$-adic field, DeBacker gives a paramaterization of the conjugacy classes of maximal unramified tori using Bruhat-Tits theory. On the other hand, for unramified classical groups, Waldspurger gives a parameterization in terms of triples of partitions by constructing a regular semisimple element whose structure is governed by the parts of the partitions. In this paper, we compare these two parameterizations in the case of the symplectic group Sp$_{2n}$.


title: Exact Matching of Random Graphs with Constant Correlation

abstract: This paper deals with the problem of graph matching or network alignment for Erd\H{o}s--R\'enyi graphs, which can be viewed as a noisy average-case version of the graph isomorphism problem. Let $G$ and $G'$ be $G(n, p)$ Erd\H{o}s--R\'enyi graphs marginally, identified with their adjacency matrices. Assume that $G$ and $G'$ are correlated such that $\mathbb{E}[G_{ij} G'_{ij}] = p(1-\alpha)$. For a permutation $\pi$ representing a latent matching between the vertices of $G$ and $G'$, denote by $G^\pi$ the graph obtained from permuting the vertices of $G$ by $\pi$. Observing $G^\pi$ and $G'$, we aim to recover the matching $\pi$. In this work, we show that for every $\varepsilon \in (0,1]$, there is $n_0>0$ depending on $\varepsilon$ and absolute constants $\alpha_0, R > 0$ with the following property. Let $n \ge n_0$, $(1+\varepsilon) \log n \le np \le n^{\frac{1}{R \log \log n}}$, and $0 < \alpha < \min(\alpha_0,\varepsilon/4)$. There is a polynomial-time algorithm $F$ such that $\mathbb{P}\{F(G^\pi,G')=\pi\}=1-o(1)$. This is the first polynomial-time algorithm that recovers the exact matching between vertices of correlated Erd\H{o}s--R\'enyi graphs with constant correlation with high probability. The algorithm is based on comparison of partition trees associated with the graph vertices.


title: Dynamic Control of Soft Robotic Arm

abstract: In this article, the control problem of one section pneumatically actuated soft robotic arm is investigated in detail. To date, extensive prior work has been done in soft robotics kinematics and dynamics modeling. Proper controller designs can complement the modeling part since they are able to compensate other effects that have not been considered in the modeling, such as the model uncertainties, system parameter identification error, hysteresis, etc. In this paper, we explored different control approaches (kinematic control, PD+feedback linearization, passivity control, adaptive passivity control) and summarized the advantages and disadvantages of each controller. We further investigated the robot control problem in the practical scenarios when the sensor noise exists, actuator velocity measurement is not available, and the hysteresis effect is non-neglectable. Our simulation results indicated that the adaptive passivity control with sigma modification terms, along with a high-gain observer presents a better performance in comparison with other approaches. Although this paper mainly presented the simulation results of various controllers, the work will pave the way for practical implementation of soft robot control.


title: On 1-subdivisions of transitive tournaments

abstract: The oriented Ramsey number $\vec{r}(H)$ for an acyclic digraph $H$ is the minimum integer $n$ such that any $n$-vertex tournament contains a copy of $H$ as a subgraph. We prove that the $1$-subdivision of the $k$-vertex transitive tournament $H_k$ satisfies $\vec{r}(H_k)= O(k^2\log\log k)$. This is tight up to multiplicative $\log\log k$-term. We also show that if $T$ is an $n$-vertex tournament with $\Delta^+(T)-\delta^+(T)= O(n/k) - k^2$, then $T$ contains a $1$-subdivision of $\vec{K}_k$, a complete $k$-vertex digraph with all possible $k(k-1)$ arcs. This is also tight up to multiplicative constant.


title: Disturbing Target Values for Neural Network Regularization

abstract: Diverse regularization techniques have been developed such as L2 regularization, Dropout, DisturbLabel (DL) to prevent overfitting. DL, a newcomer on the scene, regularizes the loss layer by flipping a small share of the target labels at random and training the neural network on this distorted data so as to not learn the training data. It is observed that high confidence labels during training cause the overfitting problem and DL selects disturb labels at random regardless of the confidence of labels. To solve this shortcoming of DL, we propose Directional DisturbLabel (DDL) a novel regularization technique that makes use of the class probabilities to infer the confident labels and using these labels to regularize the model. This active regularization makes use of the model behavior during training to regularize it in a more directed manner. To address regression problems, we also propose DisturbValue (DV), and DisturbError (DE). DE uses only predefined confident labels to disturb target values. DV injects noise into a portion of target values at random similar to DL. In this paper, 6 and 8 datasets are used to validate the robustness of our methods in classification and regression tasks respectively. Finally, we demonstrate that our methods are either comparable to or outperform DisturbLabel, L2 regularization, and Dropout. Also, we achieve the best performance in more than half the datasets by combining our methods with either L2 regularization or Dropout.


title: Casimir effect in DFR space-time

abstract: Non-Commutative space-time introduces a fundamental length scale suggested by approaches to quantum gravity. Here we report the analysis of the Casimir effect for parallel plates separated by a distance of $L$ using a Lorentz invariant scalar theory in a non-commutative space-time (DFR space-time), both at zero and finite temperatures. This is done in two ways; one when the additional space-dimensions introduced in DFR space-time are treated as extra dimensions but on par with usual space-dimension and in the second way, the additional dimensions are treated as compact dimensions. Casimir force obtained in the first approach coincides with the result in the extra-dimensional commutative space-time and this is varying as $\frac{1}{L^5}$. In the second approach, we derive the corrections to the Casimir force, which is dependent on the separation between the plate, $L$ and on the size of the extra compactified dimension, $R$. Since correction terms are very small, keeping only the most significant terms of these corrections, we show that for certain values of the R, the corrections due to non-commutativity makes the force between the parallel plates more attractive, and using this, we find lower bound on the value of $R$. We show here that the requirement of the Casimir force and the energy to be real, impose the condition that the weight function used in defining the DFR action has to be a constant. At zero temperature, we find correction terms due to non-commutativity, depend on $L$ and $R$ dependent modified Bessel functions $K_{1}$ and $K_{2}$, with coefficients that vary as $\frac{1}{LR^3}$ and $\frac{1}{L^2R^2}$, respectively . For finite temperature, the Casimir force has correction terms that scale as $\frac{1}{L}$ and $\frac{1}{L^3}$ in high-temperature limit and as $\frac{1}{L^2}$ and $\frac{1}{L^4}$ in the low-temperature limit.


title: Quasi-Cyclic Stern Proof of Knowledge

abstract: The ongoing NIST standardization process has shown that Proof of Knowledge (PoK) based signatures have become an important type of possible post-quantum signatures. Regarding code-based cryptography, the original approach for PoK based signatures is the Stern protocol which allows to prove the knowledge of a small weight vector solving a given instance of the Syndrome Decoding (SD) problem over F2. It features a soundness error equal to 2/3. This protocol was improved a few years later by V\'eron who proposed a variation of the scheme based on the General Syndrome Decoding (GSD) problem which leads to better results in term of communication. A few years later, the AGS protocol introduced a variation of the V\'eron protocol based on Quasi-Cyclic (QC) matrices. The AGS protocol permits to obtain an asymptotic soundness error of 1/2 and an improvement in term of communications. In the present paper, we introduce the Quasi-Cyclic Stern PoK which constitutes an adaptation of the AGS scheme in a SD context, as well as several new optimizations for code-based PoK. Our main optimization on the size of the signature can't be applied to GSD based protocols such as AGS and therefore motivated the design of our new protocol. In addition, we also provide a special soundness proof that is compatible with the use of the Fiat-Shamir transform for 5-round protocols. This approach is valid for our protocol but also for the AGS protocol which was lacking such a proof. We compare our results with existing signatures including the recent code-based signatures based on PoK leveraging the MPC in the head paradigm. In practice, our new protocol is as fast as AGS while reducing its associated signature length by 20%. As a consequence, it constitutes an interesting trade-off between signature length and execution time for the design of a code-based signature relying only on the difficulty of the SD problem.


title: Pre-trained Language Models in Biomedical Domain: A Systematic Survey

abstract: Pre-trained language models (PLMs) have been the de facto paradigm for most natural language processing (NLP) tasks. This also benefits biomedical domain: researchers from informatics, medicine, and computer science (CS) communities propose various PLMs trained on biomedical datasets, e.g., biomedical text, electronic health records, protein, and DNA sequences for various biomedical tasks. However, the cross-discipline characteristics of biomedical PLMs hinder their spreading among communities; some existing works are isolated from each other without comprehensive comparison and discussions. It expects a survey that not only systematically reviews recent advances of biomedical PLMs and their applications but also standardizes terminology and benchmarks. In this paper, we summarize the recent progress of pre-trained language models in the biomedical domain and their applications in biomedical downstream tasks. Particularly, we discuss the motivations and propose a taxonomy of existing biomedical PLMs. Their applications in biomedical downstream tasks are exhaustively discussed. At last, we illustrate various limitations and future trends, which we hope can provide inspiration for the future research of the research community.


title: Boosting Fast Adversarial Training with Learnable Adversarial Initialization

abstract: Adversarial training (AT) has been demonstrated to be effective in improving model robustness by leveraging adversarial examples for training. However, most AT methods are in face of expensive time and computational cost for calculating gradients at multiple steps in generating adversarial examples. To boost training efficiency, fast gradient sign method (FGSM) is adopted in fast AT methods by calculating gradient only once. Unfortunately, the robustness is far from satisfactory. One reason may arise from the initialization fashion. Existing fast AT generally uses a random sample-agnostic initialization, which facilitates the efficiency yet hinders a further robustness improvement. Up to now, the initialization in fast AT is still not extensively explored. In this paper, we boost fast AT with a sample-dependent adversarial initialization, i.e., an output from a generative network conditioned on a benign image and its gradient information from the target network. As the generative network and the target network are optimized jointly in the training phase, the former can adaptively generate an effective initialization with respect to the latter, which motivates gradually improved robustness. Experimental evaluations on four benchmark databases demonstrate the superiority of our proposed method over state-of-the-art fast AT methods, as well as comparable robustness to advanced multi-step AT methods. The code is released at https://github.com//jiaxiaojunQAQ//FGSM-SDI.


title: A novel similarity measure for mining missing links in long-path networks

abstract: Network information mining is the study of the network topology, which answers a large number of application-based questions towards the structural evolution and the function of a real system. For example, the questions can be related to how the real system evolves or how individuals interact with each other in social networks. Although the evolution of the real system may seem to be found regularly, capturing patterns on the whole process of the evolution is not trivial. Link prediction is one of the most important technologies in network information mining, which can help us understand the real system's evolution law. Link prediction aims to uncover missing links or quantify the likelihood of the emergence of nonexistent links from known network structures. Currently, widely existing methods of link prediction almost focus on short-path networks that usually have a myriad of close triangular structures. However, these algorithms on highly sparse or long-path networks have poor performance. Here, we propose a new index that is associated with the principles of Structural Equivalence and Shortest Path Length ($SESPL$) to estimate the likelihood of link existence in long-path networks. Through 548 real networks test, we find that $SESPL$ is more effective and efficient than other similarity-based predictors in long-path networks. We also exploit the performance of $SESPL$ predictor and embedding-based approaches via machine learning techniques, and the performance of $SESPL$ can achieve a gain of 44.09\% over $GraphWave$ and 7.93\% over $Node2vec$. Finally, according to the matrix of Maximal Information Coefficient ($MIC$) between all the similarity-based predictors, $SESPL$ is a new independent feature to the space of traditional similarity features.


title: Long-term balanced allocation via thinning

abstract: We study the long-term behavior of the two-thinning variant of the classical balls-and-bins model. In this model, an overseer is provided with uniform random allocation of $m$ balls into $n$ bins in an on-line fashion. For each ball, the overseer could reject its allocation and place the ball into a new bin drawn independently at random. The purpose of the overseer is to reduce the maximum load of the bins, which is defined as the difference between the maximum number of balls in a single bin and $m/n$, i.e., the average number of balls among all bins. We provide tight estimates for three quantities: the lowest maximum load that could be achieved at time $m$, the lowest maximum load that could be achieved uniformly over the entire time interval $[m]:=\{1, 2, \cdots, m\}$, and the lowest \emph{typical} maximum load that could be achieved over the interval $[m]$, where the typicality means that the maximum load holds for $1-o(1)$ portion of the times in $[m]$. We show that when $m$ and $n$ are sufficiently large, a typical maximum load of $(\log n)^{1/2+o(1)}$ can be achieved with high probability, asymptotically the same as the optimal maximum load that could be achieved at time $m$. However, for any strategy, the maximal load among all times in the interval $[m]$ is $\Omega\big(\frac{\log n}{\log\log n}\big)$ with high probability. A strategy achieving this bound is provided. An explanation for this gap is provided by our optimal strategies as follows. To control the typical load, we restrain the maximum load for some time, during which we accumulate more and more bins with relatively high load. After a while, we have to employ for a short time a different strategy to reduce the number of relatively heavily loaded bins, at the expanse of temporarily inducing high load in a few bins.


title: Interaction-induced quantum spin Hall insulator in the organic Dirac electron system $\alpha$-(BEDT-TSeF)$_2$I$_3$

abstract: Focusing on the recently-discovered candidate topological insulator $\alpha$-(BEDT-TSeF)$_2$I$_3$ -- having two-dimensional charge-neutral Dirac cones in a low symmetry lattice -- we combine ab-initio and extended-Hubbard model calculations to deal with spin-orbit and non-local repulsive interactions, and find a realization of an interaction-induced quantum spin Hall (QSH) insulator, similar to the one proposed in the honeycomb lattice under next-nearest neighbor repulsions. In the absence of repulsive interactions, a topological insulator appears by the spin-orbit coupling and is characterized by a nonzero spin Chern number. By considering up to next-nearest neighbor repulsions at Hartree-Fock level, the intrinsic spin-orbit gap is found to grow by orders of magnitude and a QSH insulating phase appears that has both a finite spin Chern number and order parameter. Transport coefficients and spin susceptibility are calculated and found to consistently account for most of the experimental findings, including the metal-to-insulator crossover occurring at $\sim50$ K as well as the Berry phase change from 0 to $\pi$ under hydrostatic pressure. We argue that such a QSH insulating phase does not necessitate a sizeable spin-orbit interaction to generate a large insulating gap, which is highly advantageous for the search of novel topological phases in generic materials having low symmetry lattice and/or small spin-orbit coupling.


title: Where's Swimmy?: Mining unique color features buried in galaxies by deep anomaly detection using Subaru Hyper Suprime-Cam data

abstract: We present the Swimmy (Subaru WIde-field Machine-learning anoMalY) survey program, a deep-learning-based search for unique sources using multicolored ($grizy$) imaging data from the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP). This program aims to detect unexpected, novel, and rare populations and phenomena, by utilizing the deep imaging data acquired from the wide-field coverage of the HSC-SSP. This article, as the first paper in the Swimmy series, describes an anomaly detection technique to select unique populations as "outliers" from the data-set. The model was tested with known extreme emission-line galaxies (XELGs) and quasars, which consequently confirmed that the proposed method successfully selected 60-70% of the quasars and 60% of the XELGs without labeled training data. In reference to the spectral information of local galaxies at $z=$0.05-0.2 obtained from the Sloan Digital Sky Survey, we investigated the physical properties of the selected anomalies and compared them based on the significance of their outlier values. The results revealed that XELGs constitute notable fractions of the most anomalous galaxies, and certain galaxies manifest unique morphological features. In summary, a deep anomaly detection is an effective tool that can search rare objects, and ultimately, unknown unknowns with large data-sets. Further development of the proposed model and selection process can promote the practical applications required to achieve specific scientific goals.


title: The Nehari manifold approach for singular equations involving the p(x)-Laplace operator

abstract: We study the following singular problem involving the p$(x)$-Laplace operator $\Delta_{p(x)}u= div(|\nabla u|^{p(x)-2}\nabla u)$, where $p(x)$ is a nonconstant continuous function, \begin{equation} \nonumber {{(\rm P_\lambda)}} \left\{\begin{aligned} - \Delta_{p(x)} u & = a(x)|u|^{q(x)-2}u(x)+ \frac{\lambda b(x)}{u^{\delta(x)}} \quad\mbox{in}\,\Omega,\\ u &>0 \quad\mbox{in}\,\Omega, \\ u & =0 \quad\mbox{on}\,\partial\Omega.\end{aligned} \right. \end{equation} Here, $\Omega$ is a bounded domain in $\mathbb{R}^{N\geq2}$ with $C^2$-boundary, $\lambda$ is a positive parameter, $a(x), b(x) \in C(\overline{\Omega})$ are positive weight functions with compact support in $\Omega$, and $\delta(x),$ $p(x),$ $q(x) \in C(\overline{\Omega})$ satisfy certain hypotheses ($A_{0}$) and ($A_{1}$). We apply the Nehari manifold approach and some new techniques to establish the multiplicity of positive solutions for problem ${{(\rm P_\lambda)}}$.


title: First order formalism of holographic Wilsonian renormalization group: Langevin equation

abstract: We study a mathematical relationship between holographic Wilsonian renormalization group and stochastic quantization framework. We extend the original proposal given in arXiv:1209.2242 to interacting theories. The original proposal suggests that fictitious time(or stochastic time) evolution of stochastic 2-point correlation function will be identical to the radial evolution of the double trace operator of certain classes of holographic models, which are free theories in AdS space. We study holographic gravity models with interactions in AdS space and establish a map between the holographic renormalization flow of multi-trace operators and stochastic $n$-point functions. To give precise examples, we extensively study conformally coupled scalar theory in AdS$_6$. What we have found is that the stochastic time $t$ dependent 3-point function obtained from Langevin equation with its Euclidean action being given by $S_E=2I_{os}$ is identical to holographic renormalization group evolution of holographic triple trace operator as its energy scale $r$ changes once an identification of $t=r$ is made. $I_{os}$ is the on-shell action of holographic model of conformally coupled scalar theory at the AdS boundary. We argue that this can be fully extended to mathematical relationship between multi point functions and multi trace operators in each framework.