title: Feature Selection for Classification with QAOA

abstract: Feature selection is of great importance in Machine Learning, where it can be used to reduce the dimensionality of classification, ranking and prediction problems. The removal of redundant and noisy features can improve both the accuracy and scalability of the trained models. However, feature selection is a computationally expensive task with a solution space that grows combinatorically. In this work, we consider in particular a quadratic feature selection problem that can be tackled with the Quantum Approximate Optimization Algorithm (QAOA), already employed in combinatorial optimization. First we represent the feature selection problem with the QUBO formulation, which is then mapped to an Ising spin Hamiltonian. Then we apply QAOA with the goal of finding the ground state of this Hamiltonian, which corresponds to the optimal selection of features. In our experiments, we consider seven different real-world datasets with dimensionality up to 21 and run QAOA on both a quantum simulator and, for small datasets, the 7-qubit IBM (ibm-perth) quantum computer. We use the set of selected features to train a classification model and evaluate its accuracy. Our analysis shows that it is possible to tackle the feature selection problem with QAOA and that currently available quantum devices can be used effectively. Future studies could test a wider range of classification models as well as improve the effectiveness of QAOA by exploring better performing optimizers for its classical step.


title: Quantum shape oscillations in the thermodynamic properties of confined electrons in core-shell nanostructures

abstract: Quantum shape effect appears under the size-invariant shape transformations of strongly confined structures. Such a transformation distinctively influences the thermodynamic properties of confined particles. Due to their characteristic geometry, core-shell nanostructures are good candidates for quantum shape effects to be observed. Here we investigate the thermodynamic properties of non-interacting degenerate electrons confined in core-shell nanowires consisting of an insulating core and a GaAs semiconducting shell. We derive the expressions of shape-dependent thermodynamic quantities and show the existence of a new type of quantum oscillations due to shape dependence, in chemical potential, internal energy, entropy and specific heat of confined electrons. We provide physical understanding of our results by invoking the quantum boundary layer concept and evaluating the distributions of quantized energy levels on Fermi function and in state space. Besides the density, temperature and size, the shape per se also becomes a control parameter on the Fermi energy of confined electrons, which provides a new mechanism for fine tuning the Fermi level and changing the polarity of semiconductors.


title: Inductive Graph Transformer for Delivery Time Estimation

abstract: Providing accurate estimated time of package delivery on users' purchasing pages for e-commerce platforms is of great importance to their purchasing decisions and post-purchase experiences. Although this problem shares some common issues with the conventional estimated time of arrival (ETA), it is more challenging with the following aspects: 1) Inductive inference. Models are required to predict ETA for orders with unseen retailers and addresses; 2) High-order interaction of order semantic information. Apart from the spatio-temporal features, the estimated time also varies greatly with other factors, such as the packaging efficiency of retailers, as well as the high-order interaction of these factors. In this paper, we propose an inductive graph transformer (IGT) that leverages raw feature information and structural graph data to estimate package delivery time. Different from previous graph transformer architectures, IGT adopts a decoupled pipeline and trains transformer as a regression function that can capture the multiplex information from both raw feature and dense embeddings encoded by a graph neural network (GNN). In addition, we further simplify the GNN structure by removing its non-linear activation and the learnable linear transformation matrix. The reduced parameter search space and linear information propagation in the simplified GNN enable the IGT to be applied in large-scale industrial scenarios. Experiments on real-world logistics datasets show that our proposed model can significantly outperform the state-of-the-art methods on estimation of delivery time. The source code is available at: https://github.com/enoche/IGT-WSDM23.


title: BEKG: A Built Environment Knowledge Graph

abstract: Practices in the built environment have become more digitalized with the rapid development of modern design and construction technologies. However, the requirement of practitioners or scholars to gather complicated professional knowledge in the built environment has not been satisfied yet. In this paper, more than 80,000 paper abstracts in the built environment field were obtained to build a knowledge graph, a knowledge base storing entities and their connective relations in a graph-structured data model. To ensure the retrieval accuracy of the entities and relations in the knowledge graph, two well-annotated datasets have been created, containing 2,000 instances and 1,450 instances each in 29 relations for the named entity recognition task and relation extraction task respectively. These two tasks were solved by two BERT-based models trained on the proposed dataset. Both models attained an accuracy above 85% on these two tasks. More than 200,000 high-quality relations and entities were obtained using these models to extract all abstract data. Finally, this knowledge graph is presented as a self-developed visualization system to reveal relations between various entities in the domain. Both the source code and the annotated dataset can be found here: https://github.com/HKUST-KnowComp/BEKG.


title: A Simple Explanation for the Goldbach Conjecture

abstract: In this paper, a simple explanation for the Goldbach Conjecture is given. We have shown that the probability of violating the conjecture not only for the prime numbers, but also for any subset of natural numbers whose distribution is similar to the prime numbers is negligible. This result makes it possible to generalize the conjecture to any subset of natural numbers whose distribution is similar to the prime numbers. Additionally, we selected several new subsets whose distribution amongst the natural numbers are similar to the prime numbers by randomly addition of +1 and -1 to the prime numbers and checked the Goldbach conjecture for every even integer less than $2 \times 10^8$ by computer. As it was expected, the Goldbach conjecture holds true for these new reconstructed sets, as well. Consequently, the conjecture can be generalized to any subset of natural numbers whose distribution is similar to the prime numbers. That is "being prime" is not necessary for the conjecture to hold for the instances. This fact brings to mind the idea that perhaps what makes the Conjecture to hold for the instances is "probability", not number theory facts.


title: Multiband linear cellular automata and endomorphisms of algebraic vector groups

abstract: We propose a correspondence between certain multiband linear cellular automata - models of computation widely used in the description of physical phenomena - and endomorphisms of certain algebraic unipotent groups over finite fields. The correspondence is based on the construction of a universal element specialising to a normal generator for any finite field. We use this correspondence to deduce new results concerning the temporal dynamics of such automata, using our prior, purely algebraic, study of the endomorphism ring of vector groups. These produce 'for free' a formula for the number of fixed points of the $n$-iterate in terms of the $p$-adic valuation of $n$, a dichotomy for the Artin-Mazur dynamical zeta function, and an asymptotic formula for the number of periodic orbits. Since multiband linear cellular automata simulate higher order linear automata (in which states depend on finitely many prior temporal states, not just the direct predecessor), the results apply equally well to that class.


title: Axion-meson mixing in light of recent lattice $\eta$-$\eta'$ simulations and their two-photon couplings within $U(3)$ chiral theory

abstract: We study the mixing of the QCD/QCD-like axion and light-flavor mesons $\pi^0, \eta, \eta'$ within the framework of $U(3)$ chiral perturbation theory up to next-to-leading order in this work. The axion-meson mixing formulas are calculated order by order in the $U(3)$ $\delta$-expansion scheme, namely the joint expansions of the momentum, light-quark masses and $1/N_C$. We provide axion-meson mixing relations in terms of the $\pi^0$-$\eta$-$\eta'$ mixing parameters and their masses. The recent lattice simulations on the $\eta$-$\eta'$ systems turn out to be able to offer valuable inputs to constrain the unknown low-energy constants. The relation of the mass and decay constant of the axion is then further explored based on our updated calculations. The two-photon couplings of the light-flavor mesons, together with the axion, are also investigated in the $U(3)$ chiral theory up to next-to-leading order in the $\delta$-counting scheme.


title: Lightweight 3D Convolutional Neural Network for Schizophrenia diagnosis using MRI Images and Ensemble Bagging Classifier

abstract: Structural alterations have been thoroughly investigated in the brain during the early onset of schizophrenia (SCZ) with the development of neuroimaging methods. The objective of the paper is an efficient classification of SCZ in 2 different classes: Cognitive Normal (CN), and SCZ using magnetic resonance imaging (MRI) images. This paper proposed a lightweight 3D convolutional neural network (CNN) based framework for SCZ diagnosis using MRI images. In the proposed model, lightweight 3D CNN is used to extract both spatial and spectral features simultaneously from 3D volume MRI scans, and classification is done using an ensemble bagging classifier. Ensemble bagging classifier contributes to preventing overfitting, reduces variance, and improves the model's accuracy. The proposed algorithm is tested on datasets taken from three benchmark databases available as open-source: MCICShare, COBRE, and fBRINPhase-II. These datasets have undergone preprocessing steps to register all the MRI images to the standard template and reduce the artifacts. The model achieves the highest accuracy 92.22%, sensitivity 94.44%, specificity 90%, precision 90.43%, recall 94.44%, F1-score 92.39% and G-mean 92.19% as compared to the current state-of-the-art techniques. The performance metrics evidenced the use of this model to assist the clinicians for automatic accurate diagnosis of SCZ.


title: Deep Learning for Rapid Landslide Detection using Synthetic Aperture Radar (SAR) Datacubes

abstract: With climate change predicted to increase the likelihood of landslide events, there is a growing need for rapid landslide detection technologies that help inform emergency responses. Synthetic Aperture Radar (SAR) is a remote sensing technique that can provide measurements of affected areas independent of weather or lighting conditions. Usage of SAR, however, is hindered by domain knowledge that is necessary for the pre-processing steps and its interpretation requires expert knowledge. We provide simplified, pre-processed, machine-learning ready SAR datacubes for four globally located landslide events obtained from several Sentinel-1 satellite passes before and after a landslide triggering event together with segmentation maps of the landslides. From this dataset, using the Hokkaido, Japan datacube, we study the feasibility of SAR-based landslide detection with supervised deep learning (DL). Our results demonstrate that DL models can be used to detect landslides from SAR data, achieving an Area under the Precision-Recall curve exceeding 0.7. We find that additional satellite visits enhance detection performance, but that early detection is possible when SAR data is combined with terrain information from a digital elevation model. This can be especially useful for time-critical emergency interventions. Code is made publicly available at https://github.com/iprapas/landslide-sar-unet.


title: Electronics and Sensor Subsystem Design for Daedalus 2 on REXUS 29: An Autorotation Probe for Sub-Orbital Re-Entry

abstract: The Daedalus 2 mission aboard REXUS 29 is a technology demonstrator for an alternative descent mechanism for very high altitude drops based on auto-rotation. It consists of two probes that are ejected from a sounding rocket at an altitude of about 80 km and decelerate to a soft landing using only a passive rotor with pitch control. This type of autonomous, scientific experiment poses great challenges upon the electronics subsystem, which include mechanical stress, power system reliability, sensor redundancy, subsystem communication, and development procedures. Based on the data gathered in Daedalus 1 multiple new approaches were developed to fulfill these requirements, such as redundant communication links, mechanical decoupling of PCBs and fault-tolerant power source selection.


title: Linear maps as sufficient criteria for entanglement depth and compatibility in many-body systems

abstract: Physical transformations are described by linear maps that are completely positive and trace preserving (CPTP). However, maps that are positive (P) but not completely positive (CP) are instrumental to derive separability/entanglement criteria. Moreover, the properties of such maps can be linked to entanglement properties of the states they detect. Here, we extend the results presented in [Phys. Rev A 93, 042335 (2016)], where sufficient separability criteria for bipartite systems were derived. In particular, we analyze the entanglement depth of an $N$-qubit system by proposing linear maps that, when applied to any state, result in a bi-separable state for the $1:(N-1)$ partitions, i.e., $(N-1)$-entanglement depth. Furthermore, we derive criteria to detect arbitrary $(N-n)$-entanglement depth tailored to states in close vicinity of the completely depolarized state (the normalized identity matrix). We also provide separability (or $1$- entanglement depth) conditions in the symmetric sector, including for diagonal states. Finally, we suggest how similar map techniques can be used to derive sufficient conditions for a set of expectation values to be compatible with separable states or local-hidden-variable theories. We dedicate this paper to the memory of the late Andrzej Kossakowski, our spiritual and intellectual mentor in the field of linear maps.


title: Distributed Coverage Hole Prevention for Visual Environmental Monitoring with Quadcopters via Nonsmooth Control Barrier Functions

abstract: This paper proposes a distributed coverage control strategy for quadcopters equipped with downward-facing cameras that prevents the appearance of unmonitored areas in between the quadcopters' fields of view (FOVs). We derive a necessary and sufficient condition for eliminating any unsurveilled area that may arise in between the FOVs among a trio of quadcopters by utilizing a power diagram, i.e. a weighted Voronoi diagram defined by radii of FOVs. Because this condition can be described as logically combined constraints, we leverage nonsmooth control barrier functions (NCBFs) to prevent the appearance of unmonitored areas among a team's FOV. We then investigate the symmetric properties of the proposed NCBFs to develop a distributed algorithm. The proposed algorithm can support the switching of the NCBFs caused by changes of the quadcopters composing trios. The existence of the control input satisfying NCBF conditions is analyzed by employing the characteristics of the power diagram. The proposed framework is synthesized with a coverage control law that maximizes the monitoring quality while reducing overlaps of FOVs. The proposed method is demonstrated in simulation and experiment.


title: Limit laws in the lattice problem. IV. The special case of $\mathbb{Z}^{d}$

abstract: We study the error of the number of points of the lattice $\mathbb{Z}^{d}$ that fall into a dilated and translated hypercube centred around $0$ and whose axis are parallel to the axis of coordinates. We show that if $t$, the factor of dilatation, is distributed according to the probability measure $\frac{1}{T} \rho(\frac{t}{T}) dt$ with $\rho$ being a probability density over $[0,1]$ the error, when normalized by $t^{d-1}$, converges in law when $T \rightarrow \infty$ in the case where the translation is of the form $X=(x,\cdots,x)$ and in the case where the coordinates of $X$ are independent between them, independent from $t$ and distributed according to the uniform law over $[-\frac{1}{2},\frac{1}{2}]$. In both cases, we compute the characteristic function of the limit law.


title: Improved Techniques for the Conditional Generative Augmentation of Clinical Audio Data

abstract: Data augmentation is a valuable tool for the design of deep learning systems to overcome data limitations and stabilize the training process. Especially in the medical domain, where the collection of large-scale data sets is challenging and expensive due to limited access to patient data, relevant environments, as well as strict regulations, community-curated large-scale public datasets, pretrained models, and advanced data augmentation methods are the main factors for developing reliable systems to improve patient care. However, for the development of medical acoustic sensing systems, an emerging field of research, the community lacks large-scale publicly available data sets and pretrained models. To address the problem of limited data, we propose a conditional generative adversarial neural network-based augmentation method which is able to synthesize mel spectrograms from a learned data distribution of a source data set. In contrast to previously proposed fully convolutional models, the proposed model implements residual Squeeze and Excitation modules in the generator architecture. We show that our method outperforms all classical audio augmentation techniques and previously published generative methods in terms of generated sample quality and a performance improvement of 2.84% of Macro F1-Score for a classifier trained on the augmented data set, an enhancement of $1.14\%$ in relation to previous work. By analyzing the correlation of intermediate feature spaces, we show that the residual Squeeze and Excitation modules help the model to reduce redundancy in the latent features. Therefore, the proposed model advances the state-of-the-art in the augmentation of clinical audio data and improves the data bottleneck for the design of clinical acoustic sensing systems.


title: Almost extreme waves

abstract: Numerically computed with high accuracy are periodic traveling waves at the free surface of a two dimensional, infinitely deep, and constant vorticity flow of an incompressible inviscid fluid, under gravity, without the effects of surface tension. Of particular interest is the angle the fluid surface of an almost extreme wave makes with the horizontal. Numerically found are: (i) a boundary layer where the angle rises sharply from $0^\circ$ at the crest to a local maximum, which converges to $30.3787\dots^\circ$ as the amplitude increases toward that of the extreme wave, independently of the vorticity, (ii) an outer region where the angle descends to $0^\circ$ at the trough for negative vorticity, while it rises to a maximum, greater than $30^\circ$, and then falls sharply to $0^\circ$ at the trough for large positive vorticity, and (iii) a transition region where the angle oscillates about $30^\circ$, resembling the Gibbs phenomenon. Numerical evidence suggests that the amplitude and frequency of the oscillations become independent of the vorticity as the wave profile approaches the extreme form.


title: Out-of-Plane Biphilic Surface Structuring for Enhanced Capillary-Driven Dropwise Condensation

abstract: Rapid and sustained condensate droplet departure from a surface is key towards achieving high heat transfer rates in condensation, a physical process critical to a broad range of industrial and societal applications. Despite progress in enhancing condensation heat transfer through inducing its dropwise mode with hydrophobic materials, sophisticated surface engineering methods that can lead to further enhancement of heat transfer are still highly desirable. Here, by employing a three-dimensional, multiphase computational approach, we present an effective out-of-plane biphilic surface topography, that reveals an unexplored capillarity-driven departure mechanism of condensate droplets. This texture consists of biphilic diverging micro-cavities wherein a matrix of small hydrophilic spots is placed at their bottom, that is, amongst the pyramid-shaped, superhydrophobic micro-textures forming the cavities. We show that an optimal combination of the hydrophilic spots and the angles of the pyramidal structures can achieve high deformational stretching of the droplets, eventually realizing an impressive slingshot-like droplet ejection process from the texture. Such a droplet departure mechanism has the potential to reduce the droplet ejection volume and thus enhance the overall condensation efficiency, compared to coalescence-initiated droplet jumping from other state-of-the-art surfaces. Simulations have shown that optimal pyramid-shaped biphilic micro-structures can provoke droplet self-ejection at low volumes, up to 56% lower compared to superhydrophobic straight pillars, revealing a promising new surface micro-texture design strategy towards enhancing condensation heat transfer efficiency and water harvesting capabilities.


title: Wigner's Friend paradoxes: consistency with weak-contextual and weak-macroscopic realism models

abstract: Wigner's friend paradoxes highlight contradictions between measurements made by Friends inside a laboratory and superobservers outside a laboratory, who have access to an entangled state of the measurement apparatus. The contradictions lead to no-go theorems for observer-independent facts, thus challenging concepts of objectivity. Here, we examine the paradoxes from the perspective of establishing consistency with macroscopic realism. We present versions of the Brukner-Wigner-friend and Frauchiger-Renner paradoxes in which the spin-$1/2$ system measured by the Friends corresponds to two macroscopically distinct states. The local unitary operations $U_{\theta}$ that determine the measurement setting $\theta$ are carried out using nonlinear interactions, thereby ensuring measurements need only distinguish between the macroscopically distinct states. The macroscopic paradoxes are perplexing, seemingly suggesting there is no objectivity in a macroscopic limit. However, we demonstrate consistency with a contextual weak form of macroscopic realism (wMR): The premise wMR asserts that the system can be considered to have a definite spin outcome $\lambda_{\theta}$, at the time after the system has undergone the unitary rotation $U_{\theta}$ to prepare it in a suitable pointer basis. We further show that the paradoxical outcomes imply failure of deterministic macroscopic local realism, and arise when there are unitary interactions $U_{\theta}$ occurring due to a change of measurement setting at both sites, with respect to the state prepared by each Friend. In models which validate wMR, there is a breakdown of a subset of the assumptions that constitute the Bell-Locality premise. A similar interpretation involving a weak contextual form of realism exists for the original paradoxes.


title: Textual Manifold-based Defense Against Natural Language Adversarial Examples

abstract: Recent studies on adversarial images have shown that they tend to leave the underlying low-dimensional data manifold, making them significantly more challenging for current models to make correct predictions. This so-called off-manifold conjecture has inspired a novel line of defenses against adversarial attacks on images. In this study, we find a similar phenomenon occurs in the contextualized embedding space induced by pretrained language models, in which adversarial texts tend to have their embeddings diverge from the manifold of natural ones. Based on this finding, we propose Textual Manifold-based Defense (TMD), a defense mechanism that projects text embeddings onto an approximated embedding manifold before classification. It reduces the complexity of potential adversarial examples, which ultimately enhances the robustness of the protected model. Through extensive experiments, our method consistently and significantly outperforms previous defenses under various attack settings without trading off clean accuracy. To the best of our knowledge, this is the first NLP defense that leverages the manifold structure against adversarial attacks. Our code is available at \url{https://github.com/dangne/tmd}.


title: A Data-Driven Evolutionary Transfer Optimization for Expensive Problems in Dynamic Environments

abstract: Many real-world problems are usually computationally costly and the objective functions evolve over time. Data-driven, a.k.a. surrogate-assisted, evolutionary optimization has been recognized as an effective approach for tackling expensive black-box optimization problems in a static environment whereas it has rarely been studied under dynamic environments. This paper proposes a simple but effective transfer learning framework to empower data-driven evolutionary optimization to solve dynamic optimization problems. Specifically, it applies a hierarchical multi-output Gaussian process to capture the correlation between data collected from different time steps with a linearly increased number of hyperparameters. Furthermore, an adaptive source task selection along with a bespoke warm staring initialization mechanisms are proposed to better leverage the knowledge extracted from previous optimization exercises. By doing so, the data-driven evolutionary optimization can jump start the optimization in the new environment with a strictly limited computational budget. Experiments on synthetic benchmark test problems and a real-world case study demonstrate the effectiveness of our proposed algorithm against nine state-of-the-art peer algorithms.


title: Superconductivity and correlated phases in non-twisted bilayer and trilayer graphene

abstract: Twisted bilayer graphene has a rich phase diagram, including superconductivity. Recently, an unexpected discovery has been the observation of superconductivity in non-twisted graphene bilayers and trilayers. In this Perspective, we give an overview of the search for uncommon phases in non-twisted graphene systems. We first contextualize these recent results within earlier work in the field, before examining the new experimental findings. Finally, we analyse the numerous theoretical models that study the underlying physical processes in these systems


title: The CGF dark matter fluid

abstract: The cosmological gauge field (CGF) is a classical solution of SU(2)-weak gauge theory oscillating rapidly in time. It is the dark matter driving the CGF cosmology. A general, local, mathematically natural construction of the CGF is given here. The macroscopic properties are derived. The CGF is an irrotational perfect fluid. It provides a synchronized global time coordinate and a global rest frame. There is a conserved number density. The energy density and pressure are related by the same equation of state as derived in the CGF cosmology and used in the TOV stellar structure equations for stars made of CGF dark matter. The present construction justifies the TOV solution. Some possible routes towards testing the theory are suggested at the end.

categories: physics.gen-ph astro-ph.CO gr-qc hep-ph hep-th


title: HERB: Measuring Hierarchical Regional Bias in Pre-trained Language Models

abstract: Fairness has become a trending topic in natural language processing (NLP), which addresses biases targeting certain social groups such as genders and religions. However, regional bias in language models (LMs), a long-standing global discrimination problem, still remains unexplored. This paper bridges the gap by analysing the regional bias learned by the pre-trained language models that are broadly used in NLP tasks. In addition to verifying the existence of regional bias in LMs, we find that the biases on regional groups can be strongly influenced by the geographical clustering of the groups. We accordingly propose a HiErarchical Regional Bias evaluation method (HERB) utilising the information from the sub-region clusters to quantify the bias in pre-trained LMs. Experiments show that our hierarchical metric can effectively evaluate the regional bias with respect to comprehensive topics and measure the potential regional bias that can be propagated to downstream tasks. Our codes are available at https://github.com/Bernard-Yang/HERB.


title: Unified Multi-View Orthonormal Non-Negative Graph Based Clustering Framework

abstract: Spectral clustering is an effective methodology for unsupervised learning. Most traditional spectral clustering algorithms involve a separate two-step procedure and apply the transformed new representations for the final clustering results. Recently, much progress has been made to utilize the non-negative feature property in real-world data and to jointly learn the representation and clustering results. However, to our knowledge, no previous work considers a unified model that incorporates the important multi-view information with those properties, which severely limits the performance of existing methods. In this paper, we formulate a novel clustering model, which exploits the non-negative feature property and, more importantly, incorporates the multi-view information into a unified joint learning framework: the unified multi-view orthonormal non-negative graph based clustering framework (Umv-ONGC). Then, we derive an effective three-stage iterative solution for the proposed model and provide analytic solutions for the three sub-problems from the three stages. We also explore, for the first time, the multi-model non-negative graph-based approach to clustering data based on deep features. Extensive experiments on three benchmark data sets demonstrate the effectiveness of the proposed method.


title: Can quantum non-locality be connected to extra-dimensions?

abstract: Quantum non locality, as described by EPR paradox, represents one of the mysteries at the very foundations of quantum mechanics. Here we suggest to investigate if it can be understood by considering extra dimensions.


title: Stateful Detection of Adversarial Reprogramming

abstract: Adversarial reprogramming allows stealing computational resources by repurposing machine learning models to perform a different task chosen by the attacker. For example, a model trained to recognize images of animals can be reprogrammed to recognize medical images by embedding an adversarial program in the images provided as inputs. This attack can be perpetrated even if the target model is a black box, supposed that the machine-learning model is provided as a service and the attacker can query the model and collect its outputs. So far, no defense has been demonstrated effective in this scenario. We show for the first time that this attack is detectable using stateful defenses, which store the queries made to the classifier and detect the abnormal cases in which they are similar. Once a malicious query is detected, the account of the user who made it can be blocked. Thus, the attacker must create many accounts to perpetrate the attack. To decrease this number, the attacker could create the adversarial program against a surrogate classifier and then fine-tune it by making few queries to the target model. In this scenario, the effectiveness of the stateful defense is reduced, but we show that it is still effective.


title: Some Classical Models of Particles and Quantum Gauge Theories

abstract: The article contains a review and new results of some mathematical models relevant to the interpretation of quantum mechanics and emulating well-known quantum gauge theories, such as scalar electrodynamics (Klein-Gordon-Maxwell electrodynamics), spinor electrodynamics (Dirac-Maxwell electrodynamics), etc. In these models, evolution is typically described by modified Maxwell equations. In the case of scalar electrodynamics, the scalar complex wave function can be made real by a gauge transformation, the wave function can be algebraically eliminated from the equations of scalar electrodynamics, and the resulting modified Maxwell equations describe the independent evolution of the electromagnetic field. Similar results were obtained for spinor electrodynamics. Three out of four components of the Dirac spinor can be algebraically eliminated from the Dirac equation, and the remaining component can be made real by a gauge transformation. A similar result was obtained for the Dirac equation in the Yang-Mills field. As quantum gauge theories play a central role in modern physics, the approach of this article may be sufficiently general. One-particle wave functions can be modeled as plasma-like collections of a large number of particles and antiparticles. This seems to enable the simulation of quantum phase-space distribution functions, such as the Wigner distribution function, which are not necessarily non-negative.


title: Planet(esimal)s Around Stars with TESS (PAST) III: A Search for Triplet He I in the Atmospheres of Two 200 Myr-old Planets

abstract: We report a search for excess absorption in the 1083.2 nm line of ortho (triplet) helium during transits of TOI-1807b and TOI-2076b, 1.25 and 2.5R$_{\rm Earth}$ planets on 0.55- and 10.4-day orbits around nearby $\sim$200~Myr-old K dwarf stars. We limit the equivalent width of any transit-associated absorption to $<$4 and $<$8 mA, respectively. We limit the escape of solar-composition atmospheres from TOI-1807b and TOI-2076b to $\lesssim$1 and $\lesssim$0.1M$_{\rm Earth}$ Gyr$^{-1}$, respectively, depending on wind temperature. The absence of a H/He signature for TOI-1807b is consistent with a measurement of mass indicating a rocky body and the prediction by a hydrodynamic model that any H-dominated atmosphere would be unstable and already have been lost. Differential spectra obtained during the transit of TOI-2076b contain a He I-like feature, but this closely resembles the stellar line and extends beyond the transit interval. Until additional transits are observed, we suspect this to be the result of variation in the stellar He I line produced by rotation of active regions and/or flaring on the young, active host star. Non-detection of escape could mean that TOI-2076b is more massive than expected, the star is less EUV-luminous, the models overestimate escape, or the planet has a H/He-poor atmosphere that is primarily molecules such as H$_2$O. Photochemical models of planetary winds predict a semi-major axis at which triplet He I observations are most sensitive to mass loss: TOI-2076b orbits near this optimum. Future surveys could use a distance criterion to increase the yield of detections.


title: Pitfalls of Climate Network Construction: A Statistical Perspective

abstract: Network-based analyses of dynamical systems have become increasingly popular in climate science. Here we address network construction from a statistical perspective and highlight the often ignored fact that the calculated correlation values are only empirical estimates. To measure spurious behaviour as deviation from a ground truth network, we simulate time-dependent isotropic random fields on the sphere and apply common network construction techniques. We find several ways in which the uncertainty stemming from the estimation procedure has major impact on network characteristics. When the data has locally coherent correlation structure, spurious link bundle teleconnections and spurious high-degree clusters have to be expected. Anisotropic estimation variance can also induce severe biases into empirical networks. We validate our findings with ERA5 reanalysis data. Moreover we explain why commonly applied resampling procedures are inappropriate for significance evaluation and propose a statistically more meaningful ensemble construction framework. By communicating which difficulties arise in estimation from scarce data and by presenting which design decisions increase robustness, we hope to contribute to more reliable climate network construction in the future.


title: Geometry of Reachability sets of Vector Addition Systems

abstract: Vector Addition Systems (VAS), aka Petri nets, are a popular model of concurrency. The reachability set of a VAS is the set of configurations reachable from the initial configuration. Leroux has studied the geometric properties of VAS reachability sets, and used them to derive decision procedures for important analysis problems. In this paper we continue the geometric study of reachability sets. We show that every reachability set admits a finite decomposition into disjoint almost hybridlinear sets enjoying nice geometric properties. Further, we prove that the decomposition of the reachability set of a given VAS is effectively computable. As a corollary, we derive a simple algorithm for deciding semilinearity of VAS reachability sets, the first one since Hauschildt's 1990 algorithm. As a second corollary, we prove that the complement of a reachability set always contains an infinite linear set.


title: Minimal length corrections to magnetic birefringence in vacuum

abstract: We consider the modification to Kruglov's non-linear electrodynamics in the presence of minimal length ($l_p$), by considering a specific formulation of generalized uncertainty principle (GUP). The presence of minimal length has been motivated by several candidate theories of quantum-gravity (both perturbative and non-perturbative). We show that, such minimal length modifications could lead to momentum dependent bounds on zero-point electric field strength, for the aforementioned non-linear model of electrodynamics. We further show that, the existence of minimal length modifies the measure of vacuum birefringence $\Delta n$ in a constant and uniformly strong, external magnetic field. We therefore suggest, the presence of a frictional mechanism of fundamental origin, acting in the parallel direction of polarization of photons (in the presence of strong magnetic field), as an additional effect of quantized background.


title: Predicting biomolecular binding kinetics: A review

abstract: Biomolecular binding kinetics including the association (kon) and dissociation (koff) rates are critical parameters for therapeutic design of small-molecule drugs, peptides and antibodies. Notably, drug molecule residence time or dissociation rate has been shown to correlate with their efficacies better than binding affinities. A wide range of modeling approaches including quantitative structure-kinetic relationship models, Molecular Dynamics simulations, enhanced sampling and Machine Learning have been developed to explore biomolecular binding and dissociation mechanisms and predict binding kinetic rates. Here, we review recent advances in computational modeling of biomolecular binding kinetics, with an outlook for future improvements.


title: SizeGAN: Improving Size Representation in Clothing Catalogs

abstract: Online clothing catalogs lack diversity in body shape and garment size. Brands commonly display their garments on models of one or two sizes, rarely including plus-size models. To our knowledge, our paper presents the first method for generating images of garments and models in a new target size to tackle the size under-representation problem. Our primary technical contribution is a conditional generative adversarial network that learns deformation fields at multiple resolutions to realistically change the size of models and garments. Results from our two user studies show SizeGAN outperforms alternative methods along three dimensions -- realism, garment faithfulness, and size -- which are all important for real world use.


title: Learning Product Graphs from Spectral Templates

abstract: Graph Learning (GL) is at the core of inference and analysis of connections in data mining and machine learning (ML). By observing a dataset of graph signals, and considering specific assumptions, Graph Signal Processing (GSP) tools can provide practical constraints in the GL approach. One applicable constraint can infer a graph with desired frequency signatures, i.e., spectral templates. However, a severe computational burden is a challenging barrier, especially for inference from high-dimensional graph signals. To address this issue and in the case of the underlying graph having graph product structure, we propose learning product (high dimensional) graphs from product spectral templates with significantly reduced complexity rather than learning them directly from high-dimensional graph signals, which, to the best of our knowledge, has not been addressed in the related areas. In contrast to the rare current approaches, our approach can learn all types of product graphs (with more than two graphs) without knowing the type of graph products and has fewer parameters. Experimental results on both the synthetic and real-world data, i.e., brain signal analysis and multi-view object images, illustrate explainable and meaningful factor graphs supported by expert-related research, as well as outperforming the rare current restricted approaches.


title: Deep Factorization Model for Robust Recommendation

abstract: Recently, malevolent user hacking has become a huge problem for real-world companies. In order to learn predictive models for recommender systems, factorization techniques have been developed to deal with user-item ratings. In this paper, we suggest a broad architecture of a factorization model with adversarial training to get over these issues. The effectiveness of our systems is demonstrated by experimental findings on real-world datasets.


title: Simple Primitives with Feasibility- and Contextuality-Dependence for Open-World Compositional Zero-shot Learning

abstract: The task of Compositional Zero-Shot Learning (CZSL) is to recognize images of novel state-object compositions that are absent during the training stage. Previous methods of learning compositional embedding have shown effectiveness in closed-world CZSL. However, in Open-World CZSL (OW-CZSL), their performance tends to degrade significantly due to the large cardinality of possible compositions. Some recent works separately predict simple primitives (i.e., states and objects) to reduce cardinality. However, they consider simple primitives as independent probability distributions, ignoring the heavy dependence between states, objects, and compositions. In this paper, we model the dependence of compositions via feasibility and contextuality. Feasibility-dependence refers to the unequal feasibility relations between simple primitives, e.g., \textit{hairy} is more feasible with \textit{cat} than with \textit{building} in the real world. Contextuality-dependence represents the contextual variance in images, e.g., \textit{cat} shows diverse appearances under the state of \textit{dry} and \textit{wet}. We design Semantic Attention (SA) and generative Knowledge Disentanglement (KD) to learn the dependence of feasibility and contextuality, respectively. SA captures semantics in compositions to alleviate impossible predictions, driven by the visual similarity between simple primitives. KD disentangles images into unbiased feature representations, easing contextual bias in predictions. Moreover, we complement the current compositional probability model with feasibility and contextuality in a compatible format. Finally, we conduct comprehensive experiments to analyze and validate the superior or competitive performance of our model, Semantic Attention and knowledge Disentanglement guided Simple Primitives (SAD-SP), on three widely-used benchmark OW-CZSL datasets.


title: Investigations on the light hadron decays of $Z_b(10610)$ and $Z_b(10650)$

abstract: The light hadron decay processes of $Z_b(10610)/Z_b(10650)$ provide us a way to study their nature and decay mechanism. In this work, we evaluate the branching ratios of $Z_b(10610)/Z_b(10650) \to VP$ ($V$ and $P$ stand for light vector and pseudoscalar mesons, respectively) using an effective Lagrangian approach, in which the contributions of intermediate bottomed meson triangle loops are considered. In our calculations, the $Z_b(10610)$ and $Z_b(10650)$ are regarded as $B\bar{B}^*+c.c.$ and $B^*\bar{B}^*$ molecular states, respectively. The predicted branching ratios of $Z_b(10610)\rightarrow VP$ are about in the order of $10^{-2}$, while the branching ratios of $Z_b(10650)\rightarrow VP$ are in the order of $10^{-3}$. Furthermore, the dependence of these ratios between different decay modes of $Z_b(10610)/Z_b(10650)$ on the mixing $\eta-\eta^\prime$ angle $\theta_P$ is investigated, which may be a good quantity for the experiments. It is hoped that the calculations here could be tested by future experiments.


title: Analysis of the planetary mass uncertainties on the accuracy of atmospherical retrieval

abstract: Characterising the properties of exoplanet atmospheres relies on several interconnected parameters, which makes it difficult to determine them independently. Planetary mass plays a role in determining the scale height of atmospheres, similarly to the contribution from the average molecular weight of the gas. We investigate the relevance of planetary mass knowledge in spectral retrievals, identifying cases where mass measurements are needed for clear or cloudy and primary or secondary atmospheres, along with the relevant precision, in the context of the ESA M4 Ariel Mission. We used TauREx to simulate the Ariel transmission spectra of representative targets of the Ariel mission reference sample, assuming different scenarios: a primordial cloudy atmosphere of a hot Jupiter and a hot Neptune, as well as the secondary atmosphere of a super-Earth that also exhibits a cloud presence. We extracted information on the various properties of the atmospheres for the cases of unknown mass or mass with different uncertainties. We also tested how the signal-to-noise ratio impacts atmospheric retrieval for different wavelength ranges. We accurately retrieved the primordial atmospheric composition independently from mass uncertainties for clear atmospheres, while we found that the uncertainties increased for high altitude clouds. We highlight the importance of the signal-to-noise ratio in the Rayleigh scattering region of the spectrum. For the secondary atmosphere cases, a mass uncertainty no larger than 50% is sufficient to retrieve the atmospheric parameters, even in the presence of clouds. Our analysis suggests that even in the worst-case scenario, a 50% mass precision level is enough for producing reliable retrievals, while an atmospheric retrieval without any knowledge of a planetary mass could lead to biases in cloudy primary atmospheres as well as in secondary atmospheres.


title: Spatial-temporal structure functions in Burgers turbulence driven by an Ornstein-Uhlenbeck process

abstract: We explore the spatial-temporal structure functions of Burgers turbulence driven by a temporal Ornstein-Uhlenbeck (OU) process, where the characteristic time scale of the OU process is much larger than that of the energy flux across spatial scales. Based on the K\'arm\'an-Howarth-Monin equation, we obtain an expression for the third-order spatial-temporal structure function away from the dissipation scale. This expression combines Kolmogorov's exact result of spatial structure function and the exponential temporal decay of the external force. We numerically justify this expression and find that the high-order structure functions also decay exponentially, however, the dependence of decay rates on order is different for the odd- and even-order structure functions. Comparing the OU-driven Burgers turbulence with that driven by temporal white noise, their spatial structure functions are identical when the energy injection rates are the same, which justifies Kolmogorov's theory, but these two systems' temporal structure functions differ. Also, the velocity pdf in the OU-driven Burgers turbulence shows a bimodal distribution, contradicting the near-Gaussian distribution in white-noise-driven turbulence.


title: Tri-Attention: Explicit Context-Aware Attention Mechanism for Natural Language Processing

abstract: In natural language processing (NLP), the context of a word or sentence plays an essential role. Contextual information such as the semantic representation of a passage or historical dialogue forms an essential part of a conversation and a precise understanding of the present phrase or sentence. However, the standard attention mechanisms typically generate weights using query and key but ignore context, forming a Bi-Attention framework, despite their great success in modeling sequence alignment. This Bi-Attention mechanism does not explicitly model the interactions between the contexts, queries and keys of target sequences, missing important contextual information and resulting in poor attention performance. Accordingly, a novel and general triple-attention (Tri-Attention) framework expands the standard Bi-Attention mechanism and explicitly interacts query, key, and context by incorporating context as the third dimension in calculating relevance scores. Four variants of Tri-Attention are generated by expanding the two-dimensional vector-based additive, dot-product, scaled dot-product, and bilinear operations in Bi-Attention to the tensor operations for Tri-Attention. Extensive experiments on three NLP tasks demonstrate that Tri-Attention outperforms about 30 state-of-the-art non-attention, standard Bi-Attention, contextual Bi-Attention approaches and pretrained neural language models1.


title: Grassmann Manifold Flows for Stable Shape Generation

abstract: Recently, studies on machine learning have focused on methods that use symmetry implicit in a specific manifold as an inductive bias. Grassmann manifolds provide the ability to handle fundamental shapes represented as shape spaces, enabling stable shape analysis. In this paper, we present a novel approach in which we establish the theoretical foundations for learning distributions on the Grassmann manifold via continuous normalization flows, with the explicit goal of generating stable shapes. Our approach facilitates more robust generation by effectively eliminating the influence of extraneous transformations, such as rotations and inversions, through learning and generating within a Grassmann manifold designed to accommodate the essential shape information of the object. The experimental results indicated that the proposed method could generate high-quality samples by capturing the data structure. Furthermore, the proposed method significantly outperformed state-of-the-art methods in terms of the log-likelihood or evidence lower bound. The results obtained are expected to stimulate further research in this field, leading to advances for stable shape generation and analysis.


title: Universal parabolic moduli over $\overline{M}_{_{g, n}}$

abstract: In this article we will construct a universal moduli space of stable parabolic vector bundles over the moduli space of marked Deligne-Mumford stable curves $\overline{M}_{_{g, n}}$. The objects that appear over the boundary of $\overline{M}_{_{g, n}}$ i.e., over singular curves will remain vector bundles. The total space and the fibers over $\overline{M}_{_{g, n}}$ will have good singularities.


title: Search for Dark Matter Axions with CAST-CAPP

abstract: The CAST-CAPP axion haloscope, operating at CERN inside the CAST dipole magnet, has searched for axions in the 19.74 $\mu$eV to 22.47 $\mu$eV mass range. The detection concept follows the Sikivie haloscope principle, where Dark Matter axions convert into photons within a resonator immersed in a magnetic field. The CAST-CAPP resonator is an array of four individual rectangular cavities inserted in a strong dipole magnet, phase-matched to maximize the detection sensitivity. Here we report on the data acquired for 4124 h from 2019 to 2021. Each cavity is equipped with a fast frequency tuning mechanism of 10 MHz/min between 4.774 GHz and 5.434 GHz. In the present work, we exclude axion-photon couplings for virialized galactic axions down to $g_{a{\gamma}{\gamma}} = 8 \times {10^{-14}}$ $GeV^{-1}$ at the 90% confidence level. The here implemented phase-matching technique also allows for future large-scale upgrades.


title: VISinger 2: High-Fidelity End-to-End Singing Voice Synthesis Enhanced by Digital Signal Processing Synthesizer

abstract: End-to-end singing voice synthesis (SVS) model VISinger can achieve better performance than the typical two-stage model with fewer parameters. However, VISinger has several problems: text-to-phase problem, the end-to-end model learns the meaningless mapping of text-to-phase; glitches problem, the harmonic components corresponding to the periodic signal of the voiced segment occurs a sudden change with audible artefacts; low sampling rate, the sampling rate of 24KHz does not meet the application needs of high-fidelity generation with the full-band rate (44.1KHz or higher). In this paper, we propose VISinger 2 to address these issues by integrating the digital signal processing (DSP) methods with VISinger. Specifically, inspired by recent advances in differentiable digital signal processing (DDSP), we incorporate a DSP synthesizer into the decoder to solve the above issues. The DSP synthesizer consists of a harmonic synthesizer and a noise synthesizer to generate periodic and aperiodic signals, respectively, from the latent representation z in VISinger. It supervises the posterior encoder to extract the latent representation without phase information and avoid the prior encoder modelling text-to-phase mapping. To avoid glitch artefacts, the HiFi-GAN is modified to accept the waveforms generated by the DSP synthesizer as a condition to produce the singing voice. Moreover, with the improved waveform decoder, VISinger 2 manages to generate 44.1kHz singing audio with richer expression and better quality. Experiments on OpenCpop corpus show that VISinger 2 outperforms VISinger, CpopSing and RefineSinger in both subjective and objective metrics.


title: HAQJSK: Hierarchical-Aligned Quantum Jensen-Shannon Kernels for Graph Classification

abstract: In this work, we propose a family of novel quantum kernels, namely the Hierarchical Aligned Quantum Jensen-Shannon Kernels (HAQJSK), for un-attributed graphs. Different from most existing classical graph kernels, the proposed HAQJSK kernels can incorporate hierarchical aligned structure information between graphs and transform graphs of random sizes into fixed-sized aligned graph structures, i.e., the Hierarchical Transitive Aligned Adjacency Matrix of vertices and the Hierarchical Transitive Aligned Density Matrix of the Continuous-Time Quantum Walk (CTQW). For a pair of graphs to hand, the resulting HAQJSK kernels are defined by measuring the Quantum Jensen-Shannon Divergence (QJSD) between their transitive aligned graph structures. We show that the proposed HAQJSK kernels not only reflect richer intrinsic global graph characteristics in terms of the CTQW, but also address the drawback of neglecting structural correspondence information arising in most existing R-convolution kernels. Furthermore, unlike the previous Quantum Jensen-Shannon Kernels associated with the QJSD and the CTQW, the proposed HAQJSK kernels can simultaneously guarantee the properties of permutation invariant and positive definiteness, explaining the theoretical advantages of the HAQJSK kernels. Experiments indicate the effectiveness of the proposed kernels.


title: Density of triangulated ternary disc packings

abstract: We consider ternary disc packings of the plane, i.e. the packings using discs of three different radii. Packings in which each ''hole'' is bounded by three pairwise tangent discs are called triangulated. There are 164 pairs $(r,s)$, $1{>}r{>}s$, allowing triangulated packings by discs of radii 1, $r$ and $s$. In this paper, we enhance existing methods of dealing with maximal-density packings in order to find ternary triangulated packings which maximize the density among all the packings with the same disc radii. We showed for 16 pairs that the density is maximized by a triangulated ternary packing; for 15 other pairs, we proved the density to be maximized by a triangulated packing using only two sizes of discs; for 40 pairs, we found non-triangulated packings strictly denser than any triangulated one; finally, we classified the remaining cases where our methods are not applicable.


title: ON-DEMAND-FL: A Dynamic and Efficient Multi-Criteria Federated Learning Client Deployment Scheme

abstract: In this paper, we increase the availability and integration of devices in the learning process to enhance the convergence of federated learning (FL) models. To address the issue of having all the data in one location, federated learning, which maintains the ability to learn over decentralized data sets, combines privacy and technology. Until the model converges, the server combines the updated weights obtained from each dataset over a number of rounds. The majority of the literature suggested client selection techniques to accelerate convergence and boost accuracy. However, none of the existing proposals have focused on the flexibility to deploy and select clients as needed, wherever and whenever that may be. Due to the extremely dynamic surroundings, some devices are actually not available to serve as clients in FL, which affects the availability of data for learning and the applicability of the existing solution for client selection. In this paper, we address the aforementioned limitations by introducing an On-Demand-FL, a client deployment approach for FL, offering more volume and heterogeneity of data in the learning process. We make use of the containerization technology such as Docker to build efficient environments using IoT and mobile devices serving as volunteers. Furthermore, Kubernetes is used for orchestration. The Genetic algorithm (GA) is used to solve the multi-objective optimization problem due to its evolutionary strategy. The performed experiments using the Mobile Data Challenge (MDC) dataset and the Localfed framework illustrate the relevance of the proposed approach and the efficiency of the on-the-fly deployment of clients whenever and wherever needed with less discarded rounds and more available data.


title: The First Cohomology of Lie Superalgebra $\tilde{P}(2)$ with Coefficients in Kac Modules

abstract: Over a field of characteristic p>2, firstly, the structure of Kac modules of Lie superalgebra $\tilde{P}(2)$ and the weight space decompositions are given. Secondly, the weight-derivations of $\tilde{P}(2)$ to its Kac modules are computed. Finally, the first cohomology of $\tilde{P}(2)$ with coefficients in Kac modules is determined.


title: Paucity phenomena for polynomial products

abstract: Let $P(x)\in \mathbb{Z}[x]$ be a polynomial with at least two distinct complex roots. We prove that the number of solutions $(x_1, \dots, x_k, y_1, \dots, y_k)\in [N]^{2k}$ to the equation \[ \prod_{1\le i \le k} P(x_i) = \prod_{1\le j \le k} P(y_j)\neq 0 \] (for any $k\ge 1$) is asymptotically $k!N^{k}$ as $N\to +\infty$. This solves a question first proposed and studied by Najnudel. The result can also be interpreted as saying that all even moments of random partial sums $\frac{1}{\sqrt{N}}\sum_{n\le N}f(P(n))$ match standard complex Gaussian moments as $N\to +\infty$, where $f$ is the Steinhaus random multiplicative function.


title: Essentially finite $G$-torsors

abstract: Let $X$ be a smooth projective curve of genus $g$, defined over an algebraically closed field $k$, and let $G$ be a connected reductive group over $k$. We say that a $G$-torsor is essentially finite if it admits a reduction to a finite group, generalising the notion of essentially finite vector bundles to arbitrary groups $G$. We give a Tannakian interpretation of such torsors, and we prove that all essentially finite $G$-torsors have torsion degree, and that the degree is 0 if $X$ is an elliptic curve. We then study the density of the set of $k$-points of essentially finite $G$-torsors of degree $0$, denoted $M_{G}^{\text{ef},0}$, inside $M_{G}^{\text{ss},0}$, the $k$-points of all semistable degree 0 $G$-torsors. We show that when $g=1$, $M_{G}^{\text{ef}}\subset M_{G}^{\text{ss},0}$ is dense. When $g>1$ and when $\text{char}(k)=0$, we show that for any reductive group of semisimple rank 1, $M_{G}^{\text{ef},0}\subset M_{G}^{\text{ss},0}$ is not dense.


title: Chaotic internal dynamics of dissipative optical soliton molecules

abstract: When a laser cavity supports the propagation of several ultrashort pulses, these pulses interact and can form compact bound states called soliton molecules. Soliton molecules are fascinating objects of nonlinear science, which present striking analogies with their matter molecules counterparts. The soliton pair, composed of two identical pulses, constitutes the chief soliton molecule of fundamental interest. The relative timing and phase between the two propagating pulses are the most salient internal degrees of freedom of the soliton molecule. These two internal degrees of freedom allow self-oscillating soliton molecules, which have indeed been repeatedly observed, whereas the lowdimensional chaotic dynamics of a soliton-pair molecule remains elusive, noting that it would require at least three degrees of freedom. We here report the observation of chaotic soliton-pair molecules within an ultrafast fiber laser, by means of a direct measurement of the relative optical pulse separation with sub-femtosecond precision in real time. Moreover, we demonstrate an all-optical control of the chaotic dynamics followed by the soliton molecule, by injecting a modulated optical signal that resynchronizes the internal periodic vibration of soliton molecule.


title: Note on Sombor index of connected graphs with given degree sequence

abstract: For a simple connected graph $G=(V,E)$, let $d(u)$ be the degree of the vertex $u$ of $G$. The general Sombor index of $G$ is defined as $$SO_{\alpha}(G)=\sum_{uv\in E} \left[d(u)^2+d(v)^2\right]^\alpha$$ where $SO(G)=SO_{0.5}(G)$ is the recently invented Sombor index. In this paper, we show that in the class of connected graphs with a fixed degree sequence (for which the minimum degree being equal to one), there exists a special extremal $BFS$-graph with minimum general Sombor index for $0<\alpha<1$ (resp. maximum general Sombor index for either $\alpha>1$ or $\alpha<0$). Moreover, for any given tree, unicyclic, and bicyclic degree sequences with minimum degree 1, there exists a unique extremal $BFS$-graph with minimum general Sombor index for $0<\alpha<1$ and maximum general Sombor index for either $\alpha>1$ or $\alpha<0$.


title: New Definitions and Evaluations for Saliency Methods: Staying Intrinsic, Complete and Sound

abstract: Saliency methods compute heat maps that highlight portions of an input that were most {\em important} for the label assigned to it by a deep net. Evaluations of saliency methods convert this heat map into a new {\em masked input} by retaining the $k$ highest-ranked pixels of the original input and replacing the rest with \textquotedblleft uninformative\textquotedblright\ pixels, and checking if the net's output is mostly unchanged. This is usually seen as an {\em explanation} of the output, but the current paper highlights reasons why this inference of causality may be suspect. Inspired by logic concepts of {\em completeness \& soundness}, it observes that the above type of evaluation focuses on completeness of the explanation, but ignores soundness. New evaluation metrics are introduced to capture both notions, while staying in an {\em intrinsic} framework -- i.e., using the dataset and the net, but no separately trained nets, human evaluations, etc. A simple saliency method is described that matches or outperforms prior methods in the evaluations. Experiments also suggest new intrinsic justifications, based on soundness, for popular heuristic tricks such as TV regularization and upsampling.


title: Alexandrov's theorem for anisotropic capillary hypersurfaces in the half-space

abstract: In this paper, we show that any embedded capillary hypersurface in the half-space with anisotropic constant mean curvature is a truncated Wulff shape. This extends Wente's result \cite{Wente80} to the anisotropic case and He-Li-Ma-Ge's result \cite{HLMG09} to the capillary boundary case. The main ingredients in the proof are a new Heintze-Karcher inequality and a new Minkowski formula, which have their own inetrest.


title: Robust Reflection Removal with Flash-only Cues in the Wild

abstract: We propose a simple yet effective reflection-free cue for robust reflection removal from a pair of flash and ambient (no-flash) images. The reflection-free cue exploits a flash-only image obtained by subtracting the ambient image from the corresponding flash image in raw data space. The flash-only image is equivalent to an image taken in a dark environment with only a flash on. This flash-only image is visually reflection-free and thus can provide robust cues to infer the reflection in the ambient image. Since the flash-only image usually has artifacts, we further propose a dedicated model that not only utilizes the reflection-free cue but also avoids introducing artifacts, which helps accurately estimate reflection and transmission. Our experiments on real-world images with various types of reflection demonstrate the effectiveness of our model with reflection-free flash-only cues: our model outperforms state-of-the-art reflection removal approaches by more than 5.23dB in PSNR. We extend our approach to handheld photography to address the misalignment between the flash and no-flash pair. With misaligned training data and the alignment module, our aligned model outperforms our previous version by more than 3.19dB in PSNR on a misaligned dataset. We also study using linear RGB images as training data. Our source code and dataset are publicly available at https://github.com/ChenyangLEI/flash-reflection-removal.


title: ESKNet-An enhanced adaptive selection kernel convolution for breast tumors segmentation

abstract: Breast cancer is one of the common cancers that endanger the health of women globally. Accurate target lesion segmentation is essential for early clinical intervention and postoperative follow-up. Recently, many convolutional neural networks (CNNs) have been proposed to segment breast tumors from ultrasound images. However, the complex ultrasound pattern and the variable tumor shape and size bring challenges to the accurate segmentation of the breast lesion. Motivated by the selective kernel convolution, we introduce an enhanced selective kernel convolution for breast tumor segmentation, which integrates multiple feature map region representations and adaptively recalibrates the weights of these feature map regions from the channel and spatial dimensions. This region recalibration strategy enables the network to focus more on high-contributing region features and mitigate the perturbation of less useful regions. Finally, the enhanced selective kernel convolution is integrated into U-net with deep supervision constraints to adaptively capture the robust representation of breast tumors. Extensive experiments with twelve state-of-the-art deep learning segmentation methods on three public breast ultrasound datasets demonstrate that our method has a more competitive segmentation performance in breast ultrasound images.


title: Electronic properties of monolayer copper selenide with one-dimensional moir\'e patterns

abstract: Strain engineering is a vital way to manipulate the electronic properties of two-dimensional (2D) materials. As a typical representative of transition metal mono-chalcogenides (TMMs), a honeycomb CuSe monolayer features with one-dimensional (1D) moir\'e patterns owing to the uniaxial strain along one of three equivalent orientations of Cu(111) substrates. Here, by combining low-temperature scanning tunneling microscopy/spectroscopy (STM/S) experiments and density functional theory (DFT) calculations, we systematically investigate the electronic properties of the strained CuSe monolayer on the Cu(111) substrate. Our results show the semiconducting feature of CuSe monolayer with a band gap of 1.28 eV and the 1D periodical modulation of electronic properties by the 1D moir\'e patterns. Except for the uniaxially strained CuSe monolayer, we observed domain boundary and line defects in the CuSe monolayer, where the biaxial-strain and strain-free conditions can be investigated respectively. STS measurements for the three different strain regions show that the first peak in conduction band will move downward with the increasing strain. DFT calculations based on the three CuSe atomic models with different strain inside reproduced the peak movement. The present findings not only enrich the fundamental comprehension toward the influence of strain on electronic properties at 2D limit, but also offer the benchmark for the development of 2D semiconductor materials.


title: SIS model of disease extinction on heterogeneous directed population networks

abstract: Understanding the spread of diseases through complex networks is of great interest where realistic, heterogeneous contact patterns play a crucial role in the spread. Most works have focused on mean-field behavior -- quantifying how contact patterns affect the emergence and stability of (meta)stable endemic states in networks. On the other hand, much less is known about longer time scale dynamics, such as disease extinction, whereby inherent process stochasticity and contact heterogeneity interact to produce large fluctuations that result in the spontaneous clearance of infection. Here we show that heterogeneity in both susceptibility and infectiousness (incoming and outgoing degree, respectively) has a non-trivial effect on extinction in directed contact networks, both speeding-up and slowing-down extinction rates depending on the relative proportion of such edges in a network, and on whether the heterogeneities in the incoming and outgoing degrees are correlated or anticorrelated. In particular, we show that weak anticorrelated heterogeneity can increase the disease stability, whereas strong heterogeneity gives rise to markedly different results for correlated and anticorrelated heterogeneous networks. All analytical results are corroborated through various numerical schemes including network Monte-Carlo simulations.


title: A Filtering-based General Approach to Learning Rational Constraints of Epistemic Graphs

abstract: Epistemic graphs are a generalization of the epistemic approach to probabilistic argumentation. Hunter proposed a 2-way generalization framework to learn epistemic constraints from crowd-sourcing data. However, the learnt epistemic constraints only reflect users' beliefs from data, without considering the rationality encoded in epistemic graphs. Meanwhile, the current framework can only generate epistemic constraints that reflect whether an agent believes an argument, but not the degree to which it believes in it. The major challenge to achieving this effect is that the computational complexity will increase sharply when expanding the variety of constraints, which may lead to unacceptable time performance. To address these problems, we propose a filtering-based approach using a multiple-way generalization step to generate a set of rational rules which are consistent with their epistemic graphs from a dataset. This approach is able to learn a wider variety of rational rules that reflect information in both the domain model and the user model. Moreover, to improve computational efficiency, we introduce a new function to exclude meaningless rules. The empirical results show that our approach significantly outperforms the existing framework when expanding the variety of rules.


title: Design of Reconfigurable Intelligent Surface-Aided Cross-Media Communications

abstract: A novel reconfigurable intelligent surface (RIS)-aided hybrid reflection/transmitter design is proposed for achieving information exchange in cross-media communications. In pursuit of the balance between energy efficiency and low-cost implementations, the cloud-management transmission protocol is adopted in the integrated multi-media system. Specifically, the messages of devices using heterogeneous propagation media, are firstly transmitted to the medium-matched AP, with the aid of the RIS-based dual-hop transmission. After the operation of intermediate frequency conversion, the access point (AP) uploads the received signals to the cloud for further demodulating and decoding process. Based on time division multiple access (TDMA), the cloud is able to distinguish the downlink data transmitted to different devices and transforms them into the input of the RIS controller via the dedicated control channel. Thereby, the RIS can passively reflect the incident carrier back into the original receiver with the exchanged information during the preallocated slots, following the idea of an index modulation-based transmitter. Moreover, the iterative optimization algorithm is utilized for optimizing the RIS phase, transmit rate and time allocation jointly in the delay-constrained cross-media communication model. Our simulation results demonstrate that the proposed RIS-based scheme can improve the end-to-end throughput than that of the AP-based transmission, the equal time allocation, the random and the discrete phase adjustment benchmarks.


title: GmGM: a Fast Multi-Axis Gaussian Graphical Model

abstract: This paper introduces the Gaussian multi-Graphical Model, a model to construct sparse graph representations of matrix- and tensor-variate data. We generalize prior work in this area by simultaneously learning this representation across several tensors that share axes, which is necessary to allow the analysis of multimodal datasets such as those encountered in multi-omics. Our algorithm uses only a single eigendecomposition per axis, achieving an order of magnitude speedup over prior work in the ungeneralized case. This allows the use of our methodology on large multi-modal datasets such as single-cell multi-omics data, which was challenging with previous approaches. We validate our model on synthetic data and five real-world datasets.


title: To share and not share a singlet: quantum switch and nonclassicality in teleportation

abstract: The superposition principle provides us the opportunity to unfold many surprising facts. One such fact leads to the generation of entanglement which may allow one to teleport an unknown quantum state from one location to another. While all pure entangled states can provide nonclassical fidelity for quantum teleportation, perfect teleportation comes at the cost of having a maximally entangled state shared between the sender and the receiver. In this work, we consider a situation where the sender and the receiver are in a superposed situation of sharing a maximally entangled state and not sharing anything, controlled by a quantum switch. We consider two distinct protocols: in the first case, the sender and the receiver do nothing when there is no shared entanglement and in the second case, they use classical communication in absence of entanglement. In each of the protocols, we follow two different paths. In the first path, after the protocol is completed, we simply throw away the switch. In the second path, after accomplishing the protocol, we operate a Hadamard gate on the switch, measure the switch's state, and consider the outcome corresponding to a particular state of the switch. We compare the two paths with the maximum fidelity achievable through random guess or utilizing classical resources only. In particular, we provide conditions to achieve nonclassical fidelity in teleportation by applying quantum switch. We comment on whether the difference between the two paths can be expressed in terms of quantum coherence present in the switch's state.


title: Beyond Hawkes: Neural Multi-event Forecasting on Spatio-temporal Point Processes

abstract: Predicting discrete events in time and space has many scientific applications, such as predicting hazardous earthquakes and outbreaks of infectious diseases. History-dependent spatio-temporal Hawkes processes are often used to mathematically model these point events. However, previous approaches have faced numerous challenges, particularly when attempting to forecast one or multiple future events. In this work, we propose a new neural architecture for simultaneous multi-event forecasting of spatio-temporal point processes, utilizing transformers, augmented with normalizing flows and probabilistic layers. Our network makes batched predictions of complex history-dependent spatio-temporal distributions of future discrete events, achieving state-of-the-art performance on a variety of benchmark datasets including the South California Earthquakes, Citibike, Covid-19, and Hawkes synthetic pinwheel datasets. More generally, we illustrate how our network can be applied to any dataset of discrete events with associated markers, even when no underlying physics is known.


title: Cross-Subject Emotion Recognition with Sparsely-Labeled Peripheral Physiological Data Using SHAP-Explained Tree Ensembles

abstract: There are still many challenges of emotion recognition using physiological data despite the substantial progress made recently. In this paper, we attempted to address two major challenges. First, in order to deal with the sparsely-labeled physiological data, we first decomposed the raw physiological data using signal spectrum analysis, based on which we extracted both complexity and energy features. Such a procedure helped reduce noise and improve feature extraction effectiveness. Second, in order to improve the explainability of the machine learning models in emotion recognition with physiological data, we proposed Light Gradient Boosting Machine (LightGBM) and SHapley Additive exPlanations (SHAP) for emotion prediction and model explanation, respectively. The LightGBM model outperformed the eXtreme Gradient Boosting (XGBoost) model on the public Database for Emotion Analysis using Physiological signals (DEAP) with f1-scores of 0.814, 0.823, and 0.860 for binary classification of valence, arousal, and liking, respectively, with cross-subject validation using eight peripheral physiological signals. Furthermore, the SHAP model was able to identify the most important features in emotion recognition, and revealed the relationships between the predictor variables and the response variables in terms of their main effects and interaction effects. Therefore, the results of the proposed model not only had good performance using peripheral physiological data, but also gave more insights into the underlying mechanisms in recognizing emotions.


title: Accurate and Reliable Methods for 5G UAV Jamming Identification With Calibrated Uncertainty

abstract: Only increasing accuracy without considering uncertainty may negatively impact Deep Neural Network (DNN) decision-making and decrease its reliability. This paper proposes five combined preprocessing and post-processing methods for time-series binary classification problems that simultaneously increase the accuracy and reliability of DNN outputs applied in a 5G UAV security dataset. These techniques use DNN outputs as input parameters and process them in different ways. Two methods use a well-known Machine Learning (ML) algorithm as a complement, and the other three use only confidence values that the DNN estimates. We compare seven different metrics, such as the Expected Calibration Error (ECE), Maximum Calibration Error (MCE), Mean Confidence (MC), Mean Accuracy (MA), Normalized Negative Log Likelihood (NLL), Brier Score Loss (BSL), and Reliability Score (RS) and the tradeoffs between them to evaluate the proposed hybrid algorithms. First, we show that the eXtreme Gradient Boosting (XGB) classifier might not be reliable for binary classification under the conditions this work presents. Second, we demonstrate that at least one of the potential methods can achieve better results than the classification in the DNN softmax layer. Finally, we show that the prospective methods may improve accuracy and reliability with better uncertainty calibration based on the assumption that the RS determines the difference between MC and MA metrics, and this difference should be zero to increase reliability. For example, Method 3 presents the best RS of 0.65 even when compared to the XGB classifier, which achieves RS of 7.22.


title: Marches al\'eatoires dans un c\^one et fonctions discr\`etes harmoniques

abstract: Random walks in cones have the double interest of being at the heart of many probabilistic problems and of being related to many mathematical fields, such as spectral theory, combinatorics, or discrete complex analysis. In this article, we present some key ideas associated with these processes: we will discuss their definition, the link with Brownian motion in cones, as well as some recent research topics such as the construction of discrete harmonic functions.


title: Parity Games of Bounded Tree-Depth

abstract: The exact complexity of solving parity games is a major open problem. Several authors have searched for efficient algorithms over specific classes of graphs. In particular, Obdr\v{z}\'{a}lek showed that for graphs of bounded tree-width or clique-width, the problem is in $\mathrm{P}$, which was later improved by Ganardi, who showed that it is even in $\mathrm{LOGCFL}$ (with an additional assumption for clique-width case). Here we extend this line of research by showing that for graphs of bounded tree-depth the problem of solving parity games is in logspace uniform $\text{AC}^0$. We achieve this by first considering a parameter that we obtain from a modification of clique-width, which we call shallow clique-width. We subsequently provide a suitable reduction.


title: Unsupervised Machine Learning for Explainable Health Care Fraud Detection

abstract: The US federal government spends more than a trillion dollars per year on health care, largely provided by private third parties and reimbursed by the government. A major concern in this system is overbilling, waste and fraud by providers, who face incentives to misreport on their claims in order to receive higher payments. In this paper, we develop novel machine learning tools to identify providers that overbill Medicare, the US federal health insurance program for elderly adults and the disabled. Using large-scale Medicare claims data, we identify patterns consistent with fraud or overbilling among inpatient hospitalizations. Our proposed approach for Medicare fraud detection is fully unsupervised, not relying on any labeled training data, and is explainable to end users, providing reasoning and interpretable insights into the potentially suspicious behavior of the flagged providers. Data from the Department of Justice on providers facing anti-fraud lawsuits and several case studies validate our approach and findings both quantitatively and qualitatively.


title: Hierarchical Control of Grid-Connected Hydrogen Electrolyzer Providing Grid Services

abstract: This paper presents the operation modes and control architecture of the grid-connected hydrogen electrolyzer systems for the provision of frequency and voltage supports. The analysis is focused on the primary and secondary loops in the hierarchical control scheme. At the power converter inner control loop, the voltage- and current-control modes are analyzed. At the primary level, the droop and opposite droop control strategies to provide voltage and frequency support are described. Coordination between primary control and secondary, tertiary reserves is discussed. The case studies and real-time simulation results are provided using Typhoon HIL to back the theoretical investigation.


title: Toward Neural Network Simulation of Variational Quantum Algorithms

abstract: Variational quantum algorithms (VQAs) utilize a hybrid quantum-classical architecture to recast problems of high-dimensional linear algebra as ones of stochastic optimization. Despite the promise of leveraging near- to intermediate-term quantum resources to accelerate this task, the computational advantage of VQAs over wholly classical algorithms has not been firmly established. For instance, while the variational quantum eigensolver (VQE) has been developed to approximate low-lying eigenmodes of high-dimensional sparse linear operators, analogous classical optimization algorithms exist in the variational Monte Carlo (VMC) literature, utilizing neural networks in place of quantum circuits to represent quantum states. In this paper we ask if classical stochastic optimization algorithms can be constructed paralleling other VQAs, focusing on the example of the variational quantum linear solver (VQLS). We find that such a construction can be applied to the VQLS, yielding a paradigm that could theoretically extend to other VQAs of similar form.


title: 1-D Convolutional Graph Convolutional Networks for Fault Detection in Distributed Energy Systems

abstract: This paper presents a 1-D convolutional graph neural network for fault detection in microgrids. The combination of 1-D convolutional neural networks (1D-CNN) and graph convolutional networks (GCN) helps extract both spatial-temporal correlations from the voltage measurements in microgrids. The fault detection scheme includes fault event detection, fault type and phase classification, and fault location. There are five neural network model training to handle these tasks. Transfer learning and fine-tuning are applied to reduce training efforts. The combined recurrent graph convolutional neural networks (1D-CGCN) is compared with the traditional ANN structure on the Potsdam 13-bus microgrid dataset. The achievable accuracy of 99.27%, 98.1%, 98.75%, and 95.6% for fault detection, fault type classification, fault phase identification, and fault location respectively.


title: Charged scalar field perturbations in Ernst black holes

abstract: We consider the propagation of a charged massive scalar field in the background of a four-dimensional Ernst black hole and study its stability analyzing the quasinormal modes (QNMs), which are calculated using the semi-analytical Wentzel-Kramers-Brillouin method and numerically using the continued fraction method. Mainly, we find that for a scalar field mass less than a critical mass, the decay rate of the QNMs decreases when the harmonic angular number $\ell$ increases; and for a scalar field mass greater than the critical mass the behaviour is inverted, i.e, the longest-lived modes are always the ones with the lowest angular number recovering the standard behaviour. Also, we find a critical value of the external magnetic field, as well as, a critical value of the scalar field charge that exhibit the same behaviour with respect to the angular harmonic numbers. In addition, we show that the spacetime allows stable quasibound states and we observe a splitting of the spectrum due to the Zeeman effect. Finally, we show that the unstable null geodesic in the equatorial plane is connected with the QNMs when the azimuthal quantum number satisfy $m= \pm \ell$ in the eikonal limit.


title: Rankers, Rankees, & Rankings: Peeking into the Pandora's Box from a Socio-Technical Perspective

abstract: Algorithmic rankers have a profound impact on our increasingly data-driven society. From leisurely activities like the movies that we watch, the restaurants that we patronize; to highly consequential decisions, like making educational and occupational choices or getting hired by companies -- these are all driven by sophisticated yet mostly inaccessible rankers. A small change to how these algorithms process the rankees (i.e., the data items that are ranked) can have profound consequences. For example, a change in rankings can lead to deterioration of the prestige of a university or have drastic consequences on a job candidate who missed out being in the list of the preferred top-k for an organization. This paper is a call to action to the human-centered data science research community to develop principled methods, measures, and metrics for studying the interactions among the socio-technical context of use, technological innovations, and the resulting consequences of algorithmic rankings on multiple stakeholders. Given the spate of new legislations on algorithmic accountability, it is imperative that researchers from social science, human-computer interaction, and data science work in unison for demystifying how rankings are produced, who has agency to change them, and what metrics of socio-technical impact one must use for informing the context of use.


title: Minimum degree of minimal (\emph{n}-10)-factor-critical graphs

abstract: A graph $G$ of order $n$ is said to be $k$-factor-critical for integers $1\leq k < n$, if the removal of any $k$ vertices results in a graph with a perfect matching. A $k$-factor-critical graph $G$ is called minimal if for any edge $e\in E(G)$, $G-e$ is not $k$-factor-critical. In 1998, O. Favaron and M. Shi conjectured that every minimal $k$-factor-critical graph of order $n$ has the minimum degree $k+1$ and confirmed it for $k=1, n-2, n-4$ and $n-6$. By using a novel approach, we have confirmed it for $k = n - 8$ in a previous paper. Continuing this method, we prove the conjecture to be true for $k=n-10$ in this paper.


title: Boost invariant spin hydrodynamics within the first order in derivative expansion

abstract: Boost-invariant equations of spin hydrodynamics confined to the first-order terms in gradients are numerically solved. The spin equation of state, relating the spin density tensor to the spin chemical potential, is consistently included in the first order. Depending on its form and the structure of the spin transport coefficients, we find solutions which are both stable and unstable within the considered evolution times of 10 fm/c. These findings are complementary to the recent identification of stable and unstable modes for perturbed uniform spin systems described by similar hydrodynamic frameworks.


title: Efficient Cavity Searching for Gene Network of Influenza A Virus

abstract: High order structures (cavities and cliques) of the gene network of influenza A virus reveal tight associations among viruses during evolution and are key signals that indicate viral cross-species infection and cause pandemics. As indicators for sensing the dynamic changes of viral genes, these higher order structures have been the focus of attention in the field of virology. However, the size of the viral gene network is usually huge, and searching these structures in the networks introduces unacceptable delay. To mitigate this issue, in this paper, we propose a simple-yet-effective model named HyperSearch based on deep learning to search cavities in a computable complex network for influenza virus genetics. Extensive experiments conducted on a public influenza virus dataset demonstrate the effectiveness of HyperSearch over other advanced deep-learning methods without any elaborated model crafting. Moreover, HyperSearch can finish the search works in minutes while 0-1 programming takes days. Since the proposed method is simple and easy to be transferred to other complex networks, HyperSearch has the potential to facilitate the monitoring of dynamic changes in viral genes and help humans keep up with the pace of virus mutations.


title: Learning the shape of protein micro-environments with a holographic convolutional neural network

abstract: Proteins play a central role in biology from immune recognition to brain activity. While major advances in machine learning have improved our ability to predict protein structure from sequence, determining protein function from structure remains a major challenge. Here, we introduce Holographic Convolutional Neural Network (H-CNN) for proteins, which is a physically motivated machine learning approach to model amino acid preferences in protein structures. H-CNN reflects physical interactions in a protein structure and recapitulates the functional information stored in evolutionary data. H-CNN accurately predicts the impact of mutations on protein function, including stability and binding of protein complexes. Our interpretable computational model for protein structure-function maps could guide design of novel proteins with desired function.


title: Quantization Adaptor for Bit-Level Deep Learning-Based Massive MIMO CSI Feedback

abstract: In massive multiple-input multiple-output (MIMO) systems, the user equipment (UE) needs to feed the channel state information (CSI) back to the base station (BS) for the following beamforming. But the large scale of antennas in massive MIMO systems causes huge feedback overhead. Deep learning (DL) based methods can compress the CSI at the UE and recover it at the BS, which reduces the feedback cost significantly. But the compressed CSI must be quantized into bit streams for transmission. In this paper, we propose an adaptor-assisted quantization strategy for bit-level DL-based CSI feedback. First, we design a network-aided adaptor and an advanced training scheme to adaptively improve the quantization and reconstruction accuracy. Moreover, for easy practical employment, we introduce the expert knowledge of data distribution and propose a pluggable and cost-free adaptor scheme. Experiments show that compared with the state-of-the-art feedback quantization method, this adaptor-aided quantization strategy can achieve better quantization accuracy and reconstruction performance with less or no additional cost. The open-source codes are available at https://github.com/zhang-xd18/QCRNet.


title: A note on products of stochastic objects

abstract: In recent study of partial differential equations (PDEs) with random initial data and singular stochastic PDEs with random forcing, it is essential to study the regularity property of various stochastic objects. These stochastic objects are often given as products of simpler stochastic objects. As pointed out in Hairer(2014), by using a multiple stochastic integral representation, one may use Jensen's inequality to reduce an estimate on the product to those on simpler stochastic objects. In this note, we present a simple argument of the same estimate, based on Cauchy-Schwarz' inequality (without any reference to multiple stochastic integrals). We present an example on computing the regularity property of stochastic objects in the study of the dispersion-generalized nonlinear wave equations, and prove their local well-posedness with rough random initial data.


title: Optimal Power Flow Pursuit in the Alternating Current Model

abstract: Transmission-constrained problems in power systems can be cast as polynomial optimization problems whose coefficients vary over time. We consider the complications therein and suggest several approaches. On the example of the alternating-current optimal power flows (ACOPFs), we illustrate one of the approaches in detail. For the time-varying ACOPF, we provide an upper bound for the difference between the optimal cost for a relaxation using the most recent data and the current approximate optimal cost generated by our algorithm. This bound is a function of the properties of the instance and the rate of change of the coefficients over time. Moreover, we also bound the number of floating-point operations to perform between two subsequent updates to ensure a bounded error.


title: Effective Audio Classification Network Based on Paired Inverse Pyramid Structure and Dense MLP Block

abstract: Recently, massive architectures based on Convolutional Neural Network (CNN) and self-attention mechanisms have become necessary for audio classification. While these techniques are state-of-the-art, these works' effectiveness can only be guaranteed with huge computational costs and parameters, large amounts of data augmentation, transfer from large datasets and some other tricks. By utilizing the lightweight nature of audio, we propose an efficient network structure called Paired Inverse Pyramid Structure (PIP) and a network called Paired Inverse Pyramid Structure MLP Network (PIPMN). The PIPMN reaches 96\% of Environmental Sound Classification (ESC) accuracy on the UrbanSound8K dataset and 93.2\% of Music Genre Classification (MGC) on the GTAZN dataset, with only 1 million parameters. Both of the results are achieved without data augmentation or model transfer. Public code is available at: https://github.com/JNAIC/PIPMN


title: Small Language Models for Tabular Data

abstract: Supervised deep learning is most commonly applied to difficult problems defined on large and often extensively curated datasets. Here we demonstrate the ability of deep representation learning to address problems of classification and regression from small and poorly formed tabular datasets by encoding input information as abstracted sequences composed of a fixed number of characters per input field. We find that small models have sufficient capacity for approximation of various functions and achieve record classification benchmark accuracy. Such models are shown to form useful embeddings of various input features in their hidden layers, even if the learned task does not explicitly require knowledge of those features. These models are also amenable to input attribution, allowing for an estimation of the importance of each input element to the model output as well as of which inputs features are effectively embedded in the model. We present a proof-of-concept for the application of small language models to mixed tabular data without explicit feature engineering, cleaning, or preprocessing, relying on the model to perform these tasks as part of the representation learning process.