title: Radiative decays of the spin-$2$ partner of $X(3872)$

abstract: It has been generally expected that the $X(3872)$ has a spin-2 partner, $X_2$, with quantum numbers $J^{PC}=2^{++}$. In the hadronic molecular model, its mass was predicted to be below the $D^*\bar D^*$ threshold, and the new structure reported in the $\gamma \psi(2S)$ invariant mass distribution by the Belle Collaboration with mass $M= (4014.3 \pm 4.0 \pm 1.5)$ MeV and decay width $\Gamma= (4 \pm 11 \pm 6)$ MeV, with a global significance of 2.8 $\sigma$, is a nice candidate for it. We consider the radiative decay widths for the $X_{2}\to \gamma\psi$ with $\psi=J/\psi, \psi(2S)$ treating the $X_2$ as a $D^*\bar{D}^*$ shallow bound state, and estimate the events of $X_2$ in two-photon collisions that can be collected in the $\gamma J/\psi\to\gamma\ell^+\ell^-$ ($\ell=e,\mu$) final states at Belle. Based on the upper limit for the ratio of decay widths of $X(3872)\to \gamma \psi(2S)$ and $X(3872)\to \gamma J/\psi$ measured by BESIII, we predict the similar ratio $\Gamma(X_2\to \gamma \psi(2S))/\Gamma(X_2\to \gamma J/\psi)$ to be smaller than $1.0$. We suggest searching for the $X_2$ signal in the $\gamma J/\psi$ invariant mass distribution via two-photon fusions. The results will lead to insights into both the $X(3872)$ and the new structure observed by Belle.


title: Sparse Bayesian Learning-Based 3D Spectrum Environment Map Construction-Sampling Optimization, Scenario-Dependent Dictionary Construction and Sparse Recovery

abstract: The spectrum environment map (SEM), which can visualize the information of invisible electromagnetic spectrum, is vital for monitoring, management, and security of spectrum resources in cognitive radio (CR) networks. In view of a limited number of spectrum sensors and constrained sampling time, this paper presents a new three-dimensional (3D) SEM construction scheme based on sparse Bayesian learning (SBL). Firstly, we construct a scenario-dependent channel dictionary matrix by considering the propagation characteristic of the interested scenario. To improve sampling efficiency, a maximum mutual information (MMI)-based optimization algorithm is developed for the layout of sampling sensors. Then, a maximum and minimum distance (MMD) clustering-based SBL algorithm is proposed to recover the spectrum data at the unsampled positions and construct the whole 3D SEM. We finally use the simulation data of the campus scenario to construct the 3D SEMs and compare the proposed method with the state-of-the-art. The recovery performance and the impact of different sparsity on the constructed SEMs are also analyzed. Numerical results show that the proposed scheme can reduce the required spectrum sensor number and has higher accuracy under the low sampling rate.


title: A Unified Framework for Soft Threshold Pruning

abstract: Soft threshold pruning is among the cutting-edge pruning methods with state-of-the-art performance. However, previous methods either perform aimless searching on the threshold scheduler or simply set the threshold trainable, lacking theoretical explanation from a unified perspective. In this work, we reformulate soft threshold pruning as an implicit optimization problem solved using the Iterative Shrinkage-Thresholding Algorithm (ISTA), a classic method from the fields of sparse recovery and compressed sensing. Under this theoretical framework, all threshold tuning strategies proposed in previous studies of soft threshold pruning are concluded as different styles of tuning $L_1$-regularization term. We further derive an optimal threshold scheduler through an in-depth study of threshold scheduling based on our framework. This scheduler keeps $L_1$-regularization coefficient stable, implying a time-invariant objective function from the perspective of optimization. In principle, the derived pruning algorithm could sparsify any mathematical model trained via SGD. We conduct extensive experiments and verify its state-of-the-art performance on both Artificial Neural Networks (ResNet-50 and MobileNet-V1) and Spiking Neural Networks (SEW ResNet-18) on ImageNet datasets. On the basis of this framework, we derive a family of pruning methods, including sparsify-during-training, early pruning, and pruning at initialization. The code is available at https://github.com/Yanqi-Chen/LATS.


title: DCLP: Neural Architecture Predictor with Curriculum Contrastive Learning

abstract: Neural predictors have shown great potential in the evaluation process of neural architecture search (NAS). However, current predictor-based approaches overlook the fact that training a predictor necessitates a considerable number of trained neural networks as the labeled training set, which is costly to obtain. Therefore, the critical issue in utilizing predictors for NAS is to train a high-performance predictor using as few trained neural networks as possible. Although some methods attempt to address this problem through unsupervised learning, they often result in inaccurate predictions. We argue that the unsupervised tasks intended for the common graph data are too challenging for neural networks, causing unsupervised training to be susceptible to performance crashes in NAS. To address this issue, we propose a Curricumum-guided Contrastive Learning framework for neural Predictor (DCLP). Our method simplifies the contrastive task by designing a novel curriculum to enhance the stability of unlabeled training data distribution during contrastive training. Specifically, we propose a scheduler that ranks the training data according to the contrastive difficulty of each data and then inputs them to the contrastive learner in order. This approach concentrates the training data distribution and makes contrastive training more efficient. By using our method, the contrastive learner incrementally learns feature representations via unsupervised data on a smooth learning curve, avoiding performance crashes that may occur with excessively variable training data distributions. We experimentally demonstrate that DCLP has high accuracy and efficiency compared with existing predictors, and shows promising potential to discover superior architectures in various search spaces when combined with search strategies. Our code is available at: https://github.com/Zhengsh123/DCLP.


title: A high-order discrete energy decay and maximum-principle preserving scheme for time fractional Allen-Cahn equation

abstract: The shifted fractional trapezoidal rule (SFTR) with a special shift is adopted to construct a finite difference scheme for the time-fractional Allen-Cahn (tFAC) equation. Some essential key properties of the weights of SFTR are explored for the first time. Based on these properties, we rigorously demonstrate the discrete energy decay property and maximum-principle preservation for the scheme. Numerical investigations show that the scheme can resolve the intrinsic initial singularity of such nonlinear fractional equations as tFAC equation on uniform meshes without any correction. Comparison with the classic fractional BDF2 and L2-1$_\sigma$ method further validates the superiority of SFTR in solving the tFAC equation. Experiments concerning both discrete energy decay and discrete maximum-principle also verify the correctness of the theoretical results.


title: Data Imputation for Sparse Radio Maps in Indoor Positioning (Extended Version)

abstract: Indoor location-based services rely on the availability of sufficiently accurate positioning in indoor spaces. A popular approach to positioning relies on so-called radio maps that contain pairs of a vector of Wi-Fi signal strength indicator values (RSSIs), called a fingerprint, and a location label, called a reference point (RP), in which the fingerprint was observed. The positioning accuracy depends on the quality of the radio maps and their fingerprints. Radio maps are often sparse, with many pairs containing vectors missing many RSSIs as well as RPs. Aiming to improve positioning accuracy, we present a complete set of techniques to impute such missing values in radio maps. We differentiate two types of missing RSSIs: missing not at random (MNAR) and missing at random (MAR). Specifically, we design a framework encompassing a missing RSSI differentiator followed by a data imputer for missing values. The differentiator identifies MARs and MNARs via clustering-based fingerprint analysis. Missing RSSIs and RPs are then imputed jointly by means of a novel encoder-decoder architecture that leverages temporal dependencies in data collection as well as correlations among fingerprints and RPs. A time-lag mechanism is used to consider the aging of data, and a sparsity-friendly attention mechanism is used to focus attention score calculation on observed data. Extensive experiments with real data from two buildings show that our proposal outperforms the alternatives with significant advantages in terms of imputation accuracy and indoor positioning accuracy.


title: Spectral decomposition of genuine cusp forms over global function fields

abstract: We prove the geometric Satake equivalence for \'etale metaplectic covers of reductive group schemes and extend the Langlands parametrization of V. Lafforgue to genuine cusp forms defined on their associated covering groups.


title: Failure-aware Policy Learning for Self-assessable Robotics Tasks

abstract: Self-assessment rules play an essential role in safe and effective real-world robotic applications, which verify the feasibility of the selected action before actual execution. But how to utilize the self-assessment results to re-choose actions remains a challenge. Previous methods eliminate the selected action evaluated as failed by the self-assessment rules, and re-choose one with the next-highest affordance~(i.e. process-of-elimination strategy [1]), which ignores the dependency between the self-assessment results and the remaining untried actions. However, this dependency is important since the previous failures might help trim the remaining over-estimated actions. In this paper, we set to investigate this dependency by learning a failure-aware policy. We propose two architectures for the failure-aware policy by representing the self-assessment results of previous failures as the variable state, and leveraging recurrent neural networks to implicitly memorize the previous failures. Experiments conducted on three tasks demonstrate that our method can achieve better performances with higher task success rates by less trials. Moreover, when the actions are correlated, learning a failure-aware policy can achieve better performance than the process-of-elimination strategy.


title: Autonomous Exploration and Mapping for Mobile Robots via Cumulative Curriculum Reinforcement Learning

abstract: Deep reinforcement learning (DRL) has been widely applied in autonomous exploration and mapping tasks, but often struggles with the challenges of sampling efficiency, poor adaptability to unknown map sizes, and slow simulation speed. To speed up convergence, we combine curriculum learning (CL) with DRL, and first propose a Cumulative Curriculum Reinforcement Learning (CCRL) training framework to alleviate the issue of catastrophic forgetting faced by general CL. Besides, we present a novel state representation, which considers a local egocentric map and a global exploration map resized to the fixed dimension, so as to flexibly adapt to environments with various sizes and shapes. Additionally, for facilitating the fast training of DRL models, we develop a lightweight grid-based simulator, which can substantially accelerate simulation compared to popular robot simulation platforms such as Gazebo. Based on the customized simulator, comprehensive experiments have been conducted, and the results show that the CCRL framework not only mitigates the catastrophic forgetting problem, but also improves the sample efficiency and generalization of DRL models, compared to general CL as well as without a curriculum. Our code is available at https://github.com/BeamanLi/CCRL_Exploration.


title: A Homotopy Invariant Based on Convex Dissection Topology and a Distance Optimal Path Planning Algorithm

abstract: The concept of path homotopy has received widely attention in the field of path planning in recent years. In this article, a homotopy invariant based on convex dissection for a two-dimensional bounded Euclidean space is developed, which can efficiently encode all homotopy path classes between any two points. Thereafter, the optimal path planning task consists of two steps: (i) search for the homotopy path class that may contain the optimal path, and (ii) obtain the shortest homotopy path in this class. Furthermore, an optimal path planning algorithm called CDT-RRT* (Rapidly-exploring Random Tree Star based on Convex Division Topology) is proposed. We designed an efficient sampling formula for CDT-RRT*, which gives it a tendency to actively explore unknown homotopy classes, and incorporated the principles of the Elastic Band algorithm to obtain the shortest path in each class. Through a series of experiments, it was determined that the performance of the proposed algorithm is comparable with state-of-the-art path planning algorithms. Hence, the application significance of the developed homotopy invariant in the field of path planning was verified.


title: Protecting quantum entanglement between error-corrected logical qubits

abstract: Entanglement represents one of the most important conceptual advances in physics during the last century and is also one of the most essential resources in quantum information science. However, entanglement is fragile and its potential advantages in applications are hindered by decoherence in practice. Here, we experimentally realize entangled logical qubits (ELQ) with a bosonic quantum module by encoding quantum information into spatially separated microwave modes. The entanglement is protected by repetitive quantum error correction, and the coherence time of the purified ELQ via error detection is improved by 45$\%$ compared with the unprotected ELQ and exceeds that of the entangled physical qubits. In addition, violation of the Bell inequality by logical qubits is demonstrated for the first time with the measured Bell signal B=2.250$\pm$0.019 after purification, surpassing the classical bound by 13 standard deviations. The protected ELQ could be applied in future explorations of quantum foundations and applications of quantum networks.


title: A Light-weight Deep Learning Model for Remote Sensing Image Classification

abstract: In this paper, we present a high-performance and light-weight deep learning model for Remote Sensing Image Classification (RSIC), the task of identifying the aerial scene of a remote sensing image. To this end, we first valuate various benchmark convolutional neural network (CNN) architectures: MobileNet V1/V2, ResNet 50/151V2, InceptionV3/InceptionResNetV2, EfficientNet B0/B7, DenseNet 121/201, ConNeXt Tiny/Large. Then, the best performing models are selected to train a compact model in a teacher-student arrangement. The knowledge distillation from the teacher aims to achieve high performance with significantly reduced complexity. By conducting extensive experiments on the NWPU-RESISC45 benchmark, our proposed teacher-student models outperforms the state-of-the-art systems, and has potential to be applied on a wide rage of edge devices.


title: MASS: Mobility-Aware Sensor Scheduling of Cooperative Perception for Connected Automated Driving

abstract: Timely and reliable environment perception is fundamental to safe and efficient automated driving. However, the perception of standalone intelligence inevitably suffers from occlusions. A new paradigm, Cooperative Perception (CP), comes to the rescue by sharing sensor data from another perspective, i.e., from a cooperative vehicle (CoV). Due to the limited communication bandwidth, it is essential to schedule the most beneficial CoV, considering both the viewpoints and communication quality. Existing methods rely on the exchange of meta-information, such as visibility maps, to predict the perception gains from nearby vehicles, which induces extra communication and processing overhead. In this paper, we propose a new approach, learning while scheduling, for distributed scheduling of CP. The solution enables CoVs to predict the perception gains using past observations, leveraging the temporal continuity of perception gains. Specifically, we design a mobility-aware sensor scheduling (MASS) algorithm based on the restless multi-armed bandit (RMAB) theory to maximize the expected average perception gain. An upper bound on the expected average learning regret is proved, which matches the lower bound of any online algorithm up to a logarithmic factor. Extensive simulations are carried out on realistic traffic traces. The results show that the proposed MASS algorithm achieves the best average perception gain and improves recall by up to 4.2 percentage points compared to other learning-based algorithms. Finally, a case study on a trace of LiDAR frames qualitatively demonstrates the superiority of adaptive exploration, the key element of the MASS algorithm.


title: Fractional Fourier Transforms Meet Riesz Potentials and Image Processing

abstract: Via chirp functions from fractional Fourier transforms, the authors introduce fractional Riesz potentials related to chirp functions, establish their relations with fractional Fourier transforms, fractional Laplace operators related to chirp functions, and fractional Riesz transforms related to chirp functions, and obtain their boundedness on rotation invariant spaces related to chirp functions. Finally, the authors give the numerical image simulation of fractional Riesz potentials related to chirp functions and their applications in image processing. The main novelty of this article is to propose a new image encryption method for the double phase coding based on the fractional Riesz potential related to chirp functions. The symbol of fractional Riesz potentials related to chirp functions essentially provides greater degrees of freedom and greatly makes the information more secure.


title: Cosecure Domination: Hardness Results and Algorithm

abstract: For a simple graph $G=(V,E)$ without any isolated vertex, a cosecure dominating set $D$ of $G$ satisfies the following two properties (i) $S$ is a dominating set of $G$, (ii) for every vertex $v \in S$ there exists a vertex $u \in V \setminus S$ such that $uv \in E$ and $(S \setminus \{v\}) \cup \{u\}$ is a dominating set of $G$. The minimum cardinality of a cosecure dominating set of $G$ is called cosecure domination number of $G$ and is denoted by $\gamma_{cs}(G)$. The Minimum Cosecure Domination problem is to find a cosecure dominating set of a graph $G$ of cardinality $\gamma_{cs}(G)$. The decision version of the problem is known to be NP-complete for bipartite, planar, and split graphs. Also, it is known that the Minimum Cosecure Domination problem is efficiently solvable for proper interval graphs and cographs. In this paper, we work on various important graph classes in an effort to reduce the complexity gap of the Minimum Cosecure Domination problem. We show that the decision version of the problem remains NP-complete for circle graphs, doubly chordal graphs, chordal bipartite graphs, star-convex bipartite graphs and comb-convex bipartite graphs. On the positive side, we give an efficient algorithm to compute the cosecure domination number of chain graphs, which is an important subclass of bipartite graphs. In addition, we show that the problem is linear-time solvable for bounded tree-width graphs. Further, we prove that the computational complexity of this problem varies from the domination problem.


title: SynGen: A Syntactic Plug-and-play Module for Generative Aspect-based Sentiment Analysis

abstract: Aspect-based Sentiment Analysis (ABSA) is a sentiment analysis task at fine-grained level. Recently, generative frameworks have attracted increasing attention in ABSA due to their ability to unify subtasks and their continuity to upstream pre-training tasks. However, these generative models suffer from the neighboring dependency problem that induces neighboring words to get higher attention. In this paper, we propose SynGen, a plug-and-play syntactic information aware module. As a plug-in module, our SynGen can be easily applied to any generative framework backbones. The key insight of our module is to add syntactic inductive bias to attention assignment and thus direct attention to the correct target words. To the best of our knowledge, we are the first one to introduce syntactic information to generative ABSA frameworks. Our module design is based on two main principles: (1) maintaining the structural integrity of backbone PLMs and (2) disentangling the added syntactic information and original semantic information. Empirical results on four popular ABSA datasets demonstrate that SynGen enhanced model achieves a comparable performance to the state-of-the-art model with relaxed labeling specification and less training consumption.


title: Speaker Recognition in Realistic Scenario Using Multimodal Data

abstract: In recent years, an association is established between faces and voices of celebrities leveraging large scale audio-visual information from YouTube. The availability of large scale audio-visual datasets is instrumental in developing speaker recognition methods based on standard Convolutional Neural Networks. Thus, the aim of this paper is to leverage large scale audio-visual information to improve speaker recognition task. To achieve this task, we proposed a two-branch network to learn joint representations of faces and voices in a multimodal system. Afterwards, features are extracted from the two-branch network to train a classifier for speaker recognition. We evaluated our proposed framework on a large scale audio-visual dataset named VoxCeleb$1$. Our results show that addition of facial information improved the performance of speaker recognition. Moreover, our results indicate that there is an overlap between face and voice.


title: Does Noise Affect Housing Prices? A Case Study in the Urban Area of Thessaloniki

abstract: Real estate markets depend on various methods to predict housing prices, including models that have been trained on datasets of residential or commercial properties. Most studies endeavor to create more accurate machine learning models by utilizing data such as basic property characteristics as well as urban features like distances from amenities and road accessibility. Even though environmental factors like noise pollution can potentially affect prices, the research around this topic is limited. One of the reasons is the lack of data. In this paper, we reconstruct and make publicly available a general purpose noise pollution dataset based on published studies conducted by the Hellenic Ministry of Environment and Energy for the city of Thessaloniki, Greece. Then, we train ensemble machine learning models, like XGBoost, on property data for different areas of Thessaloniki to investigate the way noise influences prices through interpretability evaluation techniques. Our study provides a new noise pollution dataset that not only demonstrates the impact noise has on housing prices, but also indicates that the influence of noise on prices significantly varies among different areas of the same city.


title: Collective dynamics and phase transition of active matter in presence of orientation adapters

abstract: In this work, the orientation adapter, a species of active particles that adapt their direction of motion from the other active particles, is introduced. The orientation adapters exist besides the usual Vicsek-like particles; both are self-driven, however, follow different interaction rules. We have studied the dynamics in high speed of the particles keeping dissimilar speeds for these different species. The effect of orientation adapters on the collective behaviour of the system is explored in this model. The orientational order-disorder phase transition is mainly studied in such systems. First, for equal density of both species, when the adapter speed $v_a=1.2v_0$ and usual particles speed $v_0=1.0$, both adapters and the usual particles form dense travelling bands and move in the same direction. Near the transition point, such bands appear and disappear over time, giving rise to the co-existence of two phases. The adapters and the usual particles both undergo a discontinuous transition. The nature of the transition is further confirmed by the existence of hysteresis in the order parameter under a continuously varying noise field. However, when the adapter velocity becomes much higher than the usual SPPs $v_a \approx 7v_0$, the formation of travelling bands disappears from the system, and the transition becomes continuous. The density ratio is also varied, keeping the velocities constant, and the phase transition is studied. For a high adapter velocity with $v_a=10v_0$, the continuous transition is found with low-density values of the adapters. The critical exponents related to the continuous transition are also determined.


title: Limited Query Graph Connectivity Test

abstract: We propose a combinatorial optimisation model called Limited Query Graph Connectivity Test. We consider a graph whose edges have two possible states (On/Off). The edges' states are hidden initially. We could query an edge to reveal its state. Given a source s and a destination t, we aim to test s-t connectivity by identifying either a path (consisting of only On edges) or a cut (consisting of only Off edges). We are limited to B queries, after which we stop regardless of whether graph connectivity is established. We aim to design a query policy that minimizes the expected number of queries. Our model is mainly motivated by a cyber security use case where we need to establish whether an attack path exists in a network, between a source and a destination. Edge query is resolved by manual effort from the IT admin, which is the motivation behind query minimization. Our model is highly related to monotone Stochastic Boolean Function Evaluation (SBFE). There are two existing exact algorithms for SBFE that are prohibitively expensive. We propose a significantly more scalable exact algorithm. While previous exact algorithms only scale for trivial graphs (i.e., past works experimented on at most 20 edges), we empirically demonstrate that our algorithm is scalable for a wide range of much larger practical graphs (i.e., Windows domain network graphs with tens of thousands of edges). We propose three heuristics. Our best-performing heuristic is via reducing the search horizon of the exact algorithm. The other two are via reinforcement learning (RL) and Monte Carlo tree search (MCTS). We also derive an anytime algorithm for computing the performance lower bound. Experimentally, we show that all our heuristics are near optimal. The exact algorithm based heuristic outperforms all, surpassing RL, MCTS and 8 existing heuristics ported from SBFE and related literature.


title: On the dimension of planar self-affine sets with non-invertible maps

abstract: In this paper, we study the dimension of planar self-affine sets, of which generating iterated function system (IFS) contains non-invertible affine mappings. We show that under a certain separation condition, the dimension equals to the affinity dimension for a typical choice of the linear parts of the non-invertible mappings, furthermore, we show that the dimension is strictly smaller than the affinity dimension for certain choices of parameters.


title: A Generalized Frequency Domain Embedded State Space Approach for Controller Synthesis

abstract: This paper develops a novel control synthesis approach for a wide class of practical systems. The control action is derived by inserting a compensator device in the forward path of the system that is to be controlled. The compensator design method is based on a state space system that is embedded in the frequency domain of the plant. It uses a nonlinear subspace that is the image of the compensator being used to determine the parameters of the compensator and modify system behavior. The coordinates of the state space system are taken as the compensator parameters. The method is capable of designing a compensator of arbitrary order to make the system comply with given stability performance requirements provided that these requirements can be geometrically interpreted in the frequency domain. The approach is developed and a proof of its ability to converge, if a solution exists, to the compensator tuning parameter set that satisfy the desired performance conditions is provided. A set of design examples are supplied to demonstrate the applicability of the approach to different types of linear, nonlinear, SISO and MIMO systems and system with delays.


title: Kernel Multi-Grid on Manifolds

abstract: Kernel methods for solving partial differential equations on surfaces have the advantage that those methods work intrinsically on the surface and yield high approximation rates if the solution to the partial differential equation is smooth enough. Naive implementations of kernel based methods suffer, however, from the cubic complexity in the degrees of freedom. Localized Lagrange bases have proven to overcome this computational complexity to some extend. In this article we present a rigorous proof for a geometric multigrid method with $\tau\ge 2$-cycle for elliptic partial differential equations on surfaces which is based on precomputed Lagrange basis functions. Our new multigrid provably works on quasi-uniform point clouds on the surface and hence does not require a grid-structure. Moreover, the computational cost scales log-linear in the degrees of freedom.


title: Spectral inequality for Dirac right triangles

abstract: We consider the Dirac operator on right triangles, subject to infinite-mass boundary conditions. We conjecture that the lowest positive eigenvalue is minimised by the isosceles right triangle both under the area or perimeter constraints. We prove this conjecture under extra geometric hypotheses relying on a recent approach of Ph. Briet and D. Krej{\v{c}}i{\v{r}}{\'i}k for Dirac rectangles [2].


title: Involutions on hyperelliptic curves and Prym maps

abstract: We investigate the geometry of smooth hyperelliptic curves that possess additional involutions, especially from the point of view of the Prym theory. Our main result is the injectivity of the Prym map for hyperelliptic $\mathbb{Z}_2^2$-coverings over hyperelliptic curves of positive genus.


title: Effect of time-varying electromagnetic field on Wiedemann-Franz law in a hot hadronic matter

abstract: We have estimated the electrical and thermal conductivity of a hadron resonance gas for a time-varying magnetic field, which is also compared with constant and zero magnetic field cases. Considering the exponential decay of electromagnetic fields with time, a kinetic theory framework can provide the microscopic expression of electrical and thermal conductivity in terms of relaxation and decay times. In the absence of the magnetic field, only a single time scale appears, and in the finite magnetic field case, their expressions carry two-time scales, relaxation time and cyclotron time period. Estimating the conductivities for HRG matter in three cases -- zero, constant, and time-varying magnetic fields, we have studied the validity of the Wiedemann-Franz law. We noticed that at a high-temperature domain, the ratio saturates at a particular value, which may be considered as Lorenz number of the hadron resonance gas. With respect to the saturation values, the deviation of the Wiedemann-Franz law has been quantified at the low-temperature domain. For the first time, the present work sketches this quantitative deviation of the Wiedemann-Franz law for hadron resonance gas at a constant and a time-varying magnetic field.


title: Strain-adjustable reflectivity of polyurethane nanofiber membrane for thermal management applications

abstract: Passive radiative cooling technologies are highly attractive in pursuing sustainable development. However, current cooling materials are often static, which makes it difficult to cope with the varying needs of all-weather thermal comfort management. Herein, a strategy is designed to obtain flexible thermoplastic polyurethane nanofiber (Es-TPU) membranes via electrospinning, realizing reversible in-situ solvent-free switching between radiative cooling and solar heating through changes in its optical reflectivity by stretching. In its radiative cooling state (0% strain), the Es-TPU membrane shows a high and angular-independent reflectance of 95.6% in the 0.25-2.5 {\mu}m wavelength range and an infrared emissivity of 93.3% in the atmospheric transparency window (8-13 {\mu}m), reaching a temperature drop of 10 {\deg}C at midday, with a corresponding cooling power of 118.25 W/m2. The excellent mechanical properties of the Es-TPU membrane allows the continuous adjustment of reflectivity by reversibly stretching it, reaching a reflectivity of 61.1% ({\Delta}R=34.5%) under an elongation strain of 80%, leading to a net temperature increase of 9.5 {\deg}C above ambient of an absorbing substrate and an equivalent power of 220.34 W/m2 in this solar heating mode. The strong haze, hydrophobicity and outstanding aging resistance exhibited by this scalable membrane hold promise for achieving uniform illumination with tunable strength and efficient thermal management in practical applications.


title: On the two-point function of the Ising model with infinite range-interactions

abstract: In this article, we prove some results concerning the truncated two-point function of the infinite-range Ising model above and below the critical temperature. More precisely, if the coupling constants are of the form $J_{x}= \psi(x)e^{ -\rho(x)}$ with $\rho$ some norm and $\psi$ an subexponential correction, we show under appropriate assumptions that given $s\in\mathbb{S}^{d-1}$, the Laplace transform of the two-point function in the direction $s$ is infinite for $\beta=\beta_{\text{sat}}(s)$ (where $\beta_{\text{sat}}(s)$ is a the biggest value such that the inverse correlation length $\nu_{\beta}(s)$ associated to the truncated two-point function is equal to $\rho(s)$ on $[0,\beta_{\text{sat}}(s)))$. Moreover, we prove that the two-point function satisfies Ornstein-Zernike asymptotics for $\beta=\beta_{\text{sat}}(s)$ on $\mathbb{Z}$. As far as we know, this constitutes the first result on the behaviour of the two-point function at $\beta_{\text{sat}}(s)$. Finally, we show that there exists $\beta_{0}$ such that for every $\beta>\beta_{0}$, $\nu_{\beta}(s)=\rho(s)$. All the results are new.


title: Geometric phase driven Josephson junction: Possible experimental scheme for the search of spin superfluidity

abstract: We use the Gross-Pitaevskii equation to study Josephson tunneling between two weakly coupled Bose-Einstein condensates, which compose spin-1 bosons. We show that a rotating magnetic field on one side can produce a phase difference across the junction, resulting in an oscillatory tunneling spin current. Besides numerical calculation, we derive analytical results in two extreme cases, namely the low- and high-frequency limits: in the low-frequency limit (magnetic field rotates adiabatically), a non-Abelian geometric phase arises and leads to the oscillatory spin current. By sharp contrast, the physics is intrinsically different in the high-frequency limit, where an average Zeeman energy difference leads to an oscillatory spin current. This proposed apparatus should be promising for the future experimental search of spin superfluidity.


title: In Search of Deep Learning Architectures for Load Forecasting: A Comparative Analysis and the Impact of the Covid-19 Pandemic on Model Performance

abstract: In power grids, short-term load forecasting (STLF) is crucial as it contributes to the optimization of their reliability, emissions, and costs, while it enables the participation of energy companies in the energy market. STLF is a challenging task, due to the complex demand of active and reactive power from multiple types of electrical loads and their dependence on numerous exogenous variables. Amongst them, special circumstances, such as the COVID-19 pandemic, can often be the reason behind distribution shifts of load series. This work conducts a comparative study of Deep Learning (DL) architectures, namely Neural Basis Expansion Analysis Time Series Forecasting (N-BEATS), Long Short-Term Memory (LSTM), and Temporal Convolutional Networks (TCN), with respect to forecasting accuracy and training sustainability, meanwhile examining their out-of-distribution generalization capabilities during the COVID-19 pandemic era. A Pattern Sequence Forecasting (PSF) model is used as baseline. The case study focuses on day-ahead forecasts for the Portuguese national 15-minute resolution net load time series. The results can be leveraged by energy companies and network operators (i) to reinforce their forecasting toolkit with state-of-the-art DL models; (ii) to become aware of the serious consequences of crisis events on model performance; (iii) as a high-level model evaluation, deployment, and sustainability guide within a smart grid context.


title: Quantum gravity -- an unfinished revolution

abstract: It is generally assumed that the search for a consistent and testable theory of quantum gravity is among the most important open problems of fundamental physics. I review the motivations for this search, the main problems on the way, and the status of present approaches and their physical relevance. I speculate on what the situation could be in 2050.


title: Human-in-the-Loop Schema Induction

abstract: Schema induction builds a graph representation explaining how events unfold in a scenario. Existing approaches have been based on information retrieval (IR) and information extraction(IE), often with limited human curation. We demonstrate a human-in-the-loop schema induction system powered by GPT-3. We first describe the different modules of our system, including prompting to generate schematic elements, manual edit of those elements, and conversion of those into a schema graph. By qualitatively comparing our system to previous ones, we show that our system not only transfers to new domains more easily than previous approaches, but also reduces efforts of human curation thanks to our interactive interface.


title: CASIA-Iris-Africa: A Large-scale African Iris Image Database

abstract: Iris biometrics is a phenotypic biometric trait that has proven to be agnostic to human natural physiological changes. Research on iris biometrics has progressed tremendously, partly due to publicly available iris databases. Various databases have been available to researchers that address pressing iris biometric challenges such as constraint, mobile, multispectral, synthetics, long-distance, contact lenses, liveness detection, etc. However, these databases mostly contain subjects of Caucasian and Asian docents with very few Africans. Despite many investigative studies on racial bias in face biometrics, very few studies on iris biometrics have been published, mainly due to the lack of racially diverse large-scale databases containing sufficient iris samples of Africans in the public domain. Furthermore, most of these databases contain a relatively small number of subjects and labelled images. This paper proposes a large-scale African database named CASIA-Iris-Africa that can be used as a complementary database for the iris recognition community to mediate the effect of racial biases on Africans. The database contains 28,717 images of 1023 African subjects (2046 iris classes) with age, gender, and ethnicity attributes that can be useful in demographically sensitive studies of Africans. Sets of specific application protocols are incorporated with the database to ensure the database's variability and scalability. Performance results of some open-source SOTA algorithms on the database are presented, which will serve as baseline performances. The relatively poor performances of the baseline algorithms on the proposed database despite better performance on other databases prove that racial biases exist in these iris recognition algorithms. The database will be made available on our website: http://www.idealtest.org.


title: Experimental Investigation on Particle-Laden Flows of Viscoelastic Fluids in Micro-Channels Using Optical Coherence Tomography

abstract: Considering the nonlinear response of non-Newtonian fluids to the local shear exerted on the bulks of fluid, the initially quasi-uniform distribution of the particles might be subject to alteration as well, due to the unbalanced force distribution on the particles. The current research investigates such particle migrations for flows of Viscoelastic Fluids (VEFs) in a straight micro-channel with a 1 by 3.25 mm rectangular cross-section. Polyacrylamide polymer in concentrations of 210 and 250 ppm have been used, where the heavy, linear, long-chain structure of the polymer introduces elasticity to the fluid. The flow measurements are performed using the state-of-the-art Optical Coherence Tomography (OCT) in 2D acquisition and doppler modes (D-OCT) to simultaneously resolve tomographic velocity field, and the transition of particles through the monitored cross-sections. Through the implementation of the experimental method in the current manuscript, the capability and convenience of using OCT for the problem at hand are demonstrated, as the abovementioned obtained data were to be equivalently captured by simultaneous use of Particle Image Velocimetry (PIV), for the ambient medium velocity field, and Lagrangian Particle Tracking (LPT) schemes, for identification and tracking the position of the particles. The velocity field is obtained with the spatial resolution of 2.58um in the depth direction, and through sub-pixel image processing, highly accurate positioning of the particles is realized. The experimental results are then used for statistical calculations, such as the Probability Distribution Function (PDF) of the cross-sectional map of the space frequented by the particles to explain the underlying physics.


title: Suspension Analysis and Selective Continuation-Passing Style for Universal Probabilistic Programming Languages

abstract: Universal probabilistic programming languages (PPLs) make it relatively easy to encode and automatically solve statistical inference problems. To solve inference problems, PPL implementations often apply Monte Carlo inference algorithms that rely on execution suspension. State-of-the-art solutions enable execution suspension either through (i) continuation-passing style (CPS) transformations or (ii) efficient, but comparatively complex, low-level solutions that are often not available in high-level languages. CPS transformations introduce overhead due to unnecessary closure allocations -- a problem the PPL community has generally overlooked. To reduce overhead, we develop a new efficient selective CPS approach for PPLs. Specifically, we design a novel static suspension analysis technique that determines parts of programs that require suspension, given a particular inference algorithm. The analysis allows selectively CPS transforming the program only where necessary. We formally prove the correctness of the analysis and implement the analysis and transformation in the Miking CorePPL compiler. We evaluate the implementation for a large number of Monte Carlo inference algorithms on real-world models from phylogenetics, epidemiology, and topic modeling. The evaluation results demonstrate significant improvements across all models and inference algorithms.


title: Efimov K-theory and universal localizing invariant

abstract: We give some basic properties of Efimov K-theory. In particular, Efimov K-theory is corepresentable, lax symmetric monoidal functor, preserves any small products and sends Milnor squares satisfying base change to cartesian squares.


title: Scalable Neural Network Training over Distributed Graphs

abstract: Graph neural networks (GNNs) fuel diverse machine learning tasks involving graph-structured data, ranging from predicting protein structures to serving personalized recommendations. Real-world graph data must often be stored distributed across many machines not just because of capacity constraints, but because of compliance with data residency or privacy laws. In such setups, network communication is costly and becomes the main bottleneck to train GNNs. Optimizations for distributed GNN training have targeted data-level improvements so far -- via caching, network-aware partitioning, and sub-sampling -- that work for data center-like setups where graph data is accessible to a single entity and data transfer costs are ignored. We present RETEXO, the first framework which eliminates the severe communication bottleneck in distributed GNN training while respecting any given data partitioning configuration. The key is a new training procedure, lazy message passing, that reorders the sequence of training GNN elements. RETEXO achieves 1-2 orders of magnitude reduction in network data costs compared to standard GNN training, while retaining accuracy. RETEXO scales gracefully with increasing decentralization and decreasing bandwidth. It is the first framework that can be used to train GNNs at all network decentralization levels -- including centralized data-center networks, wide area networks, proximity networks, and edge networks.


title: Charting mobility patterns in the scientific knowledge landscape

abstract: From small steps to great leaps, metaphors of spatial mobility abound to describe discovery processes. Here, we ground these ideas in formal terms by systematically studying scientific knowledge mobility patterns. We use low-dimensional embedding techniques to create a knowledge space made up of 1.5 million articles from the fields of physics, computer science, and mathematics. By analyzing the publication histories of individual researchers, we discover patterns of knowledge mobility that closely resemble physical mobility. In aggregate, the trajectories form mobility flows that can be described by a gravity model, with jumps more likely to occur in areas of high density and less likely to occur over longer distances. We identify two types of researchers from their individual mobility patterns: interdisciplinary explorers who pioneer new fields, and exploiters who are more likely to stay within their specific areas of expertise. Our results suggest that spatial mobility analysis is a valuable tool for understanding knowledge evolution.


title: Cybersickness, Cognition, & Motor Skills: The Effects of Music, Gender, and Gaming Experience

abstract: Recent research has attempted to identify methods to mitigate cybersickness and examine its aftereffects. In this direction, this paper examines the effects of cybersickness on cognitive, motor, and reading performance in VR. Also, this paper evaluates the mitigating effects of music on cybersickness, as well as the role of gender, and the computing, VR, and gaming experience of the user. This paper reports two studies. In this study, 39 participants performed an assessment four times, once before the rides (baseline), and then once after each ride (3 rides). In each ride either Calming, or Joyful, or No Music was played. During each ride, linear and angular accelerations took place to induce cybersickness in the participants. In each assessment, while immersed in VR, the participants evaluated their cybersickness symptomatology and performed a verbal working memory task, a visuospatial working memory task, and a psychomotor task. While responding to the cybersickness questionnaire (3D UI), eye-tracking was conducted to measure reading time and pupillometry. The results showed that Joyful and Calming music substantially decreased the intensity of nausea-related symptoms. However, only Joyful music significantly decreased the overall cybersickness intensity. Importantly, cybersickness was found to decrease verbal working memory performance and pupil size. Also, it significantly decelerated psychomotor (reaction time) and reading abilities. Higher gaming experience was associated with lower cybersickness. When controlling for gaming experience, there were no significant differences between female and male participants in terms of cybersickness. The outcomes indicated the efficiency of music in mitigating cybersickness, the important role of gaming experience in cybersickness, and the significant effects of cybersickness on pupil size, cognition, psychomotor skills, and reading ability.


title: SATBA: An Invisible Backdoor Attack Based On Spatial Attention

abstract: Backdoor attack has emerged as a novel and concerning threat to AI security. These attacks involve the training of Deep Neural Network (DNN) on datasets that contain hidden trigger patterns. Although the poisoned model behaves normally on benign samples, it exhibits abnormal behavior on samples containing the trigger pattern. However, most existing backdoor attacks suffer from two significant drawbacks: their trigger patterns are visible and easy to detect by backdoor defense or even human inspection, and their injection process results in the loss of natural sample features and trigger patterns, thereby reducing the attack success rate and model accuracy. In this paper, we propose a novel backdoor attack named SATBA that overcomes these limitations using spatial attention and an U-net based model. The attack process begins by using spatial attention to extract meaningful data features and generate trigger patterns associated with clean images. Then, an U-shaped model is used to embed these trigger patterns into the original data without causing noticeable feature loss. We evaluate our attack on three prominent image classification DNN across three standard datasets. The results demonstrate that SATBA achieves high attack success rate while maintaining robustness against backdoor defenses. Furthermore, we conduct extensive image similarity experiments to emphasize the stealthiness of our attack strategy. Overall, SATBA presents a promising approach to backdoor attack, addressing the shortcomings of previous methods and showcasing its effectiveness in evading detection and maintaining high attack success rate.


title: DeepBrainPrint: A Novel Contrastive Framework for Brain MRI Re-Identification

abstract: Recent advances in MRI have led to the creation of large datasets. With the increase in data volume, it has become difficult to locate previous scans of the same patient within these datasets (a process known as re-identification). To address this issue, we propose an AI-powered medical imaging retrieval framework called DeepBrainPrint, which is designed to retrieve brain MRI scans of the same patient. Our framework is a semi-self-supervised contrastive deep learning approach with three main innovations. First, we use a combination of self-supervised and supervised paradigms to create an effective brain fingerprint from MRI scans that can be used for real-time image retrieval. Second, we use a special weighting function to guide the training and improve model convergence. Third, we introduce new imaging transformations to improve retrieval robustness in the presence of intensity variations (i.e. different scan contrasts), and to account for age and disease progression in patients. We tested DeepBrainPrint on a large dataset of T1-weighted brain MRIs from the Alzheimer's Disease Neuroimaging Initiative (ADNI) and on a synthetic dataset designed to evaluate retrieval performance with different image modalities. Our results show that DeepBrainPrint outperforms previous methods, including simple similarity metrics and more advanced contrastive deep learning frameworks.


title: First-principles study of electronic and optical properties in 1-D oligomeric derivatives of telomestatin

abstract: Real-space self-interaction corrected (time-dependent) density functional theory has been used to investigate the ground-state electronic structure and optical absorption profiles of a series of linear oligomers inspired by the natural product telomestatin. Length-dependent development of plasmonic excitations in the UV region is seen in the neutral species which is augmented by polaron-type absorption in the IR when the chains are doped with an additional electron/hole. Combined with a lack of absorption in the visible region this suggests these oligomers as good candidates for applications such as transparent antennae in dye-sensitised solar energy collection materials.


title: Intrinsic minimum average variance estimation for sufficient dimension reduction with symmetric positive definite matrices and beyond

abstract: In this paper, we target the problem of sufficient dimension reduction with symmetric positive definite matrices valued responses. We propose the intrinsic minimum average variance estimation method and the intrinsic outer product gradient method which fully exploit the geometric structure of the Riemannian manifold where responses lie. We present the algorithms for our newly developed methods under the log-Euclidean metric and the log-Cholesky metric. Each of the two metrics is linked to an abelian Lie group structure that transforms our model defined on a manifold into a Euclidean one. The proposed methods are then further extended to general Riemannian manifolds. We establish rigourous asymptotic results for the proposed estimators, including the rate of convergence and the asymptotic normality. We also develop a cross validation algorithm for the estimation of the structural dimension with theoretical guarantee Comprehensive simulation studies and an application to the New York taxi network data are performed to show the superiority of the proposed methods.


title: New bounds on the cardinality of n-Hausdorff and n-Urysohn spaces

abstract: Two new cardinal functions defined in the class of $n$-Hausdorff and $n$-Urysohn spaces that extend pseudocharacter and closed pseudocharacter respectively are introduced. Through these new functions bounds on the cardinality of $n$-Urysohn spaces that represent variations of known results are given. Also properties of $n$-Urysohn $n$-H-closed spaces are proved.


title: Non-LTE analysis for Helium and Strontium lines in the kilonova AT2017gfo

abstract: Kilonova spectra imprint valuable information about the elements synthesized in neutron star mergers. In AT2017gfo, the kilonova associated with GW170817, the spectroscopic feature centered around 8000 angstroms has been interpreted as the P-Cygni profile arising from singly ionized Strontium. Recently, Perego et al. (2022) suggested that Helium 10833 line can be an alternative explanation of the feature. Here, we study the line features under non-local thermodynamic equilibrium. We find that the ionization of ejecta by the stopping of radioactive decay product can significantly enhance the ionization states around the line forming region. We compute the kilonova spectrum under the assumption of spherical symmetry and uniform elemental fraction in the line-forming region. We find that 0.2\% (in mass) of Helium in the ejecta can reproduce the P-Cygni feature in the observed spectrum at $1.43$ -- $4.40$ days. Strontium with a mass fraction of $1\%$ is also able to make the absorption feature at $\sim 1.5\,$days, but it gets weaker with time due to ionization by radioactive decay products. The strength of the He line signature depends sensitively on UV strength for the first two epochs. Further modeling of UV line blanketing by $r$-process elements and the optical properties of light $r$-process elements would be crucial to distinguish between Helium and Strontium features. The mass fraction of He is a good indicator for ejecta entropy that allows us to probe the mass ejection mechanism.


title: Optical and atomic decoherence in entangled atomic ensembles generated by quantum nondemolition measurements

abstract: We study the effects of decoherence in the form of optical phase diffusion, photon loss and gain, and atomic dephasing in entangled atomic ensembles produced via quantum nondemolition (QND) measurements. For the optical decoherence channels, we use the technique of integration within ordered operators (IWOP) to obtain the Kraus operators that describe the decoherence. We analyze the effect of different decoherence channels on a variety of quantities such as the variances of the spin operators, entanglement and correlation criteria, logarithmic negativity, and the Bell-CHSH inequality. We generally find a smooth decay of correlations and entanglement in the presence of decoherence. We find that various quantities retain showing non-classical properties under all three types of decoherence, in the short interaction time range. Our results show that such QND measurements are one of the most promising methods for entanglement generation between two Bose-Einstein condensates.


title: Time-Variance Aware Real-Time Speech Enhancement

abstract: Time-variant factors often occur in real-world full-duplex communication applications. Some of them are caused by the complex environment such as non-stationary environmental noises and varying acoustic path while some are caused by the communication system such as the dynamic delay between the far-end and near-end signals. Current end-to-end deep neural network (DNN) based methods usually model the time-variant components implicitly and can hardly handle the unpredictable time-variance in real-time speech enhancement. To explicitly capture the time-variant components, we propose a dynamic kernel generation (DKG) module that can be introduced as a learnable plug-in to a DNN-based end-to-end pipeline. Specifically, the DKG module generates a convolutional kernel regarding to each input audio frame, so that the DNN model is able to dynamically adjust its weights according to the input signal during inference. Experimental results verify that DKG module improves the performance of the model under time-variant scenarios, in the joint acoustic echo cancellation (AEC) and deep noise suppression (DNS) tasks.


title: $\mathcal{PT}-$symmetry and chaos control via dissipative optomechanical coupling

abstract: We study a dissipative, mechanically coupled optomechanical system that accommodates gain and loss. The gain (loss) is engineered by driven a purely dispersive optomechanical cavity with a blue-detuned (red-detuned) electromagnetic field. By taking into account the dissipative coupling, the Exceptional Point (EP), which is the $\mathcal{PT}-$symmetry phase transition, occurs at low threshold driving strength compared to the purely dispersive system. In the linear regime, the $\mathcal{PT}-$symmetry is unbroken and the dissipative coupling induces strong coupling between the mechanical resonators, leading to an increase in energy exchange. For sufficiently strong driving, the system enters into a nonlinear regime where the $\mathcal{PT}-$symmetry is broken. In this regime, the mechanical resonators exhibit chaotic beats like-behaviour in the purely dispersive system. By switching on the dissipative coupling, the complex dynamics is switched off, restoring regular dynamics to the system. This work suggests ways to probe quantum phenomena in dissipative $\mathcal{PT}-$symmetric systems at low-threshold driving strength. It also provides a new way to control complex dynamics in optomechanics and related fields.


title: Entangled probability distributions

abstract: Concept of entangled probability distribution of several random variables is introduced. These probability distributions describe multimode quantum states in probability representation of quantum mechanics. Example of entangled probability distribution is considered.


title: Estimating Fiscal Multipliers by Combining Statistical Identification with Potentially Endogenous Proxies

abstract: Different proxy variables used in fiscal policy SVARs lead to contradicting conclusions regarding the size of fiscal multipliers. We show that the conflicting results are due to violations of the exogeneity assumptions, i.e. the commonly used proxies are endogenously related to the structural shocks. We propose a novel approach to include proxy variables into a Bayesian non-Gaussian SVAR, tailored to accommodate for potentially endogenous proxy variables. Using our model, we show that increasing government spending is a more effective tool to stimulate the economy than reducing taxes.


title: Polarization and Greedy Energy on the Sphere

abstract: We investigate the behavior of a greedy sequence on the sphere $\mathbb{S}^d$ defined so that at each step the point that minimizes the Riesz $s$-energy is added to the existing set of points. We show that for $0<s<d$, the greedy sequence achieves optimal second-order behavior for the Riesz $s$-energy (up to constants). In order to obtain this result, we prove that the second-order term of the maximal polarization with Riesz $s$-kernels is of order $N^{s/d}$ in the same range $0<s<d$. Furthermore, using the Stolarsky principle relating the $L^2$-discrepancy of a point set with the pairwise sum of distances (Riesz energy with $s=-1$), we also obtain a simple upper bound on the $L^2$-spherical cap discrepancy of the greedy sequence and give numerical examples that indicate that the true discrepancy is much lower.


title: Classifying solutions of ${\rm SU}(n+1)$ Toda system around a singular source

abstract: Consider a positive integer $n$ and $\gamma_1>-1,\cdots,\gamma_n>-1$. Let $D=\{z\in {\Bbb C}:|z|<1\}$, and let $(a_{ij})_{n\times n}$ denote the Cartan matrix of $\frak{su}(n+1)$. Utilizing the ordinary differential equation of $(n+1)$th order around a singular source of ${\rm SU}(n+1)$ Toda system, as discovered by Lin-Wei-Ye ({\it Invent Math}, {\bf 190}(1):169-207, 2012), we precisely characterize a solution $(u_1,\cdots, u_n)$ to the ${\rm SU}(n+1)$ Toda system \begin{equation*} \begin{cases} \frac{\partial^2 u_i}{\partial z\partial \bar z}+\sum_{j=1}^n a_{ij} e^{u_j}&=\pi \gamma _i\delta _0\,\,{\rm on}\,\, D\\ \frac{\sqrt{-1}}{2}\,\int_{D\backslash \{0\}} e^{u_{i} }{\rm d}z\wedge {\rm d}\bar z &< \infty \end{cases} \quad \text{for all}\quad i=1,\cdots, n \end{equation*} using $(n+1)$ holomorphic functions that satisfy the normalized condition. Additionally, we demonstrate that for each $1\leq i\leq n$, $0$ represents the cone singularity with angle $2\pi(1+\gamma_i)$ for the metric $e^{u_i}|{\rm d}z|^2$ on $D\backslash\{0\}$, which can be locally characterized by $(n-1)$ non-vanishing holomorphic functions at $0$.


title: Medical visual question answering using joint self-supervised learning

abstract: Visual Question Answering (VQA) becomes one of the most active research problems in the medical imaging domain. A well-known VQA challenge is the intrinsic diversity between the image and text modalities, and in the medical VQA task, there is another critical problem relying on the limited size of labelled image-question-answer data. In this study we propose an encoder-decoder framework that leverages the image-text joint representation learned from large-scaled medical image-caption data and adapted to the small-sized medical VQA task. The encoder embeds across the image-text dual modalities with self-attention mechanism and is independently pre-trained on the large-scaled medical image-caption dataset by multiple self-supervised learning tasks. Then the decoder is connected to the top of the encoder and fine-tuned using the small-sized medical VQA dataset. The experiment results present that our proposed method achieves better performance comparing with the baseline and SOTA methods.


title: Elicitability of Return Risk Measures

abstract: Informally, a risk measure is said to be elicitable if there exists a suitable scoring function such that minimizing its expected value recovers the risk measure. In this paper, we analyze the elicitability properties of the class of return risk measures (i.e., normalized, monotone and positively homogeneous risk measures). First, we provide dual representation results for convex and geometrically convex return risk measures. Next, we establish new axiomatic characterizations of Orlicz premia (i.e., Luxemburg norms). More specifically, we prove, under different sets of conditions, that Orlicz premia naturally arise as the only elicitable return risk measures. Finally, we provide a general family of strictly consistent scoring functions for Orlicz premia, a myriad of specific examples and a mixture representation suitable for constructing Murphy diagrams.


title: Production and decay of polarized hyperon-antihyperon pairs

abstract: Polarized hyperon-antihyperon pairs shed light on various unresolved puzzles in contemporary physics: How the strong interaction confines quarks into hadrons, how accurately the Standard Model describes microcosmos and even why our universe consists of so much more matter than antimatter. Thanks to their weak, parity violating decays, hyperons reveal their spin properties. This can be exploited e.g. the decomposition of the electromagnetic structure of hyperons, precision tests of flavour symmetry and searches for CP violation. At the BESIII experiment at BEPC-II, Beijing, China, hyperon-antihyperon pairs can be produced in abundance. Recently collected large data samples have triggered the development of new methods that provide unprecedented precision and a plethora of new results have emerged. When applied at future high-intensity facilities like PANDA and STCF, precision physics will be taken to a new level which can contribute to the solution to the aforementioned puzzles.


title: Supersolvability of built lattices and Koszulness of generalized Chow rings

abstract: We give an explicit quadratic Grobner basis for generalized Chow rings of supersolvable built lattices, with the help of the operadic structure on geometric lattices introduced in a previous article. This shows that the generalized Chow rings associated to minimal building sets of supersolvable lattices are Koszul. As another consequence, we get that the cohomology algebras of the components of the extended modular operad in genus 0 are Koszul.


title: Feedback Capacity of the Continuous-Time ARMA(1,1) Gaussian Channel

abstract: We consider the continuous-time ARMA(1,1) Gaussian channel and derive its feedback capacity in closed form. More specifically, the channel is given by $\boldsymbol{y}(t) =\boldsymbol{x}(t) +\boldsymbol{z}(t)$, where the channel input $\{\boldsymbol{x}(t) \}$ satisfies average power constraint $P$ and the noise $\{\boldsymbol{z}(t)\}$ is a first-order {\em autoregressive moving average} (ARMA(1,1)) Gaussian process satisfying $$ \boldsymbol{z}^\prime(t)+\kappa \boldsymbol{z}(t)=(\kappa+\lambda)\boldsymbol{w}(t)+\boldsymbol{w}^\prime(t), $$ where $\kappa>0,~\lambda\in\mathbb{R}$ and $\{\boldsymbol{w}(t) \}$ is a white Gaussian process with unit double-sided spectral density. We show that the feedback capacity of this channel is equal to the unique positive root of the equation $$ P(x+\kappa)^2 = 2x(x+\vert \kappa+\lambda\vert)^2 $$ when $-2\kappa<\lambda<0$ and is equal to $P/2$ otherwise. Among many others, this result shows that, as opposed to a discrete-time additive Gaussian channel, feedback may not increase the capacity of a continuous-time additive Gaussian channel even if the noise process is colored. The formula enables us to conduct a thorough analysis of the effect of feedback on the capacity for such a channel. We characterize when the feedback capacity equals or doubles the non-feedback capacity; moreover, we disprove continuous-time analogues of the half-bit bound and Cover's $2P$ conjecture for discrete-time additive Gaussian channels.


title: Temporal Segment Transformer for Action Segmentation

abstract: Recognizing human actions from untrimmed videos is an important task in activity understanding, and poses unique challenges in modeling long-range temporal relations. Recent works adopt a predict-and-refine strategy which converts an initial prediction to action segments for global context modeling. However, the generated segment representations are often noisy and exhibit inaccurate segment boundaries, over-segmentation and other problems. To deal with these issues, we propose an attention based approach which we call \textit{temporal segment transformer}, for joint segment relation modeling and denoising. The main idea is to denoise segment representations using attention between segment and frame representations, and also use inter-segment attention to capture temporal correlations between segments. The refined segment representations are used to predict action labels and adjust segment boundaries, and a final action segmentation is produced based on voting from segment masks. We show that this novel architecture achieves state-of-the-art accuracy on the popular 50Salads, GTEA and Breakfast benchmarks. We also conduct extensive ablations to demonstrate the effectiveness of different components of our design.


title: BOP Challenge 2022 on Detection, Segmentation and Pose Estimation of Specific Rigid Objects

abstract: We present the evaluation methodology, datasets and results of the BOP Challenge 2022, the fourth in a series of public competitions organized with the goal to capture the status quo in the field of 6D object pose estimation from an RGB/RGB-D image. In 2022, we witnessed another significant improvement in the pose estimation accuracy -- the state of the art, which was 56.9 AR$_C$ in 2019 (Vidal et al.) and 69.8 AR$_C$ in 2020 (CosyPose), moved to new heights of 83.7 AR$_C$ (GDRNPP). Out of 49 pose estimation methods evaluated since 2019, the top 18 are from 2022. Methods based on point pair features, which were introduced in 2010 and achieved competitive results even in 2020, are now clearly outperformed by deep learning methods. The synthetic-to-real domain gap was again significantly reduced, with 82.7 AR$_C$ achieved by GDRNPP trained only on synthetic images from BlenderProc. The fastest variant of GDRNPP reached 80.5 AR$_C$ with an average time per image of 0.23s. Since most of the recent methods for 6D object pose estimation begin by detecting/segmenting objects, we also started evaluating 2D object detection and segmentation performance based on the COCO metrics. Compared to the Mask R-CNN results from CosyPose in 2020, detection improved from 60.3 to 77.3 AP$_C$ and segmentation from 40.5 to 58.7 AP$_C$. The online evaluation system stays open and is available at: \href{http://bop.felk.cvut.cz/}{bop.felk.cvut.cz}.


title: Order in Innovation

abstract: Is calendar time the true clock of innovation? By combining complexity science with innovation economics and using vaccine datasets containing over three million citations and eight regulatory authorisations, we discover that calendar time and network order describe innovation progress at varying accuracy. First, we present a method to establish a mathematical link between technological evolution and complex networks. The result is a path of events that narrates innovation bottlenecks. Next, we quantify the position and proximity of documents to these innovation paths and find that research, by and large, proceed from basic research, applied research, development, to commercialisation. By extension, we are able to causally quantify the participation of innovation funders. When it comes to vaccine innovation, diffusion-oriented entities are preoccupied with basic, later-stage research; biopharmaceuticals tend to participate in applied development activities and clinical trials at the later-stage; while mission-oriented entities tend to initiate early-stage research. Future innovation programs and funding allocations would benefit from better understanding innovation orders.


title: Non-autonomous double phase eigenvalue problems with indefinite weight and lack of compactness

abstract: In this paper, we consider eigenvalues to the following double phase problem with unbalanced growth and indefinite weight, $$ -\Delta_p^a u-\Delta_q u =\lambda m(x) |u|^{q-2}u \quad \mbox{in} \,\, \R^N, $$ where {$N \geq 2$}, {$1<p, q<N$, $p \neq q$}, ${a \in C^{0, 1}(\R^N, [0, +\infty))}$, $a \not\equiv 0$ and $m: \R^N \to \R$ is {an indefinite sign weight which may admit nontrivial positive and negative parts}. Here $\Delta_q$ is the $q$-Laplacian operator and $\Delta_p^a$ is the weighted $p$-Laplace operator defined by $\Delta_p^a u:=\textnormal{div}(a(x) |\nabla u|^{p-2} \nabla u)$. The problem can be degenerate, in the sense that the infimum of $a$ in $\R^N$ may be zero. Our main results distinguish between the cases $p<q$ and $q<p$. In the first case, we establish the existence of a {\it continuous} family of eigenvalues, starting from the principal frequency of a suitable single phase eigenvalue problem. In the latter case, we prove the existence of a {\it discrete} family of positive eigenvalues, which diverges to infinity.


title: Lower Bounds for the Advection-Hyperdiffusion Equation

abstract: Motivated by [7], we study the advection-hyperdiffusion equation in the whole space in two and three dimensions with the goal of understanding the decay in time of the $H^{-1}$- and $L^2$-norm of the solutions. We view the advection term as a perturbation of the hyperdiffusion equation and employ the Fourier-splitting method first introduced by Schonbek in [8] for scalar parabolic equations and later generalized to a broader class of equations including Navier-Stokes equations and magneto-hydrodynamic systems. This approach consists of decomposing the Fourier space along a sphere with radius decreasing in time. Combining the Fourier-splitting method with classical PDE techniques applied to the hyperdiffusion equation we find a lower bound for the $H^{-1}$-norm by interpolation.


title: Privacy-Preserving Electricity Theft Detection based on Blockchain

abstract: In most electricity theft detection schemes, consumers' power consumption data is directly input into the detection center. Although it is valid in detecting the theft of consumers, the privacy of all consumers is at risk unless the detection center is assumed to be trusted. In fact, it is impractical. Moreover, existing schemes may result in some security problems, such as the collusion attack due to the presence of a trusted third party, and malicious data tampering caused by the system operator (SO) being attacked. Aiming at the problems above, we propose a blockchain-based privacy-preserving electricity theft detection scheme without a third party. Specifically, the proposed scheme uses an improved functional encryption scheme to enable electricity theft detection and load monitoring while preserving consumers' privacy; distributed storage of consumers' data with blockchain to resolve security problems such as data tampering, etc. Meanwhile, we build a long short-term memory network (LSTM) model to perform higher accuracy for electricity theft detection. The proposed scheme is evaluated in a real environment, and the results show that it is more accurate in electricity theft detection within acceptable communication and computational overhead. Our system analysis demonstrates that the proposed scheme can resist various security attacks and preserve consumers' privacy.


title: Does a Neural Network Really Encode Symbolic Concepts?

abstract: Recently, a series of studies have tried to extract interactions between input variables modeled by a DNN and define such interactions as concepts encoded by the DNN. However, strictly speaking, there still lacks a solid guarantee whether such interactions indeed represent meaningful concepts. Therefore, in this paper, we examine the trustworthiness of interaction concepts from four perspectives. Extensive empirical studies have verified that a well-trained DNN usually encodes sparse, transferable, and discriminative concepts, which is partially aligned with human intuition.


title: Isolated Suborders and their Application to Counting Closure Operators

abstract: In this paper we investigate the interplay between isolated suborders and closures. Isolated suborders are a special kind of suborders and can be used to diminish the number of elements of an ordered set by means of a quotient construction. The decisive point is that there are simple formulae establishing relationships between the number of closures in the original ordered set and the quotient thereof induced by isolated suborders. We show how these connections can be used to derive a recursive algorithm for counting closures, provided the ordered set under consideration contains suitable isolated suborders.


title: A Threat-Intelligence Driven Methodology to Incorporate Uncertainty in Cyber Risk Analysis and Enhance Decision Making

abstract: The challenge of decision-making under uncertainty in information security has become increasingly important, given the unpredictable probabilities and effects of events in the ever-changing cyber threat landscape. Cyber threat intelligence provides decision-makers with the necessary information and context to understand and anticipate potential threats, reducing uncertainty and improving the accuracy of risk analysis. The latter is a principal element of evidence-based decision-making, and it is essential to recognize that addressing uncertainty requires a new, threat-intelligence driven methodology and risk analysis approach. We propose a solution to this challenge by introducing a threat-intelligence based security assessment methodology and a decision-making strategy that considers both known unknowns and unknown unknowns. The proposed methodology aims to enhance the quality of decision-making by utilizing causal graphs, which offer an alternative to conventional methodologies that rely on attack trees, resulting in a reduction of uncertainty. Furthermore, we consider tactics, techniques, and procedures that are possible, probable, and plausible, improving the predictability of adversary behavior. Our proposed solution provides practical guidance for information security leaders to make informed decisions in uncertain situations. This paper offers a new perspective on addressing the challenge of decision-making under uncertainty in information security by introducing a methodology that can help decision-makers navigate the intricacies of the dynamic and continuously evolving landscape of cyber threats.


title: Knowledge Graph Completion with Counterfactual Augmentation

abstract: Graph Neural Networks (GNNs) have demonstrated great success in Knowledge Graph Completion (KGC) by modeling how entities and relations interact in recent years. However, most of them are designed to learn from the observed graph structure, which appears to have imbalanced relation distribution during the training stage. Motivated by the causal relationship among the entities on a knowledge graph, we explore this defect through a counterfactual question: "would the relation still exist if the neighborhood of entities became different from observation?". With a carefully designed instantiation of a causal model on the knowledge graph, we generate the counterfactual relations to answer the question by regarding the representations of entity pair given relation as context, structural information of relation-aware neighborhood as treatment, and validity of the composed triplet as the outcome. Furthermore, we incorporate the created counterfactual relations with the GNN-based framework on KGs to augment their learning of entity pair representations from both the observed and counterfactual relations. Experiments on benchmarks show that our proposed method outperforms existing methods on the task of KGC, achieving new state-of-the-art results. Moreover, we demonstrate that the proposed counterfactual relations-based augmentation also enhances the interpretability of the GNN-based framework through the path interpretations of predictions.


title: RemoteNet: Remote Sensing Image Segmentation Network based on Global-Local Information

abstract: Remotely captured images possess an immense scale and object appearance variability due to the complex scene. It becomes challenging to capture the underlying attributes in the global and local context for their segmentation. Existing networks struggle to capture the inherent features due to the cluttered background. To address these issues, we propose a remote sensing image segmentation network, RemoteNet, for semantic segmentation of remote sensing images. We capture the global and local features by leveraging the benefits of the transformer and convolution mechanisms. RemoteNet is an encoder-decoder design that uses multi-scale features. We construct an attention map module to generate channel-wise attention scores for fusing these features. We construct a global-local transformer block (GLTB) in the decoder network to support learning robust representations during a decoding phase. Further, we designed a feature refinement module to refine the fused output of the shallow stage encoder feature and the deepest GLTB feature of the decoder. Experimental findings on the two public datasets show the effectiveness of the proposed RemoteNet.


title: Peculiarities of electron transport and resistive switching in point contacts on TiSe2, TiSeS and CuxTiSe2

abstract: TiSe2 has received much attention among the transition metals chalcogenides because of its thrilling physical properties concerning atypical resistivity behavior, emerging of charge density wave (CDW) state, induced superconductivity etc. Here, we report discovery of new feature of TiSe2, namely, observation of resistive switching in voltage biased point contacts (PCs) based on TiSe2 and its derivatives doped by S and Cu (TiSeS, CuxTiSe2). The switching is taking place between a low resistive mainly metallic-type state and a high resistive semiconducting-type state by applying bias voltage (usually below 0.5V), while reverse switching takes place by applying voltage of opposite polarity (usually below 0.5V). The difference in resistance between these two states can reach up to two orders of magnitude at the room temperature. The origin of the effect can be attributed to the variation of stoichiometry in PC core due to drift/displacement of Se/Ti vacancies under high electric field. Additionally, we demonstrated, that heating takes place in PC core, which can facilitate the electric field induced effect. At the same time, we did not found any evidence for CDW spectral features in our PC spectra for TiSe2. The observed resistive switching allows to propose TiSe2 and their derivatives as the promising materials, e.g., for non-volatile resistive random access memory (ReRAM) engineering.


title: Self-Supervised and Supervised Deep Learning for PET Image Reconstruction

abstract: A unified self-supervised and supervised deep learning framework for PET image reconstruction is presented, including deep-learned filtered backprojection (DL-FBP) for sinograms, deep-learned backproject then filter (DL-BPF) for backprojected images, and a more general mapping using a deep network in both the sinogram and image domains (DL-FBP-F). The framework allows varying amounts and types of training data, from the case of having only one single dataset to reconstruct through to the case of having numerous measured datasets, which may or may not be paired with high-quality references. For purely self-supervised mappings, no reference or ground truth data are needed. The self-supervised deep-learned reconstruction operators all use a conventional image reconstruction objective within the loss function (e.g. maximum Poisson likelihood, maximum a posteriori). If it is desired for the reconstruction networks to generalise (i.e. to need either no or minimal retraining for a new measured dataset, but to be fast, ready to reuse), then these self-supervised networks show potential even when previously trained from just one single dataset. For any given new measured dataset, finetuning is however often necessary, and of course the initial training set should ideally go beyond just one dataset if a generalisable network is sought. Example results for the purely self-supervised single-dataset case are shown, but the networks can be i) trained uniquely for any measured dataset to reconstruct from, ii) pretrained on multiple datasets and then used with no retraining for new measured data, iii) pretrained and then finetuned for new measured data, iv) optionally trained with high-quality references. The framework, with its optional inclusion of supervised learning, provides a spectrum of reconstruction approaches by making use of whatever (if any) training data quantities and types are available.


title: Gauss-Newton Temporal Difference Learning with Nonlinear Function Approximation

abstract: In this paper, a Gauss-Newton Temporal Difference (GNTD) learning method is proposed to solve the Q-learning problem with nonlinear function approximation. In each iteration, our method takes one Gauss-Newton (GN) step to optimize a variant of Mean-Squared Bellman Error (MSBE), where target networks are adopted to avoid double sampling. Inexact GN steps are analyzed so that one can safely and efficiently compute the GN updates by cheap matrix iterations. Under mild conditions, non-asymptotic finite-sample convergence to the globally optimal Q function is derived for various nonlinear function approximations. In particular, for neural network parameterization with relu activation, GNTD achieves an improved sample complexity of $\tilde{\mathcal{O}}(\varepsilon^{-1})$, as opposed to the $\mathcal{\mathcal{O}}(\varepsilon^{-2})$ sample complexity of the existing neural TD methods. An $\tilde{\mathcal{O}}(\varepsilon^{-1.5})$ sample complexity of GNTD is also established for general smooth function approximations. We validate our method via extensive experiments in several RL benchmarks, where GNTD exhibits both higher rewards and faster convergence than TD-type methods.


title: Kahramanmaras-Gaziantep, Turkiye Mw 7.8 Earthquake on February 6, 2023: Preliminary Report on Strong Ground Motion and Building Response Estimations

abstract: The effects on structures of the earthquake with magnitude 7.8 on the Richter scale (moment magnitude scale) which took place in Pazarcik, Kahramanmaras, Turkiye at 04:17 a.m. local time (01:17 UTC) on February 6, 2023, are investigated by processing suitable seismic records using the open-source software OpenSeismoMatlab. The earthquake had a maximum Mercalli intensity of XI (Extreme) and it was followed by a Mw 7.5 earthquake nine hours later, centered 95 km to the north-northeast from the first. Peak and cumulative seismic measures as well as elastic response spectra, constant ductility (or isoductile) response spectra, and incremental dynamic analysis curves were calculated for two representative earthquake records of the main event. Furthermore, the acceleration response spectra of a large set of records were compared to the acceleration design spectrum of the Turkish seismic code. Based on the study, it is concluded that the structures were overloaded far beyond their normal design levels. This, in combination with considerable vertical seismic components, was a contributing factor towards the collapse of many buildings in the region. Modifications of the Turkish seismic code are required so that higher spectral acceleration values can be prescribed, especially in earthquake-prone regions.


title: Fluctuation relations to calculate protein redox potentials from molecular dynamics simulations

abstract: The tunable design of protein redox potentials promises to open a range of applications in biotechnology and catalysis. Here we introduce a method to calculate redox potential changes by combining fluctuation relations with molecular dynamics simulations. It involves the simulation of reduced and oxidized states, followed by the instantaneous conversion between them. Energy differences introduced by the perturbations are obtained using the Kubo-Onsager approach. Using a detailed fluctuation relation coupled with Bayesian inference, these are post-processed into estimates for the redox potentials in an efficient manner. This new method, denoted MD+CB, is tested on a de novo four-helix bundle heme protein (the m4D2 `maquette') and five designed mutants, including some mutants characterized experimentally in this work. The MD+CB approach is found to perform reliably, giving redox potential shifts with reasonably good correlation (0.85) to the experimental values for the mutants. The MD+CB approach also compares well with redox potential shift predictions using a continuum electrostatic method. The estimation method employed within the MD+CB approach is straightforwardly transferable to standard equilibrium MD simulations, and holds promise for redox protein engineering and design applications.


title: Three-dimensional real Chern insulator in bulk $\gamma$-graphyne

abstract: The real Chern insulator state, featuring nontrivial real Chern number and second-order boundary modes, has been revealed in a few two-dimensional systems. The concept can be extended to three dimensions (3D), but a proper material realization is still lacking. Here, based on first-principles calculations and theoretical analysis, we identify the recently synthesized bulk ${\gamma}$-graphyne as a 3D real Chern insulator. Its nontrivial bulk topology leads to topological hinge modes spreading across the 1D edge Brillouin zone. Under compression of the interlayer distance, the system can undergo a topological phase transition into a real nodal-line semimetal, which hosts three bulk nodal rings and topological boundary modes on both surfaces and hinges. We also develop a minimal model which captures essential physics of the system.


title: Concept-Level Explanation for the Generalization of a DNN

abstract: This paper explains the generalization power of a deep neural network (DNN) from the perspective of interactive concepts. Many recent studies have quantified a clear emergence of interactive concepts encoded by the DNN, which have been observed on different DNNs during the learning process. Therefore, in this paper, we investigate the generalization power of each interactive concept, and we use the generalization power of different interactive concepts to explain the generalization power of the entire DNN. Specifically, we define the complexity of each interactive concept. We find that simple concepts can be better generalized to testing data than complex concepts. The DNN with strong generalization power usually learns simple concepts more quickly and encodes fewer complex concepts. More crucially, we discover the detouring dynamics of learning complex concepts, which explain both the high learning difficulty and the low generalization power of complex concepts.


title: JND-Based Perceptual Optimization For Learned Image Compression

abstract: Recently, learned image compression schemes have achieved remarkable improvements in image fidelity (e.g., PSNR and MS-SSIM) compared to conventional hybrid image coding ones due to their high-efficiency non-linear transform, end-to-end optimization frameworks, etc. However, few of them take the Just Noticeable Difference (JND) characteristic of the Human Visual System (HVS) into account and optimize learned image compression towards perceptual quality. To address this issue, a JND-based perceptual quality loss is proposed. Considering that the amounts of distortion in the compressed image at different training epochs under different Quantization Parameters (QPs) are different, we develop a distortion-aware adjustor. After combining them together, we can better assign the distortion in the compressed image with the guidance of JND to preserve the high perceptual quality. All these designs enable the proposed method to be flexibly applied to various learned image compression schemes with high scalability and plug-and-play advantages. Experimental results on the Kodak dataset demonstrate that the proposed method has led to better perceptual quality than the baseline model under the same bit rate.


title: Average case analysis of Lasso under ultra-sparse conditions

abstract: We analyze the performance of the least absolute shrinkage and selection operator (Lasso) for the linear model when the number of regressors $N$ grows larger keeping the true support size $d$ finite, i.e., the ultra-sparse case. The result is based on a novel treatment of the non-rigorous replica method in statistical physics, which has been applied only to problem settings where $N$ ,$d$ and the number of observations $M$ tend to infinity at the same rate. Our analysis makes it possible to assess the average performance of Lasso with Gaussian sensing matrices without assumptions on the scaling of $N$ and $M$, the noise distribution, and the profile of the true signal. Under mild conditions on the noise distribution, the analysis also offers a lower bound on the sample complexity necessary for partial and perfect support recovery when $M$ diverges as $M = O(\log N)$. The obtained bound for perfect support recovery is a generalization of that given in previous literature, which only considers the case of Gaussian noise and diverging $d$. Extensive numerical experiments strongly support our analysis.

categories: cond-mat.dis-nn cs.IT math.IT math.ST stat.ML stat.TH


title: Knowledge-infused Contrastive Learning for Urban Imagery-based Socioeconomic Prediction

abstract: Monitoring sustainable development goals requires accurate and timely socioeconomic statistics, while ubiquitous and frequently-updated urban imagery in web like satellite/street view images has emerged as an important source for socioeconomic prediction. Especially, recent studies turn to self-supervised contrastive learning with manually designed similarity metrics for urban imagery representation learning and further socioeconomic prediction, which however suffers from effectiveness and robustness issues. To address such issues, in this paper, we propose a Knowledge-infused Contrastive Learning (KnowCL) model for urban imagery-based socioeconomic prediction. Specifically, we firstly introduce knowledge graph (KG) to effectively model the urban knowledge in spatiality, mobility, etc., and then build neural network based encoders to learn representations of an urban image in associated semantic and visual spaces, respectively. Finally, we design a cross-modality based contrastive learning framework with a novel image-KG contrastive loss, which maximizes the mutual information between semantic and visual representations for knowledge infusion. Extensive experiments of applying the learnt visual representations for socioeconomic prediction on three datasets demonstrate the superior performance of KnowCL with over 30\% improvements on $R^2$ compared with baselines. Especially, our proposed KnowCL model can apply to both satellite and street imagery with both effectiveness and transferability achieved, which provides insights into urban imagery-based socioeconomic prediction.


title: Bayesian Neural Networks Avoid Encoding Complex and Perturbation-Sensitive Concepts

abstract: In this paper, we focus on mean-field variational Bayesian Neural Networks (BNNs) and explore the representation capacity of such BNNs by investigating which types of concepts are less likely to be encoded by the BNN. It has been observed and studied that a relatively small set of interactive concepts usually emerge in the knowledge representation of a sufficiently-trained neural network, and such concepts can faithfully explain the network output. Based on this, our study proves that compared to standard deep neural networks (DNNs), it is less likely for BNNs to encode complex concepts. Experiments verify our theoretical proofs. Note that the tendency to encode less complex concepts does not necessarily imply weak representation power, considering that complex concepts exhibit low generalization power and high adversarial vulnerability. The code is available at https://github.com/sjtu-xai-lab/BNN-concepts.


title: Real-Time Recognition of In-Place Body Actions and Head Gestures using Only a Head-Mounted Display

abstract: Body actions and head gestures are natural interfaces for interaction in virtual environments. Existing methods for in-place body action recognition often require hardware more than a head-mounted display (HMD), making body action interfaces difficult to be introduced to ordinary virtual reality (VR) users as they usually only possess an HMD. In addition, there lacks a unified solution to recognize in-place body actions and head gestures. This potentially hinders the exploration of the use of in-place body actions and head gestures for novel interaction experiences in virtual environments. We present a unified two-stream 1-D convolutional neural network (CNN) for recognition of body actions when a user performs walking-in-place (WIP) and for recognition of head gestures when a user stands still wearing only an HMD. Compared to previous approaches, our method does not require specialized hardware and/or additional tracking devices other than an HMD and can recognize a significantly larger number of body actions and head gestures than other existing methods. In total, ten in-place body actions and eight head gestures can be recognized with the proposed method, which makes this method a readily available body action interface (head gestures included) for interaction with virtual environments. We demonstrate one utility of the interface through a virtual locomotion task. Results show that the present body action interface is reliable in detecting body actions for the VR locomotion task but is physically demanding compared to a touch controller interface. The present body action interface is promising for new VR experiences and applications, especially for VR fitness applications where workouts are intended.