title: Conformalized Fairness via Quantile Regression

abstract: Algorithmic fairness has received increased attention in socially sensitive domains. While rich literature on mean fairness has been established, research on quantile fairness remains sparse but vital. To fulfill great needs and advocate the significance of quantile fairness, we propose a novel framework to learn a real-valued quantile function under the fairness requirement of Demographic Parity with respect to sensitive attributes, such as race or gender, and thereby derive a reliable fair prediction interval. Using optimal transport and functional synchronization techniques, we establish theoretical guarantees of distribution-free coverage and exact fairness for the induced prediction interval constructed by fair quantiles. A hands-on pipeline is provided to incorporate flexible quantile regressions with an efficient fairness adjustment post-processing algorithm. We demonstrate the superior empirical performance of this approach on several benchmark datasets. Our results show the model's ability to uncover the mechanism underlying the fairness-accuracy trade-off in a wide range of societal and medical applications.


title: Multi-task Self-supervised Graph Neural Networks Enable Stronger Task Generalization

abstract: Self-supervised learning (SSL) for graph neural networks (GNNs) has attracted increasing attention from the graph machine learning community in recent years, owing to its capability to learn performant node embeddings without costly label information. One weakness of conventional SSL frameworks for GNNs is that they learn through a single philosophy, such as mutual information maximization or generative reconstruction. When applied to various downstream tasks, these frameworks rarely perform equally well for every task, because one philosophy may not span the extensive knowledge required for all tasks. To enhance the task generalization across tasks, as an important first step forward in exploring fundamental graph models, we introduce PARETOGNN, a multi-task SSL framework for node representation learning over graphs. Specifically, PARETOGNN is self-supervised by manifold pretext tasks observing multiple philosophies. To reconcile different philosophies, we explore a multiple-gradient descent algorithm, such that PARETOGNN actively learns from every pretext task while minimizing potential conflicts. We conduct comprehensive experiments over four downstream tasks (i.e., node classification, node clustering, link prediction, and partition prediction), and our proposal achieves the best overall performance across tasks on 11 widely adopted benchmark datasets. Besides, we observe that learning from multiple philosophies enhances not only the task generalization but also the single task performances, demonstrating that PARETOGNN achieves better task generalization via the disjoint yet complementary knowledge learned from different philosophies. Our code is publicly available at https://github.com/jumxglhf/ParetoGNN.


title: Infectious Probability Analysis on COVID-19 Spreading with Wireless Edge Networks

abstract: The emergence of infectious disease COVID-19 has challenged and changed the world in an unprecedented manner. The integration of wireless networks with edge computing (namely wireless edge networks) brings opportunities to address this crisis. In this paper, we aim to investigate the prediction of the infectious probability and propose precautionary measures against COVID-19 with the assistance of wireless edge networks. Due to the availability of the recorded detention time and the density of individuals within a wireless edge network, we propose a stochastic geometry-based method to analyze the infectious probability of individuals. The proposed method can well keep the privacy of individuals in the system since it does not require to know the location or trajectory of each individual. Moreover, we also consider three types of mobility models and the static model of individuals. Numerical results show that analytical results well match with simulation results, thereby validating the accuracy of the proposed model. Moreover, numerical results also offer many insightful implications. Thereafter, we also offer a number of countermeasures against the spread of COVID-19 based on wireless edge networks. This study lays the foundation toward predicting the infectious risk in realistic environment and points out directions in mitigating the spread of infectious diseases with the aid of wireless edge networks.


title: InterFace:Adjustable Angular Margin Inter-class Loss for Deep Face Recognition

abstract: In the field of face recognition, it is always a hot research topic to improve the loss solution to make the face features extracted by the network have greater discriminative power. Research works in recent years has improved the discriminative power of the face model by normalizing softmax to the cosine space step by step and then adding a fixed penalty margin to reduce the intra-class distance to increase the inter-class distance. Although a great deal of previous work has been done to optimize the boundary penalty to improve the discriminative power of the model, adding a fixed margin penalty to the depth feature and the corresponding weight is not consistent with the pattern of data in the real scenario. To address this issue, in this paper, we propose a novel loss function, InterFace, releasing the constraint of adding a margin penalty only between the depth feature and the corresponding weight to push the separability of classes by adding corresponding margin penalties between the depth features and all weights. To illustrate the advantages of InterFace over a fixed penalty margin, we explained geometrically and comparisons on a set of mainstream benchmarks. From a wider perspective, our InterFace has advanced the state-of-the-art face recognition performance on five out of thirteen mainstream benchmarks. All training codes, pre-trained models, and training logs, are publicly released \footnote{$https://github.com/iamsangmeng/InterFace$}.


title: Atari-5: Distilling the Arcade Learning Environment down to Five Games

abstract: The Arcade Learning Environment (ALE) has become an essential benchmark for assessing the performance of reinforcement learning algorithms. However, the computational cost of generating results on the entire 57-game dataset limits ALE's use and makes the reproducibility of many results infeasible. We propose a novel solution to this problem in the form of a principled methodology for selecting small but representative subsets of environments within a benchmark suite. We applied our method to identify a subset of five ALE games, called Atari-5, which produces 57-game median score estimates within 10% of their true values. Extending the subset to 10-games recovers 80% of the variance for log-scores for all games within the 57-game set. We show this level of compression is possible due to a high degree of correlation between many of the games in ALE.


title: The logarithmic Minkowski inequality for cylinders

abstract: In this paper, we prove that if $K$ is an $o$-symmetric cylinder and $L$ is an $o$-symmetric convex body in $\mathbb R^3$, then the logarithmic Minkowski inequality \[\frac{1}{V(K)}\int_{\mathbb S^{2}}\log\frac{h_L}{h_K}\,dV_K\geq\frac{1}{3}\log\frac{V(L)}{V(K)}\] holds, with equality if and only if $K$ and $L$ are relative cylinders.


title: Exploring Effective Knowledge Transfer for Few-shot Object Detection

abstract: Recently, few-shot object detection~(FSOD) has received much attention from the community, and many methods are proposed to address this problem from a knowledge transfer perspective. Though promising results have been achieved, these methods fail to achieve shot-stable:~methods that excel in low-shot regimes are likely to struggle in high-shot regimes, and vice versa. We believe this is because the primary challenge of FSOD changes when the number of shots varies. In the low-shot regime, the primary challenge is the lack of inner-class variation. In the high-shot regime, as the variance approaches the real one, the main hindrance to the performance comes from misalignment between learned and true distributions. However, these two distinct issues remain unsolved in most existing FSOD methods. In this paper, we propose to overcome these challenges by exploiting rich knowledge the model has learned and effectively transferring them to the novel classes. For the low-shot regime, we propose a distribution calibration method to deal with the lack of inner-class variation problem. Meanwhile, a shift compensation method is proposed to compensate for possible distribution shift during fine-tuning. For the high-shot regime, we propose to use the knowledge learned from ImageNet as guidance for the feature learning in the fine-tuning stage, which will implicitly align the distributions of the novel classes. Although targeted toward different regimes, these two strategies can work together to further improve the FSOD performance. Experiments on both the VOC and COCO benchmarks show that our proposed method can significantly outperform the baseline method and produce competitive results in both low-shot settings (shot<5) and high-shot settings (shot>=5). Code is available at https://github.com/JulioZhao97/EffTrans_Fsdet.git.


title: Parity-doublet bands in the odd-\bm{$A$} isotones \element{237}U and \element{239}Pu by a particle-number-conserving method based on the cranked shell model

abstract: Based on the reflection-asymmetric Nilsson potential, the parity-doublet rotational bands in odd-$A$ isotones \element{237}U and \element{239}Pu have been investigated by using the particle-number-conserving (PNC) method in the framework of the cranked shell model (CSM). The experimental kinematic moments of inertia (MOIs) and angular momentum alignments are reproduced very well by the PNC-CSM calculations. The significant differences of rotational properties between \element{237}U and \element{239}Pu are explained with the contribution of nucleons occupying proton octupole-correlation pairs of $\pi ^{2} i_{13/2}f_{7/2}$. The upbendings of moments of inertia of the parity-doublet bands in \element{237}U are due to the interference terms of alignments of protons occupying $\pi f_{7/2}$ (${1/2}$) and the high-$j$ intruder $\pi i_{13/2}$ $(1/2, 3/2)$ orbitals. The splittings between the simplex partner bands of the parity-doublet bands in both \element{237}U and \element{239}Pu result from the contribution of alignment of neutron occupying the $\nu d_{5/2}$ ($1/2$) orbital.


title: DreamShard: Generalizable Embedding Table Placement for Recommender Systems

abstract: We study embedding table placement for distributed recommender systems, which aims to partition and place the tables on multiple hardware devices (e.g., GPUs) to balance the computation and communication costs. Although prior work has explored learning-based approaches for the device placement of computational graphs, embedding table placement remains to be a challenging problem because of 1) the operation fusion of embedding tables, and 2) the generalizability requirement on unseen placement tasks with different numbers of tables and/or devices. To this end, we present DreamShard, a reinforcement learning (RL) approach for embedding table placement. DreamShard achieves the reasoning of operation fusion and generalizability with 1) a cost network to directly predict the costs of the fused operation, and 2) a policy network that is efficiently trained on an estimated Markov decision process (MDP) without real GPU execution, where the states and the rewards are estimated with the cost network. Equipped with sum and max representation reductions, the two networks can directly generalize to any unseen tasks with different numbers of tables and/or devices without fine-tuning. Extensive experiments show that DreamShard substantially outperforms the existing human expert and RNN-based strategies with up to 19% speedup over the strongest baseline on large-scale synthetic tables and our production tables. The code is available at https://github.com/daochenzha/dreamshard


title: Perfect Reconstruction Two-Channel Filter Banks on Arbitrary Graphs

abstract: This paper extends the existing theory of perfect reconstruction two-channel filter banks from bipartite graphs to non-bipartite graphs. By generalizing the concept of downsampling/upsampling we establish the frame of two-channel filter bank on arbitrary connected, undirected and weighted graphs. Then the equations for perfect reconstruction of the filter banks are presented and solved under proper conditions. Algorithms for designing orthogonal and biorthogonal banks are given and two typical orthogonal two-channel filter banks are calculated. The locality and approximation properties of such filter banks are discussed theoretically and experimentally.


title: GMMSeg: Gaussian Mixture based Generative Semantic Segmentation Models

abstract: Prevalent semantic segmentation solutions are, in essence, a dense discriminative classifier of p(class|pixel feature). Though straightforward, this de facto paradigm neglects the underlying data distribution p(pixel feature|class), and struggles to identify out-of-distribution data. Going beyond this, we propose GMMSeg, a new family of segmentation models that rely on a dense generative classifier for the joint distribution p(pixel feature,class). For each class, GMMSeg builds Gaussian Mixture Models (GMMs) via Expectation-Maximization (EM), so as to capture class-conditional densities. Meanwhile, the deep dense representation is end-to-end trained in a discriminative manner, i.e., maximizing p(class|pixel feature). This endows GMMSeg with the strengths of both generative and discriminative models. With a variety of segmentation architectures and backbones, GMMSeg outperforms the discriminative counterparts on three closed-set datasets. More impressively, without any modification, GMMSeg even performs well on open-world datasets. We believe this work brings fundamental insights into the related fields.


title: Truncated atomic plane wave method for the subband structure calculations of Moir\'e systems

abstract: We propose a highly efficient and accurate numerical scheme named Truncated Atomic Plane Wave (TAPW) method to determine the subband structure of Twisted Bilayer Graphene (TBG) inspired by BM model. Our method utilizes real space information of carbon atoms in the moir\'e unit cell and projects the full tight binding Hamiltonian into a much smaller subspace using atomic plane waves. We present accurate electronic band structures of TBG in a wide range of twist angles together with detailed moir\'e potential and screened Coulomb interaction at the first magic angle using our new method. Furthermore, we generalize our formalism to solve the problem of low frequency moir\'e phonons in TBG.


title: The Bernoulli clock: probabilistic and combinatorial interpretations of the Bernoulli polynomials by circular convolution

abstract: The factorially normalized Bernoulli polynomials $b_n(x) = B_n(x)/n!$ are known to be characterized by $b_0(x) = 1$ and $b_n(x)$ for $n >0$ is the antiderivative of $b_{n-1}(x)$ subject to $\int_0^1 b_n(x) dx = 0$. We offer a related characterization: $b_1(x) = x - 1/2$ and $(-1)^{n-1} b_n(x)$ for $n >0$ is the $n$-fold circular convolution of $b_1(x)$ with itself. Equivalently, $1 - 2^n b_n(x)$ is the probability density at $x \in (0,1)$ of the fractional part of a sum of $n$ independent random variables, each with the beta$(1,2)$ probability density $2(1-x)$ at $x \in (0,1)$. This result has a novel combinatorial analog, the {\em Bernoulli clock}: mark the hours of a $2 n$ hour clock by a uniform random permutation of the multiset $\{1,1, 2,2, \ldots, n,n\}$, meaning pick two different hours uniformly at random from the $2 n$ hours and mark them $1$, then pick two different hours uniformly at random from the remaining $2 n - 2$ hours and mark them $2$, and so on. Starting from hour $0 = 2n$, move clockwise to the first hour marked $1$, continue clockwise to the first hour marked $2$, and so on, continuing clockwise around the Bernoulli clock until the first of the two hours marked $n$ is encountered, at a random hour $I_n$ between $1$ and $2n$. We show that for each positive integer $n$, the event $( I_n = 1)$ has probability $(1 - 2^n b_n(0))/(2n)$, where $n! b_n(0) = B_n(0)$ is the $n$th Bernoulli number. For $ 1 \le k \le 2 n$, the difference $\delta_n(k):= 1/(2n) - \P( I_n = k)$ is a polynomial function of $k$ with the surprising symmetry $\delta_n( 2 n + 1 - k) = (-1)^n \delta_n(k)$, which is a combinatorial analog of the well known symmetry of Bernoulli polynomials $b_n(1-x) = (-1)^n b_n(x)$.


title: Nodeless superconductivity in the topological nodal-line semimetal CaSb2

abstract: CaSb2 is a topological nodal-line semimetal that becomes superconducting below 1.6 K, providing an ideal platform to investigate the interplay between topologically nontrivial electronic bands and superconductivity. In this work, we investigated the superconducting order parameter of CaSb2 by measuring its magnetic penetration depth change {\Delta}{\lambda}(T) down to 0.07 K, using a tunneling diode oscillator (TDO) based technique. Well inside the superconducting state, {\Delta}{\lambda}(T) shows an exponential activated behavior, and provides direct evidence for a nodeless superconducting gap. By analyzing the temperature dependence of the superfluid density and the electronic specific heat, we find both can be consistently described by a two-gap s-wave model, in line with the presence of multiple Fermi surfaces associated with distinct Sb sites in this compound. These results demonstrate fully-gapped superconductivity in CaSb2 and constrain the allowed pairing symmetry.


title: Inharmonious Region Localization with Auxiliary Style Feature

abstract: With the prevalence of image editing techniques, users can create fantastic synthetic images, but the image quality may be compromised by the color/illumination discrepancy between the manipulated region and background. Inharmonious region localization aims to localize the inharmonious region in a synthetic image. In this work, we attempt to leverage auxiliary style feature to facilitate this task. Specifically, we propose a novel color mapping module and a style feature loss to extract discriminative style features containing task-relevant color/illumination information. Based on the extracted style features, we also propose a novel style voting module to guide the localization of inharmonious region. Moreover, we introduce semantic information into the style voting module to achieve further improvement. Our method surpasses the existing methods by a large margin on the benchmark dataset.


title: Point Cloud Recognition with Position-to-Structure Attention Transformers

abstract: In this paper, we present Position-to-Structure Attention Transformers (PS-Former), a Transformer-based algorithm for 3D point cloud recognition. PS-Former deals with the challenge in 3D point cloud representation where points are not positioned in a fixed grid structure and have limited feature description (only 3D coordinates ($x, y, z$) for scattered points). Existing Transformer-based architectures in this domain often require a pre-specified feature engineering step to extract point features. Here, we introduce two new aspects in PS-Former: 1) a learnable condensation layer that performs point downsampling and feature extraction; and 2) a Position-to-Structure Attention mechanism that recursively enriches the structural information with the position attention branch. Compared with the competing methods, while being generic with less heuristics feature designs, PS-Former demonstrates competitive experimental results on three 3D point cloud tasks including classification, part segmentation, and scene segmentation.


title: Conic divisorial ideals of toric rings and applications to Hibi rings and stable set rings

abstract: In the present paper, we study conic divisorial ideals of toric rings. We provide an idea to determine them and we give a description of the conic divisorial ideals of Hibi rings and stable set rings of perfect graphs by using this idea. We also characterize when Hibi rings or stable set rings are quasi-symmetric or weakly-symmetric. Moreover, by using the description of the conic divisorial ideals, we construct a non-commutative crepant resolution (NCCR) of a special family of stable set rings.


title: Torque reversals and wind variations of X-ray pulsar Vela X-1

abstract: The erratic spin history of Vela X-1 shows some continuous spin-up/spin-down trend over tens of days. We study the orbital profile and spectral property of Vela X-1 in these spin-up/spin-down intervals, using the spin history monitored by Fermi/GBM and light curve from Swift/BAT and MAXI/GSC. The BAT fluxes in the spin-up intervals are about 1.6 times those of the spin-down intervals for out-of-eclipse orbital phases. The spin-up intervals also show a higher column density than the spin-down intervals, indicating there are more material on the orbital scale for the spin-up intervals. It could be due to the variation of the stellar wind of the optical star (HD 77581) on tens of days. The varying wind could lead to alternating prograde/retrograde accreting flow to the neutron star, which dominates the transfer of the angular momentum to Vela X-1, but not the total observed luminosity.


title: Learning Video-independent Eye Contact Segmentation from In-the-Wild Videos

abstract: Human eye contact is a form of non-verbal communication and can have a great influence on social behavior. Since the location and size of the eye contact targets vary across different videos, learning a generic video-independent eye contact detector is still a challenging task. In this work, we address the task of one-way eye contact detection for videos in the wild. Our goal is to build a unified model that can identify when a person is looking at his gaze targets in an arbitrary input video. Considering that this requires time-series relative eye movement information, we propose to formulate the task as a temporal segmentation. Due to the scarcity of labeled training data, we further propose a gaze target discovery method to generate pseudo-labels for unlabeled videos, which allows us to train a generic eye contact segmentation model in an unsupervised way using in-the-wild videos. To evaluate our proposed approach, we manually annotated a test dataset consisting of 52 videos of human conversations. Experimental results show that our eye contact segmentation model outperforms the previous video-dependent eye contact detector and can achieve 71.88% framewise accuracy on our annotated test set. Our code and evaluation dataset are available at https://github.com/ut-vision/Video-Independent-ECS.


title: Clustering Semantic Predicates in the Open Research Knowledge Graph

abstract: When semantically describing knowledge graphs (KGs), users have to make a critical choice of a vocabulary (i.e. predicates and resources). The success of KG building is determined by the convergence of shared vocabularies so that meaning can be established. The typical lifecycle for a new KG construction can be defined as follows: nascent phases of graph construction experience terminology divergence, while later phases of graph construction experience terminology convergence and reuse. In this paper, we describe our approach tailoring two AI-based clustering algorithms for recommending predicates (in RDF statements) about resources in the Open Research Knowledge Graph (ORKG) https://orkg.org/. Such a service to recommend existing predicates to semantify new incoming data of scholarly publications is of paramount importance for fostering terminology convergence in the ORKG. Our experiments show very promising results: a high precision with relatively high recall in linear runtime performance. Furthermore, this work offers novel insights into the predicate groups that automatically accrue loosely as generic semantification patterns for semantification of scholarly knowledge spanning 44 research fields.


title: A Counterexample to a Directed KKL Inequality

abstract: We show that the natural directed analogues of the KKL theorem [KKL88] and the Eldan--Gross inequality [EG20] from the analysis of Boolean functions fail to hold. This is in contrast to several other isoperimetric inequalities on the Boolean hypercube (such as the Poincare inequality, Margulis's inequality [Mar74] and Talagrand's inequality [Tal93]) for which directed strengthenings have recently been established.


title: Inharmonious Region Localization via Recurrent Self-Reasoning

abstract: Synthetic images created by image editing operations are prevalent, but the color or illumination inconsistency between the manipulated region and background may make it unrealistic. Thus, it is important yet challenging to localize the inharmonious region to improve the quality of synthetic image. Inspired by the classic clustering algorithm, we aim to group pixels into two clusters: inharmonious cluster and background cluster by inserting a novel Recurrent Self-Reasoning (RSR) module into the bottleneck of UNet structure. The mask output from RSR module is provided for the decoder as attention guidance. Finally, we adaptively combine the masks from RSR and the decoder to form our final mask. Experimental results on the image harmonization dataset demonstrate that our method achieves competitive performance both quantitatively and qualitatively.


title: Mandelbrot set and Julia sets of fractional order

abstract: In this paper the fractional-order Mandelbrot and Julia sets in the sense of $q$-th Caputo-like discrete fractional differences, for $q\in(0,1)$, are introduced and several properties are analytically and numerically studied. Some intriguing properties of the fractional models are revealed. Thus, for $q\uparrow1$, contrary to expectations, it is not obtained the known shape of the Mandelbrot of integer order, but for $q\downarrow0$. Also, we conjecture that for $q\downarrow0$, the fractional-order Mandelbrot set is similar to the integer-order Mandelbrot set, while for $q\downarrow0$ and $c=0$, one of the underlying fractional-order Julia sets is similar to the integer-order Mandelbrot set. In support of our conjecture, several extensive numerical experiments were done. To draw the Mandelbrot and Julia sets of fractional order, the numerical integral of the underlying initial values problem of fractional order is used, while to draw the sets, the escape-time algorithm adapted for the fractional-order case is used. The algorithm is presented as pseudocode.


title: MOTSLAM: MOT-assisted monocular dynamic SLAM using single-view depth estimation

abstract: Visual SLAM systems targeting static scenes have been developed with satisfactory accuracy and robustness. Dynamic 3D object tracking has then become a significant capability in visual SLAM with the requirement of understanding dynamic surroundings in various scenarios including autonomous driving, augmented and virtual reality. However, performing dynamic SLAM solely with monocular images remains a challenging problem due to the difficulty of associating dynamic features and estimating their positions. In this paper, we present MOTSLAM, a dynamic visual SLAM system with the monocular configuration that tracks both poses and bounding boxes of dynamic objects. MOTSLAM first performs multiple object tracking (MOT) with associated both 2D and 3D bounding box detection to create initial 3D objects. Then, neural-network-based monocular depth estimation is applied to fetch the depth of dynamic features. Finally, camera poses, object poses, and both static, as well as dynamic map points, are jointly optimized using a novel bundle adjustment. Our experiments on the KITTI dataset demonstrate that our system has reached best performance on both camera ego-motion and object tracking on monocular dynamic SLAM.


title: Conjugate Fillings and Legendrian Weaves

abstract: First, we show that conjugate Lagrangian fillings, associated to plabic graphs, and Lagrangian fillings obtained as Reeb pinching sequences are both Hamiltonian isotopic to Lagrangian projections of Legendrian weaves. In general, we establish a series of new Reidemeister moves for hybrid Lagrangian surfaces. These allow for explicit combinatorial isotopies between the different types of Lagrangian fillings and we use them to show that Legendrian weaves indeed generalize these previously known combinatorial methods to construct Lagrangian fillings. This generalization is strict, as weaves are typically able to produce infinitely many distinct Hamiltonian isotopy classes of Lagrangian fillings, whereas conjugate surfaces and Reeb pinching sequences produce finitely many fillings. Second, we compare the sheaf quantizations associated to each such types of Lagrangian fillings and show that the cluster structures in the corresponding moduli of pseudo-perfect objects coincide. In particular, this shows that the cluster variables in Bott-Samelson cells, given as generalized minors, are geometric microlocal holonomies associated to sheaf quantizations. Similar results are presented for the Fock-Goncharov cluster variables in the moduli spaces of framed local systems. In the course of the article and its appendices, we also establish several technical results needed for a rigorous comparison between the different Lagrangian fillings and their microlocal sheaf invariants.


title: GT-GAN: General Purpose Time Series Synthesis with Generative Adversarial Networks

abstract: Time series synthesis is an important research topic in the field of deep learning, which can be used for data augmentation. Time series data types can be broadly classified into regular or irregular. However, there are no existing generative models that show good performance for both types without any model changes. Therefore, we present a general purpose model capable of synthesizing regular and irregular time series data. To our knowledge, we are the first designing a general purpose time series synthesis model, which is one of the most challenging settings for time series synthesis. To this end, we design a generative adversarial network-based method, where many related techniques are carefully integrated into a single framework, ranging from neural ordinary/controlled differential equations to continuous time-flow processes. Our method outperforms all existing methods.


title: Natural Color Fool: Towards Boosting Black-box Unrestricted Attacks

abstract: Unrestricted color attacks, which manipulate semantically meaningful color of an image, have shown their stealthiness and success in fooling both human eyes and deep neural networks. However, current works usually sacrifice the flexibility of the uncontrolled setting to ensure the naturalness of adversarial examples. As a result, the black-box attack performance of these methods is limited. To boost transferability of adversarial examples without damaging image quality, we propose a novel Natural Color Fool (NCF) which is guided by realistic color distributions sampled from a publicly available dataset and optimized by our neighborhood search and initialization reset. By conducting extensive experiments and visualizations, we convincingly demonstrate the effectiveness of our proposed method. Notably, on average, results show that our NCF can outperform state-of-the-art approaches by 15.0%$\sim$32.9% for fooling normally trained models and 10.0%$\sim$25.3% for evading defense methods. Our code is available at https://github.com/ylhz/Natural-Color-Fool.


title: FedMT: Federated Learning with Mixed-type Labels

abstract: In federated learning (FL), classifiers (e.g., deep networks) are trained on datasets from multiple data centers without exchanging data across them, which improves the sample efficiency. However, the conventional FL setting assumes the same labeling criterion in all data centers involved, thus limiting its practical utility. This limitation becomes particularly notable in domains like disease diagnosis, where different clinical centers may adhere to different standards, making traditional FL methods unsuitable. This paper addresses this important yet under-explored setting of FL, namely FL with mixed-type labels, where the allowance of different labeling criteria introduces inter-center label space differences. To address this challenge effectively and efficiently, we introduce a model-agnostic approach called FedMT, which estimates label space correspondences and projects classification scores to construct loss functions. The proposed FedMT is versatile and integrates seamlessly with various FL methods, such as FedAvg. Experimental results on benchmark and medical datasets highlight the substantial improvement in classification accuracy achieved by FedMT in the presence of mixed-type labels.


title: Non-equilibrium dynamics in a three state opinion formation model with stochastic extreme switches

abstract: We investigate the non-equilibrium dynamics of a three state kinetic exchange model of opinion formation, where switches between extreme states are possible, depending on the value of a parameter $q$. The mean field dynamical equations are derived and analysed for any $q$. The fate of the system under the evolutionary rules used in \cite{BCS} shows that it is dependent on the value of $q$ and the initial state in general. For $q=1$, which allows the extreme switches maximally, a quasi-conservation in the dynamics is obtained which renders it equivalent to the voter model. For general $q$ values, a "frozen" disordered fixed point is obtained which acts as an attractor for all initially disordered states. For other initial states, the order parameter grows with time $t$ as $\exp[\alpha(q) t]$ where $\alpha = \frac{1-q}{3-q}$ for $q\neq 1$ and follows a power law behaviour for $q=1$. Numerical simulations using a fully connected agent based model provide additional results like the system size dependence of the exit probability and consensus times that further accentuate the different behaviour of the model for $q=1$ and $q\neq 1$. The results are compared with the non-equilibrium phenomena in other well known dynamical systems.


title: Microwave response to sunspot oscillations

abstract: We present the first observations of spatially resolved oscillation sources obtained with the Siberian Radioheliograph (SRH) at 3-6 GHz. We have found significant flux oscillations with periods of about 3, 5 and 13 minutes emitted from AR12833. The 3-minute periodicity dominates at higher frequencies. It was found that the apparent level of oscillations depends on the active region location on the disc, and scales down towards the limbs. The oscillations were studied in detail during one hour interval on June 19, 2021. We found that sources of 3-min oscillations were located above the umbra and their emission is extraordinary polarized. The 5 and 13-min periods were manifested in emission at lower frequencies, down to 2.8 GHz. Sources with 5-min periodicity were located near the umbra-penumbra boundary and in the pore region. Positions of sources with 13-min oscillations were different at 3.1 GHz and 4.7 GHz. We found consistency between spatial location of the oscillation sources in radio and UV in 171A and 304A. There is significant correlation of signals in two ranges. Time delays between microwave oscillations increase as the frequency decreases, which can be explained by upward propagation of periodic disturbances. The localization of oscillation sources is probably related to magnetic structures with different wave cutoff frequencies at different heights. The obtained results show that SRH can provide the spatial resolved observation of the oscillations in the intensity and polarization channels in 3-6 GHz band.


title: Coarse-to-Fine Point Cloud Registration with SE(3)-Equivariant Representations

abstract: Point cloud registration is a crucial problem in computer vision and robotics. Existing methods either rely on matching local geometric features, which are sensitive to the pose differences, or leverage global shapes, which leads to inconsistency when facing distribution variances such as partial overlapping. Combining the advantages of both types of methods, we adopt a coarse-to-fine pipeline that concurrently handles both issues. We first reduce the pose differences between input point clouds by aligning global features; then we match the local features to further refine the inaccurate alignments resulting from distribution variances. As global feature alignment requires the features to preserve the poses of input point clouds and local feature matching expects the features to be invariant to these poses, we propose an SE(3)-equivariant feature extractor to simultaneously generate two types of features. In this feature extractor, representations that preserve the poses are first encoded by our novel SE(3)-equivariant network and then converted into pose-invariant ones by a pose-detaching module. Experiments demonstrate that our proposed method increases the recall rate by 20% compared to state-of-the-art methods when facing both pose differences and distribution variances.


title: Prototype Design and Efficiency Analysis of a Novel Robot Drive Based on 3K-H-V Topology

abstract: Robot actuators directly affect the performance of robots, and robot drives directly affect the performance of robot actuators. With the development of robotics, robots have put higher requirements on robot drives, such as high stiffness, high accuracy, high loading, high efficiency, low backlash, compact size, and hollow structure. In order to meet the demand development of robot actuators, this research base proposes a new robot drive based on 3K-H-V topology using involute and cycloidal gear shapes, planetary cycloidal drive, from the perspective of drive topology and through the design idea of decoupling. In this study, the reduction ratio and the efficiency model of the 3K-H-V topology were analyzed, and a prototype planetary cycloidal actuator was designed. The feasibility of the drive is initially verified by experimentally concluding that the PCA has a hollow structure, compact size, and high torque density (69 kg/Nm).


title: Quantum symmetries of Hadamard matrices

abstract: We define quantum automorphisms and isomorphisms of Hadamard matrices. We show that every Hadamard matrix of size $N\ge 4$ has quantum symmetries and that all Hadamard matrices of a fixed size are mutually quantum isomorphic. These results pass also to the corresponding Hadamard graphs. We also define quantum Hadamard matrices acting on quantum spaces and bring an example thereof over matrix algebras.


title: Partial Tail Correlation for Extremes

abstract: In order to understand structural relationships among sets of variables at extreme levels, we develop an extremes analogue to partial correlation. We begin by developing an inner product space constructed from transformed-linear combinations of independent regularly varying random variables. We define partial tail correlation via the projection theorem for the inner product space. We show that the partial tail correlation can be understood as the inner product of the prediction errors from transformed-linear prediction. We connect partial tail correlation to the inverse of the inner product matrix and show that a zero in this inverse implies a partial tail correlation of zero. We then show that under a modeling assumption that the random variables belong to a sensible subset of the inner product space, the matrix of inner products corresponds to the previously-studied tail pairwise dependence matrix. We develop a hypothesis test for partial tail correlation of zero. We demonstrate the performance in two applications: high nitrogen dioxide levels in Washington DC and extreme river discharges in the upper Danube basin.


title: Investigation of wetting layers in InAs/GaAs self-assembled nanostructures with reflectance difference spectroscopy

abstract: As a system with both profound physics and promising application potentials, the strain-induced self-assembled semiconductor nanostructures have been investigated for decades of years. The optical and electrical properties of this system are mainly determined by the nanostructures, but can be greatly affected by the generally existent two dimensional structures from which the nanostructures evolve, the so called wetting layer (WL). The WL configurations can be varied with different growth conditions, and further influence the nanostructure morphology and properties. This is a reviewing article introducing some recent progresses in investigating the evolution of WLs in InAs/GaAs system with reflectance difference spectroscopy. Different kinds of WL evolution processes in Stranski-Krastanov growth mode are introduced. The segregation and desorption of indium atoms and the effect of growth interruption are mentioned. The existence and the evolution process of wetting layers in droplet epitaxy method are also discussed.


title: Thouless pumping and topology

abstract: Thouless pumping provides one of the simplest manifestations of topology in quantum systems, and has attracted a lot of recent interest, both theoretically and experimentally. Since the seminal works by Thouless and Niu in 1983 and 1984, it is argued that the quantization of the pumped charge is robust against weak disorder, but a clear characterization of the localization properties of the relevant states, and the breakdown of quantized transport in the presence of interaction or out of the adiabatic approximation, has been long debated. Thouless pumping is also the first example of a topological phase emerging in a periodically-driven system. Driven systems can exhibit exotic topological phases without any static analogue and have been the subject of many recent proposals both in fermionic and bosonic systems in diverse platforms ranging from cold atoms to photonics and condensed matter systems. In this respect, this review has a twofold purpose: On the one hand, it serves as a basis to understand the robustness of the topology of slowly-driven systems per se; On the other hand, it highlights the rich properties of topological pumps and their diverse range of applications, for instance, in systems with synthetic dimensions or for understanding higher-order topological phases. These examples underline the relevance of topological pumping for the fast growing field of topological quantum matter.


title: Weak error analysis for the stochastic Allen-Cahn equation

abstract: We prove strong rate resp. weak rate ${\mathcal O}(\tau)$ for a structure preserving temporal discretization (with $\tau$ the step size) of the stochastic Allen-Cahn equation with additive resp. multiplicative colored noise in $d=1,2,3$ dimensions. Direct variational arguments exploit the one-sided Lipschitz property of the cubic nonlinearity in the first setting to settle first order strong rate. It is the same property which allows for uniform bounds for the derivatives of the solution of the related Kolmogorov equation, and then leads to weak rate ${\mathcal O}(\tau)$ in the presence of multiplicative noise. Hence, we obtain twice the rate of convergence known for the strong error in the presence of multiplicative noise.


title: Nonlinear Outcome of Coagulation Instability in Protoplanetary Disks II: Dust Ring Formation Mediated by Backreaction and Fragmentation

abstract: In our previous work (Paper I), we demonstrated that coagulation instability results in dust concentration against depletion due to the radial drift and accelerates dust growth locally. In this work (Paper II), we perform numerical simulations of coagulation instability taking into account effects of backreaction to gas and collisional fragmentation of dust grains. We find that the slowdown of the dust drift due to backreaction regulates dust concentration in the nonlinear growth phase of coagulation instability. The dust-to-gas surface density ratio increases from $10^{-3}$ up to $\sim10^{-2}$. Each resulting dust ring tends to have mass of $\simeq0.5M_{\oplus}-1.5M_{\oplus}$ in our disk model. In contrast to Paper I, the dust surface density profile shows a local plateau structure at each dust ring. In spite of the regulation at the nonlinear growth, the efficient dust concentration reduces their collision velocity. As a result, dust grains can grow beyond the fragmentation barrier, and the dimensionless stopping time reaches unity as in Paper I. The necessary condition for the efficient dust growth is (1) weak turbulence of $\alpha<1\times10^{-3}$ and (2) a large critical velocity for dust fragmentation ($> 1$ m/s). The efficient dust concentration in outer regions will reduce the inward pebble flux and is expected to decelerate the planet formation via the pebble accretion. We also find that the resulting rings can be unstable to secular gravitational instability (GI). The subsequent secular GI promotes planetesimal formation. We thus expect that a combination of these instabilities is a promising mechanism for dust-ring and planetesimal formation.


title: Joint Beamforming Designs for Active Reconfigurable Intelligent Surface: A Sub-Connected Array Architecture

abstract: Reconfigurable intelligent surface (RIS) is regarded as a promising technology with great potential to boost wireless networks. Affected by the "double fading" effect, however, conventional passive RIS cannot bring considerable performance improvement when users are not close enough to RIS. Recently, active RIS is introduced to combat the double fading effect by actively amplifying incident signals with the aid of integrated reflection-type amplifiers. In order to reduce the hardware cost and energy consumption due to massive active components in the conventional fully-connected active RIS, a novel hardware-and-energy efficient sub-connected active RIS architecture has been proposed recently, in which multiple reconfigurable electromagnetic elements are driven by only one amplifier. In this paper, we first develop an improved and accurate signal model for the sub-connected active RIS architecture. Then, we investigate the joint transmit precoding and RIS reflection beamforming (i.e., the reflection phase-shift and amplification coefficients) designs in multiuser multiple-input single-output (MU-MISO) communication systems. Both sum-rate maximization and power minimization problems are solved by leveraging fractional programming (FP), block coordinate descent (BCD), second-order cone programming (SOCP), alternating direction method of multipliers (ADMM), and majorization-minimization (MM) methods. Extensive simulation results verify that compared with the conventional fully-connected structure, the proposed sub-connected active RIS can significantly reduce the hardware cost and power consumption, and achieve great performance improvement when power budget at RIS is limited.


title: Placing by Touching: An empirical study on the importance of tactile sensing for precise object placing

abstract: This work deals with a practical everyday problem: stable object placement on flat surfaces starting from unknown initial poses. Common object-placing approaches require either complete scene specifications or extrinsic sensor measurements, e.g., cameras, that occasionally suffer from occlusions. We propose a novel approach for stable object placing that combines tactile feedback and proprioceptive sensing. We devise a neural architecture that estimates a rotation matrix, resulting in a corrective gripper movement that aligns the object with the placing surface for the subsequent object manipulation. We compare models with different sensing modalities, such as force-torque and an external motion capture system, in real-world object placing tasks with different objects. The experimental evaluation of our placing policies with a set of unseen everyday objects reveals significant generalization of our proposed pipeline, suggesting that tactile sensing plays a vital role in the intrinsic understanding of robotic dexterous object manipulation. Code, models, and supplementary videos are available at https://sites.google.com/view/placing-by-touching.


title: Learning to Act: Novel Integration of Algorithms and Models for Epidemic Preparedness

abstract: In this work we present a framework which may transform research and praxis in epidemic planning. Introduced in the context of the ongoing COVID-19 pandemic, we provide a concrete demonstration of the way algorithms may learn from epidemiological models to scale their value for epidemic preparedness. Our contributions in this work are two fold: 1) a novel platform which makes it easy for decision making stakeholders to interact with epidemiological models and algorithms developed within the Machine learning community, and 2) the release of this work under the Apache-2.0 License. The objective of this paper is not to look closely at any particular models or algorithms, but instead to highlight how they can be coupled and shared to empower evidence-based decision making.


title: Extreme expectile estimation for short-tailed data, with an application to market risk assessment

abstract: The use of expectiles in risk management has recently gathered remarkable momentum due to their excellent axiomatic and probabilistic properties. In particular, the class of elicitable law-invariant coherent risk measures only consists of expectiles. While the theory of expectile estimation at central levels is substantial, tail estimation at extreme levels has so far only been considered when the tail of the underlying distribution is heavy. This article is the first work to handle the short-tailed setting where the loss (e.g. negative log-returns) distribution of interest is bounded to the right and the corresponding extreme value index is negative. We derive an asymptotic expansion of tail expectiles in this challenging context under a general second-order extreme value condition, which allows to come up with two semiparametric estimators of extreme expectiles, and with their asymptotic properties in a general model of strictly stationary but weakly dependent observations. A simulation study and a real data analysis from a forecasting perspective are performed to verify and compare the proposed competing estimation procedures.


title: Comparing Hysteresis Comparator and RMS Threshold Methods for Automatic Single Cough Segmentations

abstract: Research on diagnosing diseases based on voice signals currently are rapidly increasing, including cough-related diseases. When training the cough sound signals into deep learning models, it is necessary to have a standard input by segmenting several cough signals into individual cough signals. Previous research has been developed to segment cough signals from non-cough signals. This research evaluates the segmentation methods of several cough signals from a single audio file into several single-cough signals. We evaluate three different methods employing manual segmentation as a baseline and automatic segmentation. The results by two automatic segmentation methods obtained precisions of 73% and 70% compared to 49% by manual segmentation. The agreements of listening tests to count the number of correct single-cough segmentations show fair and moderate correlations for automatic segmentation methods and are comparable with manual segmentation.


title: Direct evidence of a charge depletion region at the interface of Van der Waals monolayers and dielectric oxides: The case of superconducting FeSe/STO

abstract: The discovery of two dimensional Van der Waals materials has opened up several possibilities for designing novel devices. Yet a more promising way of designing exotic heterostutures with improved physical properties is to grow a monolayer of these materials on a substrate. For example, in the field of superconductivity it has been demonstrated that the superconducting transition temperature of a monolayer of FeSe grown on some oxide substrates e.g., strontium titanate (STO) is by far higher than its bulk counterpart. Although the system has been considered as a model system for understanding the phenomenon of high-temperature superconductivity, the physical mechanism responsible for this high transition temperature is still highly under debate. Here using momentum and energy resolved high-resolution electron energy-loss spectroscopy we probe the dynamic charge response of the FeSe/STO(001) system and demonstrate that the frequency- and momentum-dependent dynamic charge response is not compatible with a simple film/substrate model. Our analysis reveals the existence of a depletion region at the interface between this Van der Waals monolayer and the substrate. The presence of the depletion layer, accompanied with a considerably large charge transfer from STO into the FeSe monolayer, leads to a strong renormalization of the STO energy bands and a substantial band bending at the interface. Our results shed light on the electronic complexities of the FeSe/oxide interfaces and pave the way of designing novel low-dimensional high-temperature superconductors through interface engineering. We anticipate that the observed phenomenon is rather general and can take place in many two dimensional Van der Waals monolayers brought in contact with dielectric oxides or semiconducting substrates.


title: Establishing the accuracy of asteroseismic mass and radius estimates of giant stars III. KIC4054905, an eclipsing binary with two 10 Gyr thick disk RGB stars

abstract: Eclipsing binary stars with an oscillating giant component allow accurate stellar parameters to be derived and asteroseismic methods to be tested and calibrated. To this aim, suitable systems need to be firstly identified and secondly measured precisely and accurately. KIC 4054905 is one such system, which has been identified, but with measurements of a relatively low precision and with some confusion regarding its parameters and evolutionary state. Our aim is to provide a detailed and precise characterisation of the system and to test asteroseismic scaling relations. Dynamical and asteroseismic parameters of KIC4054905 were determined from Kepler photometry and multi-epoch high-resolution spectra from FIES at the Nordic Optical Telescope. KIC 4054905 was found to belong to the thick disk and consist of two lower red giant branch (RGB) components with nearly identical masses of 0.95$M_{\odot}$ and an age of $9.9\pm0.6$ Gyr. The most evolved star displays solar-like oscillations, which suggest that the star belongs to the RGB, supported also by the radius, which is significantly smaller than the red clump phase for this mass and metallicity. Masses and radii from corrected asteroseismic scaling relations can be brought into full agreement with the dynamical values if the RGB phase is assumed, but a best scaling method could not be identified. We measured dynamical masses and radii with a precision better than 1.0%. We firmly establish the evolutionary nature of the system to be that of two early RGB stars with an age close to 10 Gyr, unlike previous findings. The metallicity and Galactic velocity suggest that the system belongs to the thick disk of the Milky Way. We investigate the agreement between dynamical and asteroseismic parameters for KIC 4054905. Consistent solutions exist, but the need to analyse more systems continues in order to establish the accuracy of asteroseismic methods.


title: Graph Classification via Discriminative Edge Feature Learning

abstract: Spectral graph convolutional neural networks (GCNNs) have been producing encouraging results in graph classification tasks. However, most spectral GCNNs utilize fixed graphs when aggregating node features, while omitting edge feature learning and failing to get an optimal graph structure. Moreover, many existing graph datasets do not provide initialized edge features, further restraining the ability of learning edge features via spectral GCNNs. In this paper, we try to address this issue by designing an edge feature scheme and an add-on layer between every two stacked graph convolution layers in GCNN. Both are lightweight while effective in filling the gap between edge feature learning and performance enhancement of graph classification. The edge feature scheme makes edge features adapt to node representations at different graph convolution layers. The add-on layers help adjust the edge features to an optimal graph structure. To test the effectiveness of our method, we take Euclidean positions as initial node features and extract graphs with semantic information from point cloud objects. The node features of our extracted graphs are more scalable for edge feature learning than most existing graph datasets (in one-hot encoded label format). Three new graph datasets are constructed based on ModelNet40, ModelNet10 and ShapeNet Part datasets. Experimental results show that our method outperforms state-of-the-art graph classification methods on the new datasets by reaching 96.56% overall accuracy on Graph-ModelNet40, 98.79% on Graph-ModelNet10 and 97.91% on Graph-ShapeNet Part. The constructed graph datasets will be released to the community.


title: Discovery of double BSS sequences in the old Galactic open cluster Berkeley 17

abstract: Blue straggler stars (BSS) are peculiar objects which normally appear as a single broad sequence along the extension of the main sequence. Only four globular clusters (GCs) have been observed to have two distinct and parallel BSS sequences. For the first time for any open cluster (OC), we report double BSS sequences in Berkeley 17. Using the machine-learning based membership algorithm ML-MOC on Gaia EDR3 data, we identify 627 cluster members, including 21 BSS candidates out to 15 arcmin from the cluster center. Both the BSS sequences are almost equally populated and parallel to one another in Gaia as well as in Pan-STARRS colour-magnitude diagram (CMD). We statistically confirm their presence and report that both BSS sequences are highly segregated compared to the reference population out to $\sim$5.5 arcmin and not segregated thereafter. The lower densities of OCs make BSS formation impossible via the collisional channel. Therefore, mass transfer seems to be the only viable channel for forming candidates of both sequences. The gap between the red and blue BSS sequences, on the other hand, is significant and presents a great opportunity to understand the connection between BSS formation and internal as well as external dynamics of the parent clusters.


title: Weak lensing of gravitational waves in wave optics: Beyond the Born approximation

abstract: The Universe's matter inhomogeneity gravitationally affects the propagation of gravitational waves (GWs), causing the lensing effect. Particularly, the weak lensing of GWs has been studied within the range of the Born approximation to constrain the small-scale power spectrum. In this work, the validity of the Born approximation is investigated by accounting for the higher-order terms in the gravitational potential $\Phi$. To do so, we formulate the post-Born approximation and derive the magnification $K$ and the phase modulation $S$ up to third order in $\Phi$. We find that the average of $S$ and $K$ is non-zero and that the average of $S$ depends on the size of the point mass. Due to this size dependency, the signal is enhanced, and the number of GW events required for detecting the average of $S$ decreases. We find that this number can become comparable to or even smaller than the number required for detecting the variance of $S$ in certain scenarios. In addition, it is verified that, for lensing by dark low-mass halos, the post-Born corrections are a few orders of magnitude smaller than the Born approximation at $f\geq0.01$~Hz. However, in the presence of the point mass, there is a condition under which the Born approximation fails. We derive the correction terms to the Born approximation and identify the condition under which the Born approximation no longer holds. For the magnification, the Born approximation is valid as long as the wavelength of GWs is larger than the Schwarzschild radius of lenses, while for the phase modulation, this condition is modified due to the physical size of the point mass.


title: Improving Sentiment Analysis By Emotion Lexicon Approach on Vietnamese Texts

abstract: The sentiment analysis task has various applications in practice. In the sentiment analysis task, words and phrases that represent positive and negative emotions are important. Finding out the words that represent the emotion from the text can improve the performance of the classification models for the sentiment analysis task. In this paper, we propose a methodology that combines the emotion lexicon with the classification model to enhance the accuracy of the models. Our experimental results show that the emotion lexicon combined with the classification model improves the performance of models.


title: Impact of substrates and quantum effects on exciton line shapes of 2D semiconductors at room temperature

abstract: Exciton resonances in monolayer transition-metal dichalcogenides (TMDs) provide exceptionally strong light-matter interaction at room temperature. Their spectral line shape is critical in the design of a myriad of optoelectronic devices, ranging from solar cells to quantum information processing. However, disorder resulting from static inhomogeneities and dynamical fluctuations can significantly impact the line shape. Many recent works experimentally evaluate the optical properties of TMD monolayers placed on a substrate and the line shape is typically linked directly to the material's quality. Here, we highlight that the interference of the substrate and TMD reflections can strongly influence the line shape. We further show how basic, room-temperature reflection measurement allow investigation of the quantum mechanical exciton dynamics by systematically controlling the substrate reflection with index-matching oils. By removing the substrate contribution with a properly chosen oil, we can extract the excitonic decay rates including the quantum mechanical dephasing rate. The results provide valuable guidance for the engineering of exciton line shapes in layered nanophotonic systems.


title: Fraunhofer pattern in the presence of Majorana zero modes

abstract: We propose a new platform to detect signatures of the presence of Majorana bound states (MBSs) in the Fraunhofer pattern of Josephson junctions featuring quantum spin Hall edge states on the normal part and Majorana bound states at the NS interfaces. We use a tight-binding model to demonstrate a drastic change in the periodicity of the Fraunhofer pattern when comparing trivial and non-trivial regimes. We explain these results in terms of the presence of additional parallel-spin electron-hole reflections, which due to the spin-momentum locking, occur as cross Andreev reflections, accumulating a different magnetic flux and yielding a change in the Fraunhofer periodicity. We show that this detection scheme exhibits some advantages compared to previous ones as it is robust against disorder, finite temperature and works in equilibrium. Furthermore, we introduce a scattering model that captures the main results of the microscopic calculations with MBSs and extend our discussion to the main differences found using accidental zero energy ABSs.


title: Optimal heat kernel bounds and asymptotics on Damek--Ricci spaces

abstract: We give optimal bounds for the radial, space and time derivatives of arbitrary order of the heat kernel of the Laplace--Beltrami operator on Damek--Ricci spaces. In the case of symmetric spaces of rank one, these complete and actually improve conjectured estimates by Anker and Ji. We also provide asymptotics at infinity of all the radial and time derivates of the kernel. Along the way, we provide sharp bounds for all the derivatives of the Riemannian distance and obtain analogous bounds for those of the heat kernel of the distinguished Laplacian.


title: Computing maximal generalized palindromes

abstract: Palindromes are popular and important objects in textual data processing, bioinformatics, and combinatorics on words. Let $S = XaY$ be a string, where $X$ and $Y$ are of the same length and $a$ is either a single character or the empty string. Then, there exist two alternative definitions for palindromes: $S$ is said to be a palindrome if: Reversal-based definition: $S$ is equal to its reversal $S^R$; Symmetry-based definition: its left-arm $X$ is equal to the reversal of its right-arm $Y^R$. It is clear that if the "equality" ($\approx$) used in both definitions is exact character matching ($=$), then the two definitions are the same. However, if we apply other string-equality criteria $\approx$, including the complementary model for biological sequences, the parameterized model [Baker, JCSS 1996], the order-preserving model [Kim et al., TCS 2014], the Cartesian-tree model [Park et al., TCS 2020], and the palindromic-structure model [I et al., TCS 2013], then are the reversal-based palindromes and the symmetry-based palindromes the same? To the best of our knowledge, no previous work has considered or answered this natural question. In this paper, we first provide answers to this question, and then present efficient algorithms for computing all maximal generalized palindromes that occur in a given string. After confirming that Gusfield's offline suffix-tree based algorithm for computing maximal symmetry-based palindromes can be readily extended to the aforementioned matching models, we show how to extend Manacher's online algorithm for computing maximal reversal-based palindromes in linear time for all the aforementioned matching models.


title: Nonparametric Decoding for Generative Retrieval

abstract: The generative retrieval model depends solely on the information encoded in its model parameters without external memory, its information capacity is limited and fixed. To overcome the limitation, we propose Nonparametric Decoding (Np Decoding) which can be applied to existing generative retrieval models. Np Decoding uses nonparametric contextualized vocab embeddings (external memory) rather than vanilla vocab embeddings as decoder vocab embeddings. By leveraging the contextualized vocab embeddings, the generative retrieval model is able to utilize both the parametric and nonparametric space. Evaluation over 9 datasets (8 single-hop and 1 multi-hop) in the document retrieval task shows that applying Np Decoding to generative retrieval models significantly improves the performance. We also show that Np Decoding is data- and parameter-efficient, and shows high performance in the zero-shot setting.


title: Quasi-Normal Modes from Bound States: The Numerical Approach

abstract: It is known that the spectrum of quasi-normal modes of potential barriers is related to the spectrum of bound states of the corresponding potential wells. This property has been widely used to compute black hole quasi-normal modes, but it is limited to a few "approximate" potentials with certain transformation properties for which the spectrum of bound states must be known analytically. In this work we circumvent this limitation by proposing an approach that allows one to make use of potentials with similar transformation properties, but where the spectrum of bound states can also be computed numerically. Because the numerical calculation of bound states is usually more stable than the direct computation of the corresponding quasi-normal modes, the new approach is also interesting from a technical point of view. We apply the method to different potentials, including the P\"oschl-Teller potential for which all steps can be understood analytically, as well as potentials for which we are not aware of analytic results but provide independent numerical results for comparison. As a canonical test, all potentials are chosen to match the Regge-Wheeler potential of axial perturbations of the Schwarzschild black hole. We find that the new approximate potentials are more suitable to approximate the exact quasi-normal modes than the P\"oschl-Teller potential, particularly for the first overtone. We hope this work opens new perspectives to the computation of quasi-normal modes and finds further improvements and generalizations in the future.


title: Non-Convergence and Limit Cycles in the Adam optimizer

abstract: One of the most popular training algorithms for deep neural networks is the Adaptive Moment Estimation (Adam) introduced by Kingma and Ba. Despite its success in many applications there is no satisfactory convergence analysis: only local convergence can be shown for batch mode under some restrictions on the hyperparameters, counterexamples exist for incremental mode. Recent results show that for simple quadratic objective functions limit cycles of period 2 exist in batch mode, but only for atypical hyperparameters, and only for the algorithm without bias correction. %More general there are several more adaptive gradient methods which try to estimate a fitting learning rate and / or search direction from the training data to improve the learning process compared to pure gradient descent with fixed learningrate. We extend the convergence analysis for Adam in the batch mode with bias correction and show that even for quadratic objective functions as the simplest case of convex functions 2-limit-cycles exist, for all choices of the hyperparameters. We analyze the stability of these limit cycles and relate our analysis to other results where approximate convergence was shown, but under the additional assumption of bounded gradients which does not apply to quadratic functions. The investigation heavily relies on the use of computer algebra due to the complexity of the equations.


title: Advanced Deep Learning Architectures for Accurate Detection of Subsurface Tile Drainage Pipes from Remote Sensing Images

abstract: Subsurface tile drainage pipes provide agronomic, economic and environmental benefits. By lowering the water table of wet soils, they improve the aeration of plant roots and ultimately increase the productivity of farmland. They do however also provide an entryway of agrochemicals into subsurface water bodies and increase nutrition loss in soils. For maintenance and infrastructural development, accurate maps of tile drainage pipe locations and drained agricultural land are needed. However, these maps are often outdated or not present. Different remote sensing (RS) image processing techniques have been applied over the years with varying degrees of success to overcome these restrictions. Recent developments in deep learning (DL) techniques improve upon the conventional techniques with machine learning segmentation models. In this study, we introduce two DL-based models: i) improved U-Net architecture; and ii) Visual Transformer-based encoder-decoder in the framework of tile drainage pipe detection. Experimental results confirm the effectiveness of both models in terms of detection accuracy when compared to a basic U-Net architecture. Our code and models are publicly available at https://git.tu-berlin.de/rsim/drainage-pipes-detection.


title: Optimal Control of the F${_1}$-ATPase Molecular Motor

abstract: F$_{1}$-ATPase is a rotary molecular motor that \emph{in vivo} is subject to strong nonequilibrium driving forces. There is great interest in understanding the operational principles governing its high efficiency of free-energy transduction. Here we use a near-equilibrium framework to design a non-trivial control protocol to minimize dissipation in rotating F$_{1}$ to synthesize ATP. We find that the designed protocol requires much less work than a naive (constant-velocity) protocol across a wide range of protocol durations. Our analysis points to a possible mechanism for energetically efficient driving of F$_{1}$ \emph{in vivo} and provides insight into free-energy transduction for a broader class of biomolecular and synthetic machines.


title: CMOS based high-resolution dynamic X-ray imaging with inorganic perovskite

abstract: High-resolution dynamic X-ray detector is crucial for time-resolved digital radiography (DR) imaging and fast 3D medical computed tomography (CT) imaging. Recently, perovskites have become promising alternatives to conventional semi-conductor materials, e.g., Si, a-Se and CdTe, for direct X-ray detection. However, the feasibility of their combination with high-speed pixelated complementary metal-oxide-semiconductor (CMOS) arrays remains unknown. This work originally reports an innovative direct-conversion X-ray detector fabricated with 300 micrometer thick inorganic perovskite film printed on a tailored CMOS array. In-house measurements demonstrate that the CsPbBr3 film has excellent optoelectric properties of an electron mobility-lifetime product of 3.40x10$^{-5}$ cm$^2$ V$^{-1}$, and the X-ray detector exhibits high sensitivity of 9341uC Gy$_{\rm air}^{-1}$ cm$^{-2}$, and low detection limit of 588 nGy$_{\rm air}^{-1}$. This CMOS X-ray imaging detector achieves a high spatial resolution up to 5.5 lp/mm (close to the resolution limit of 6.0 lp/mm), and >300 frame per second (fps) readout speed. DR image of a resolution pattern phantom and a anesthesia mice, CT images of a biological specimen are acquired for the first time.


title: Two Video Data Sets for Tracking and Retrieval of Out of Distribution Objects

abstract: In this work we present two video test data sets for the novel computer vision (CV) task of out of distribution tracking (OOD tracking). Here, OOD objects are understood as objects with a semantic class outside the semantic space of an underlying image segmentation algorithm, or an instance within the semantic space which however looks decisively different from the instances contained in the training data. OOD objects occurring on video sequences should be detected on single frames as early as possible and tracked over their time of appearance as long as possible. During the time of appearance, they should be segmented as precisely as possible. We present the SOS data set containing 20 video sequences of street scenes and more than 1000 labeled frames with up to two OOD objects. We furthermore publish the synthetic CARLA-WildLife data set that consists of 26 video sequences containing up to four OOD objects on a single frame. We propose metrics to measure the success of OOD tracking and develop a baseline algorithm that efficiently tracks the OOD objects. As an application that benefits from OOD tracking, we retrieve OOD sequences from unlabeled videos of street scenes containing OOD objects.


title: On the Learning Mechanisms in Physical Reasoning

abstract: Is dynamics prediction indispensable for physical reasoning? If so, what kind of roles do the dynamics prediction modules play during the physical reasoning process? Most studies focus on designing dynamics prediction networks and treating physical reasoning as a downstream task without investigating the questions above, taking for granted that the designed dynamics prediction would undoubtedly help the reasoning process. In this work, we take a closer look at this assumption, exploring this fundamental hypothesis by comparing two learning mechanisms: Learning from Dynamics (LfD) and Learning from Intuition (LfI). In the first experiment, we directly examine and compare these two mechanisms. Results show a surprising finding: Simple LfI is better than or on par with state-of-the-art LfD. This observation leads to the second experiment with Ground-truth Dynamics, the ideal case of LfD wherein dynamics are obtained directly from a simulator. Results show that dynamics, if directly given instead of approximated, would achieve much higher performance than LfI alone on physical reasoning; this essentially serves as the performance upper bound. Yet practically, LfD mechanism can only predict Approximate Dynamics using dynamics learning modules that mimic the physical laws, making the following downstream physical reasoning modules degenerate into the LfI paradigm; see the third experiment. We note that this issue is hard to mitigate, as dynamics prediction errors inevitably accumulate in the long horizon. Finally, in the fourth experiment, we note that LfI, the extremely simpler strategy when done right, is more effective in learning to solve physical reasoning problems. Taken together, the results on the challenging benchmark of PHYRE show that LfI is, if not better, as good as LfD for dynamics prediction. However, the potential improvement from LfD, though challenging, remains lucrative.


title: A new characterisation of the Fermat curve

abstract: This paper presents a new characterisation of the Fermat curve, according to the arrangement of Galois points.


title: Exploring The Role of Mean Teachers in Self-supervised Masked Auto-Encoders

abstract: Masked image modeling (MIM) has become a popular strategy for self-supervised learning~(SSL) of visual representations with Vision Transformers. A representative MIM model, the masked auto-encoder (MAE), randomly masks a subset of image patches and reconstructs the masked patches given the unmasked patches. Concurrently, many recent works in self-supervised learning utilize the student/teacher paradigm which provides the student with an additional target based on the output of a teacher composed of an exponential moving average (EMA) of previous students. Although common, relatively little is known about the dynamics of the interaction between the student and teacher. Through analysis on a simple linear model, we find that the teacher conditionally removes previous gradient directions based on feature similarities which effectively acts as a conditional momentum regularizer. From this analysis, we present a simple SSL method, the Reconstruction-Consistent Masked Auto-Encoder (RC-MAE) by adding an EMA teacher to MAE. We find that RC-MAE converges faster and requires less memory usage than state-of-the-art self-distillation methods during pre-training, which may provide a way to enhance the practicality of prohibitively expensive self-supervised learning of Vision Transformer models. Additionally, we show that RC-MAE achieves more robustness and better performance compared to MAE on downstream tasks such as ImageNet-1K classification, object detection, and instance segmentation.


title: Gravitational microlensing by dressed primordial black holes

abstract: The accretion of dark matter around the primordial black holes (PBHs) could lead to the formation of surrounding minihalos, whose mass can be several orders of magnitude higher than the central PBH mass. The gravitational microlensing produced by such dressed PBHs could be quite different from that of the bare PBHs, which may significantly affect the constraints on the PBH abundance. In this paper, we study the gravitational microlensing produced by dressed PBHs in detail. We find that all the microlensing effects by dressed PBHs have asymptotic behavior depending on the minihalo size, which can be used to predict the microlensing effects by comparing the halo size with the Einstein radius. When the minihalo radius and the Einstein radius are comparable, the effect of the density distribution of the halo is significant to the microlensing. Applying the stellar microlensing by dressed PBHs to the data of the Optical Gravitational Lensing Experiment and Subaru/HSC Andromeda observations, we obtain the improved constraints on the PBH abundance. It shows that the existence of dark matter minihalos surrounding PBHs can strengthen the constraints on the PBH abundance from stellar microlensing by several orders, and can shift the constraints to the well-known asteroid mass window where PBHs can constitute all the dark matter.


title: Diffusive Fluctuations in Hard Rods System

abstract: We examine the behaviour of density fluctuation in equilibrium under diffusive space-time scaling of a completely integrable dynamics of hard rods with variable length. This is the extended abstract of a talk given by S.Olla at the workshop 'Large Stochastic Dynamics', Oberwolfach, 12-17 September 2022


title: Extremal Kirchhoff index in polycyclic chains

abstract: The Kirchhoff index of graphs, introduced by Klein and Randi\'{c} in 1993, has been known useful in the study of computer science, complex network and quantum chemistry. The Kirchhoff index of a graph $G$ is defined as $Kf(G)=\sum\limits_{\{u,v\}\subseteq V(G)}\Omega_{G}(u,v)$, where $\Omega_{G}(u,v)$ denotes the resistance distance between $u$ and $v$ in $G$. In this paper, we determine the maximum (resp. minimum) $k$-polycyclic chains with respect to Kirchhoff index for $k\geq 5$, which extends the results of Yang and Klein [Comparison theorems on resistance distances and Kirchhoff indices of $S,T$-isomers, Discrete Appl. Math. 175 (2014) 87-93], Yang and Sun [Minimal hexagonal chains with respect to the Kirchhoff index, Discrete Math. 345 (2022) 113099], Sun and Yang [Extremal pentagonal chains with respect to the Kirchhoff index, Appl. Math. Comput. 437 (2023) 127534] and Ma [Extremal octagonal chains with respect to the Kirchhoff index, arXiv: 2209.10264].


title: Locate before Answering: Answer Guided Question Localization for Video Question Answering

abstract: Video question answering (VideoQA) is an essential task in vision-language understanding, which has attracted numerous research attention recently. Nevertheless, existing works mostly achieve promising performances on short videos of duration within 15 seconds. For VideoQA on minute-level long-term videos, those methods are likely to fail because of lacking the ability to deal with noise and redundancy caused by scene changes and multiple actions in the video. Considering the fact that the question often remains concentrated in a short temporal range, we propose to first locate the question to a segment in the video and then infer the answer using the located segment only. Under this scheme, we propose "Locate before Answering" (LocAns), a novel approach that integrates a question locator and an answer predictor into an end-to-end model. During the training phase, the available answer label not only serves as the supervision signal of the answer predictor, but also is used to generate pseudo temporal labels for the question locator. Moreover, we design a decoupled alternative training strategy to update the two modules separately. In the experiments, LocAns achieves state-of-the-art performance on two modern long-term VideoQA datasets NExT-QA and ActivityNet-QA, and its qualitative examples show the reliable performance of the question localization.


title: Jitter Does Matter: Adapting Gaze Estimation to New Domains

abstract: Deep neural networks have demonstrated superior performance on appearance-based gaze estimation tasks. However, due to variations in person, illuminations, and background, performance degrades dramatically when applying the model to a new domain. In this paper, we discover an interesting gaze jitter phenomenon in cross-domain gaze estimation, i.e., the gaze predictions of two similar images can be severely deviated in target domain. This is closely related to cross-domain gaze estimation tasks, but surprisingly, it has not been noticed yet previously. Therefore, we innovatively propose to utilize the gaze jitter to analyze and optimize the gaze domain adaptation task. We find that the high-frequency component (HFC) is an important factor that leads to jitter. Based on this discovery, we add high-frequency components to input images using the adversarial attack and employ contrastive learning to encourage the model to obtain similar representations between original and perturbed data, which reduces the impacts of HFC. We evaluate the proposed method on four cross-domain gaze estimation tasks, and experimental results demonstrate that it significantly reduces the gaze jitter and improves the gaze estimation performance in target domains.


title: Multi-View Independent Component Analysis with Shared and Individual Sources

abstract: Independent component analysis (ICA) is a blind source separation method for linear disentanglement of independent latent sources from observed data. We investigate the special setting of noisy linear ICA where the observations are split among different views, each receiving a mixture of shared and individual sources. We prove that the corresponding linear structure is identifiable, and the source distribution can be recovered. To computationally estimate the sources, we optimize a constrained form of the joint log-likelihood of the observed data among all views. We also show empirically that our objective recovers the sources also in the case when the measurements are corrupted by noise. Furthermore, we propose a model selection procedure for recovering the number of shared sources which we verify empirically. Finally, we apply the proposed model in a challenging real-life application, where the estimated shared sources from two large transcriptome datasets (observed data) provided by two different labs (two different views) lead to recovering (shared) sources utilized for finding a plausible representation of the underlying graph structure.


title: Particle swarm optimization of a wind farm layout with active control of turbine yaws

abstract: Active yaw control (AYC) of wind turbines has been widely applied to increase the annual energy production (AEP) of a wind farm. AYC efficiency depends on the wind direction and the wind farm layout because an AYC method utilizes wake deflection by yawing wind turbines. Conventional optimization of a wind farm layout assumed that the swept areas of all wind turbines are aligned perpendicular to the wind direction, thereby allowing non-optimal utilization of an AYC method. Higher AEP can be obtained by joint optimization which considers an AYC method in the layout design stage. Joint optimization of the farm layout and AYC has been difficult due to the non-convexity of the problem and the computational inefficiency. In the present study, a particle swarm optimization based method is developed for joint optimization. The layout is optimized with simultaneous consideration for yaw angles for all wind velocities to obtain a globally optimal layout. A number of random initial particles consisting of the layout and yaw angles of wind turbines reduce the initial layout dependency on the optimized layout. To deal with the challenge of large-scale optimization, the adaptive granularity learning distributed particle swarm optimization algorithm is implemented. The improvement in AEP when using a jointly optimized layout compared to a conventionally optimized layout in a real wind farm is demonstrated using the present method.


title: DooML: A new Database & Object-Oriented Modeling Language for database-driven web application design and development

abstract: A database driven web application is a very common software solution to rising business problems. Modeling the database and the software architecture can be challenging, hence there not being one combined modeling language for database and software architecture, specifically suited for web application development. In this paper we present Database object-oriented Modeling Language (DooML) and its primary Archetype Diagram: a notation for specifying the design of a database schema and corresponding object-oriented software architecture. It combines the syntax for drawing Entity Relationship Diagrams, the Relational Model and Universal Modeling Language Class Diagrams as well to create a mixed diagram, stating database design as well as software design specifications. By default, DooML ensures that the approach of advanced web application development is model-driven and both database-oriented as well as object-oriented.


title: Calibrating the Cepheid Period--Wesenheit Relation in the Gaia Bands using Galactic Open Cluster Cepheids

abstract: Establishing the period--Wesenheit relation requires independent and accurate distance measurements of classical Cepheids (DCEPs). The precise distance provided by an associated open cluster independently calibrates the period--Wesenheit relation of DCEPs. 51 DCEPs associated with open clusters are compiled using the constraints of five-dimensional astrometric information. By directly using Gaia DR3 parallax, the period--Wesenheit relation in the Gaia $G$ band is calibrated as $W_G = (-3.06 \pm 0.11) \log P + (-2.96 \pm 0.10)$. Compared with the results derived by directly adopting the DCEP parallaxes or using distance moduli, the Wesenheit magnitudes based on the cluster-averaged parallaxes exhibit a tighter relation with the period. Besides, there is a systematic offset between the observed Wesenheit absolute magnitudes of distant OC-DCEPs and their fitted magnitudes. After considering the parallax zero-point correction, the systematic offset can be reduced, yielding a probably better PW relation of $W_G = (-2.94 \pm 0.12) \log P + (-2.93 \pm 0.11)$.


title: Bilinear Exponential Family of MDPs: Frequentist Regret Bound with Tractable Exploration and Planning

abstract: We study the problem of episodic reinforcement learning in continuous state-action spaces with unknown rewards and transitions. Specifically, we consider the setting where the rewards and transitions are modeled using parametric bilinear exponential families. We propose an algorithm, BEF-RLSVI, that a) uses penalized maximum likelihood estimators to learn the unknown parameters, b) injects a calibrated Gaussian noise in the parameter of rewards to ensure exploration, and c) leverages linearity of the exponential family with respect to an underlying RKHS to perform tractable planning. We further provide a frequentist regret analysis of BEF-RLSVI that yields an upper bound of $\tilde{\mathcal{O}}(\sqrt{d^3H^3K})$, where $d$ is the dimension of the parameters, $H$ is the episode length, and $K$ is the number of episodes. Our analysis improves the existing bounds for the bilinear exponential family of MDPs by $\sqrt{H}$ and removes the handcrafted clipping deployed in existing \RLSVI-type algorithms. Our regret bound is order-optimal with respect to $H$ and $K$.


title: WUDA: Unsupervised Domain Adaptation Based on Weak Source Domain Labels

abstract: Unsupervised domain adaptation (UDA) for semantic segmentation addresses the cross-domain problem with fine source domain labels. However, the acquisition of semantic labels has always been a difficult step, many scenarios only have weak labels (e.g. bounding boxes). For scenarios where weak supervision and cross-domain problems coexist, this paper defines a new task: unsupervised domain adaptation based on weak source domain labels (WUDA). To explore solutions for this task, this paper proposes two intuitive frameworks: 1) Perform weakly supervised semantic segmentation in the source domain, and then implement unsupervised domain adaptation; 2) Train an object detection model using source domain data, then detect objects in the target domain and implement weakly supervised semantic segmentation. We observe that the two frameworks behave differently when the datasets change. Therefore, we construct dataset pairs with a wide range of domain shifts and conduct extended experiments to analyze the impact of different domain shifts on the two frameworks. In addition, to measure domain shift, we apply the metric representation shift to urban landscape image segmentation for the first time. The source code and constructed datasets are available at \url{https://github.com/bupt-ai-cz/WUDA}.


title: Transformer-based conditional generative adversarial network for multivariate time series generation

abstract: Conditional generation of time-dependent data is a task that has much interest, whether for data augmentation, scenario simulation, completing missing data, or other purposes. Recent works proposed a Transformer-based Time series generative adversarial network (TTS-GAN) to address the limitations of recurrent neural networks. However, this model assumes a unimodal distribution and tries to generate samples around the expectation of the real data distribution. One of its limitations is that it may generate a random multivariate time series; it may fail to generate samples in the presence of multiple sub-components within an overall distribution. One could train models to fit each sub-component separately to overcome this limitation. Our work extends the TTS-GAN by conditioning its generated output on a particular encoded context allowing the use of one model to fit a mixture distribution with multiple sub-components. Technically, it is a conditional generative adversarial network that models realistic multivariate time series under different types of conditions, such as categorical variables or multivariate time series. We evaluate our model on UniMiB Dataset, which contains acceleration data following the XYZ axes of human activities collected using Smartphones. We use qualitative evaluations and quantitative metrics such as Principal Component Analysis (PCA), and we introduce a modified version of the Frechet inception distance (FID) to measure the performance of our model and the statistical similarities between the generated and the real data distributions. We show that this transformer-based CGAN can generate realistic high-dimensional and long data sequences under different kinds of conditions.


title: Joint Communication and Computation in Hybrid Cloud/Mobile Edge Computing Networks

abstract: Facing a vast amount of connections, huge performance demands, and the need for reliable connectivity, the sixth generation of communication networks (6G) is envisioned to implement disruptive technologies that jointly spur connectivity, performance, and reliability. In this context, this paper proposes, and evaluates the benefit of, a hybrid central cloud (CC) computing and mobile edge computing (MEC) platform, especially introduced to balance the network resources required for joint computation and communication. Consider a hybrid cloud and MEC system, where several power-hungry multi-antenna unmanned aerial vehicles (UAVs) are deployed at the cell-edge to boost the CC connectivity and relieve part of its computation burden. While the multi-antenna base stations are connected to the cloud via capacity-limited fronthaul links, the UAVs serve the cell-edge users with limited power and computational capabilities. The paper then considers the problem of maximizing the weighted network sum-rate subject to per-user delay, computational capacity, and power constraints, so as to determine the beamforming vectors and computation allocations. Such intricate non-convex optimization problem is tackled using an iterative algorithm that relies on $\ell_0$-norm relaxation, successive convex approximation, and fractional programming, and has the compelling ability to be implemented in a distributed fashion across the multiple UAVs and the CC. The paper results illustrate the numerical prospects of the proposed algorithm for enabling joint communication and computation, and highlight the appreciable improvements of data processing delays and throughputs as compared to conventional system strategies.


title: Tripletformer for Probabilistic Interpolation of Irregularly sampled Time Series

abstract: Irregularly sampled time series data with missing values is observed in many fields like healthcare, astronomy, and climate science. Interpolation of these types of time series is crucial for tasks such as root cause analysis and medical diagnosis, as well as for smoothing out irregular or noisy data. To address this challenge, we present a novel encoder-decoder architecture called "Tripletformer" for probabilistic interpolation of irregularly sampled time series with missing values. This attention-based model operates on sets of observations, where each element is composed of a triple of time, channel, and value. The encoder and decoder of the Tripletformer are designed with attention layers and fully connected layers, enabling the model to effectively process the presented set elements. We evaluate the Tripletformer against a range of baselines on multiple real-world and synthetic datasets and show that it produces more accurate and certain interpolations. Results indicate an improvement in negative loglikelihood error by up to 32% on real-world datasets and 85% on synthetic datasets when using the Tripletformer compared to the next best model.


title: Functional Central Limit Theorem and Strong Law of Large Numbers for Stochastic Gradient Langevin Dynamics

abstract: We study the mixing properties of an important optimization algorithm of machine learning: the stochastic gradient Langevin dynamics (SGLD) with a fixed step size. The data stream is not assumed to be independent hence the SGLD is not a Markov chain, merely a \emph{Markov chain in a random environment}, which complicates the mathematical treatment considerably. We derive a strong law of large numbers and a functional central limit theorem for SGLD.


title: Centralized Feature Pyramid for Object Detection

abstract: Visual feature pyramid has shown its superiority in both effectiveness and efficiency in a wide range of applications. However, the existing methods exorbitantly concentrate on the inter-layer feature interactions but ignore the intra-layer feature regulations, which are empirically proved beneficial. Although some methods try to learn a compact intra-layer feature representation with the help of the attention mechanism or the vision transformer, they ignore the neglected corner regions that are important for dense prediction tasks. To address this problem, in this paper, we propose a Centralized Feature Pyramid (CFP) for object detection, which is based on a globally explicit centralized feature regulation. Specifically, we first propose a spatial explicit visual center scheme, where a lightweight MLP is used to capture the globally long-range dependencies and a parallel learnable visual center mechanism is used to capture the local corner regions of the input images. Based on this, we then propose a globally centralized regulation for the commonly-used feature pyramid in a top-down fashion, where the explicit visual center information obtained from the deepest intra-layer feature is used to regulate frontal shallow features. Compared to the existing feature pyramids, CFP not only has the ability to capture the global long-range dependencies, but also efficiently obtain an all-round yet discriminative feature representation. Experimental results on the challenging MS-COCO validate that our proposed CFP can achieve the consistent performance gains on the state-of-the-art YOLOv5 and YOLOX object detection baselines.