title: Input optics systems of the KAGRA detector during O3GK

abstract: KAGRA, the underground and cryogenic gravitational-wave detector, was operated for its solo observation from February 25th to March 10th, 2020, and its first joint observation with the GEO 600 detector from April 7th -- 21st, 2020 (O3GK). This study presents an overview of the input optics systems of the KAGRA detector, which consist of various optical systems, such as a laser source, its intensity and frequency stabilization systems, modulators, a Faraday isolator, mode-matching telescopes, and a high-power beam dump. These optics were successfully delivered to the KAGRA interferometer and operated stably during the observations. The laser frequency noise was observed to limit the detector sensitivity above a few kHz, whereas the laser intensity did not significantly limit the detector sensitivity.


title: Optimizing Evaluation Metrics for Multi-Task Learning via the Alternating Direction Method of Multipliers

abstract: Multi-task learning (MTL) aims to improve the generalization performance of multiple tasks by exploiting the shared factors among them. Various metrics (e.g., F-score, Area Under the ROC Curve) are used to evaluate the performances of MTL methods. Most existing MTL methods try to minimize either the misclassified errors for classification or the mean squared errors for regression. In this paper, we propose a method to directly optimize the evaluation metrics for a large family of MTL problems. The formulation of MTL that directly optimizes evaluation metrics is the combination of two parts: (1) a regularizer defined on the weight matrix over all tasks, in order to capture the relatedness of these tasks; (2) a sum of multiple structured hinge losses, each corresponding to a surrogate of some evaluation metric on one task. This formulation is challenging in optimization because both of its parts are non-smooth. To tackle this issue, we propose a novel optimization procedure based on the alternating direction scheme of multipliers, where we decompose the whole optimization problem into a sub-problem corresponding to the regularizer and another sub-problem corresponding to the structured hinge losses. For a large family of MTL problems, the first sub-problem has closed-form solutions. To solve the second sub-problem, we propose an efficient primal-dual algorithm via coordinate ascent. Extensive evaluation results demonstrate that, in a large family of MTL problems, the proposed MTL method of directly optimization evaluation metrics has superior performance gains against the corresponding baseline methods.


title: Equal Experience in Recommender Systems

abstract: We explore the fairness issue that arises in recommender systems. Biased data due to inherent stereotypes of particular groups (e.g., male students' average rating on mathematics is often higher than that on humanities, and vice versa for females) may yield a limited scope of suggested items to a certain group of users. Our main contribution lies in the introduction of a novel fairness notion (that we call equal experience), which can serve to regulate such unfairness in the presence of biased data. The notion captures the degree of the equal experience of item recommendations across distinct groups. We propose an optimization framework that incorporates the fairness notion as a regularization term, as well as introduce computationally-efficient algorithms that solve the optimization. Experiments on synthetic and benchmark real datasets demonstrate that the proposed framework can indeed mitigate such unfairness while exhibiting a minor degradation of recommendation accuracy.


title: The JCMT BISTRO Survey: A Spiral Magnetic Field in a Hub-filament Structure, Monoceros R2

abstract: We present and analyze observations of polarized dust emission at 850 $\mu$m towards the central 1 pc $\times$ 1 pc hub-filament structure of Monoceros R2 (Mon R2). The data are obtained with SCUBA-2/POL-2 on the James Clerk Maxwell Telescope (JCMT) as part of the BISTRO (B-fields in Star-forming Region Observations) survey. The orientations of the magnetic field follow the spiral structure of Mon R2, which are well-described by an axisymmetric magnetic field model. We estimate the turbulent component of the magnetic field using the angle difference between our observations and the best-fit model of the underlying large-scale mean magnetic field. This estimate is used to calculate the magnetic field strength using the Davis-Chandrasekhar-Fermi method, for which we also obtain the distribution of volume density and velocity dispersion using a column density map derived from $Herschel$ data and the C$^{18}$O ($J$ = 3-2) data taken with HARP on the JCMT, respectively. We make maps of magnetic field strengths and mass-to-flux ratios, finding that magnetic field strengths vary from 0.02 to 3.64 mG with a mean value of 1.0 $\pm$ 0.06 mG, and the mean critical mass-to-flux ratio is 0.47 $\pm$ 0.02. Additionally, the mean Alfv\'en Mach number is 0.35 $\pm$ 0.01. This suggests that in Mon R2, magnetic fields provide resistance against large-scale gravitational collapse, and magnetic pressure exceeds turbulent pressure. We also investigate the properties of each filament in Mon R2. Most of the filaments are aligned along the magnetic field direction and are magnetically sub-critical.


title: Robust Models are less Over-Confident

abstract: Despite the success of convolutional neural networks (CNNs) in many academic benchmarks for computer vision tasks, their application in the real-world is still facing fundamental challenges. One of these open problems is the inherent lack of robustness, unveiled by the striking effectiveness of adversarial attacks. Current attack methods are able to manipulate the network's prediction by adding specific but small amounts of noise to the input. In turn, adversarial training (AT) aims to achieve robustness against such attacks and ideally a better model generalization ability by including adversarial samples in the trainingset. However, an in-depth analysis of the resulting robust models beyond adversarial robustness is still pending. In this paper, we empirically analyze a variety of adversarially trained models that achieve high robust accuracies when facing state-of-the-art attacks and we show that AT has an interesting side-effect: it leads to models that are significantly less overconfident with their decisions, even on clean data than non-robust models. Further, our analysis of robust models shows that not only AT but also the model's building blocks (like activation functions and pooling) have a strong influence on the models' prediction confidences. Data & Project website: https://github.com/GeJulia/robustness_confidences_evaluation


title: Multi-wavelength observations of the obscuring wind in the radio-quiet quasar MR 2251-178

abstract: Obscuring winds driven away from active supermassive black holes are rarely seen due to their transient nature. They have been observed with multi-wavelength observations in a few Seyfert 1 galaxies and one broad absorption line radio-quiet quasar so far. An X-ray obscuration event in MR 2251-178 was caught in late 2020, which triggered multi-wavelength (NIR to X-ray) observations targeting this radio-quiet quasar. In the X-ray band, the obscurer leads to a flux drop in the soft X-ray band from late 2020 to early 2021. X-ray obscuration events might have a quasi-period of two decades considering earlier events in 1980 and 1996. In the UV band, a forest of weak blueshifted absorption features emerged in the blue wing of Ly$\alpha$ $\lambda1216$ in late 2020. Our XMM-Newton, NuSTAR, and HST/COS observations are obtained simultaneously, hence, the transient X-ray obscuration event is expected to account for the UV outflow, although they are not necessarily caused by the same part of the wind. Both blueshifted and redshifted absorption features were found for He {\sc i} $\lambda10830$, but no previous NIR spectra are available for comparison. The X-ray observational features of MR 2251-178 shared similarities with some other type 1 AGNs with obscuring wind. However, observational features in the UV to NIR bands are distinctly different from those seen in other AGN with obscuring winds. A general understanding of the observational variety and the nature of obscuring wind is still lacking.


title: Distance Seidel matrix of a connected graph

abstract: For a connected graph $G$, we present the concept of a new graph matrix related to its distance and Seidel matrix, called distance Seidel matrix $\mathcal{D}^S(G)$. Suppose that the eigenvalues of $\mathcal{D}^S(G)$ be $\partial_{1}^{S}(G) \geq \cdots \geq \partial_{n}^{S}(G).$ In this article, we establish a relationship between distance Seidel eigenvalues of a graph with its distance and adjacency eigenvalues. We characterize all the connected graphs with $\partial_{1}^{S}(G)= 3.$ Also, we determine different bounds for the distance Seidel spectral radius and distance Seidel energy. We study the distance Seidel energy change of the complete bipartite graph due to the deletion of an edge. Moreover, we obtain the distance Seidel spectra of different graph operations such as join, cartesian product, lexicographic product, and unary operations like the double graph and extended double cover graph. We give various families of distance Seidel cospectral and distance Seidel integral graphs as an application.


title: Decomposed Knowledge Distillation for Class-Incremental Semantic Segmentation

abstract: Class-incremental semantic segmentation (CISS) labels each pixel of an image with a corresponding object/stuff class continually. To this end, it is crucial to learn novel classes incrementally without forgetting previously learned knowledge. Current CISS methods typically use a knowledge distillation (KD) technique for preserving classifier logits, or freeze a feature extractor, to avoid the forgetting problem. The strong constraints, however, prevent learning discriminative features for novel classes. We introduce a CISS framework that alleviates the forgetting problem and facilitates learning novel classes effectively. We have found that a logit can be decomposed into two terms. They quantify how likely an input belongs to a particular class or not, providing a clue for a reasoning process of a model. The KD technique, in this context, preserves the sum of two terms (i.e., a class logit), suggesting that each could be changed and thus the KD does not imitate the reasoning process. To impose constraints on each term explicitly, we propose a new decomposed knowledge distillation (DKD) technique, improving the rigidity of a model and addressing the forgetting problem more effectively. We also introduce a novel initialization method to train new classifiers for novel classes. In CISS, the number of negative training samples for novel classes is not sufficient to discriminate old classes. To mitigate this, we propose to transfer knowledge of negatives to the classifiers successively using an auxiliary classifier, boosting the performance significantly. Experimental results on standard CISS benchmarks demonstrate the effectiveness of our framework.


title: Topological Radicals of Semicrossed Products

abstract: We characterize the hypocompact radical of a semicrossed product in terms of properties of the dynamical system. We show that an element A of a semicrossed product is in the hypocompact radical if and only if the Fourier coefficients of A vanish on the closure of the recurrent points and the 0-Fourier coefficient vanishes also on the largest perfect subset of X.


title: Dispersive decay bound of small data solutions to higher order scattering-supercritical KdV-type equations

abstract: In this article, we prove that small localized data yield solutions to Higher order Korteweg-de Vries type equation with scattering-supercritical nonlinearity have linear dispersive decay in only a finite length of time. The proof is done by using space-time resonance method and analyzing the oscillatory integrals on the Fourier side.


title: ACSeg: Adaptive Conceptualization for Unsupervised Semantic Segmentation

abstract: Recently, self-supervised large-scale visual pre-training models have shown great promise in representing pixel-level semantic relationships, significantly promoting the development of unsupervised dense prediction tasks, e.g., unsupervised semantic segmentation (USS). The extracted relationship among pixel-level representations typically contains rich class-aware information that semantically identical pixel embeddings in the representation space gather together to form sophisticated concepts. However, leveraging the learned models to ascertain semantically consistent pixel groups or regions in the image is non-trivial since over/ under-clustering overwhelms the conceptualization procedure under various semantic distributions of different images. In this work, we investigate the pixel-level semantic aggregation in self-supervised ViT pre-trained models as image Segmentation and propose the Adaptive Conceptualization approach for USS, termed ACSeg. Concretely, we explicitly encode concepts into learnable prototypes and design the Adaptive Concept Generator (ACG), which adaptively maps these prototypes to informative concepts for each image. Meanwhile, considering the scene complexity of different images, we propose the modularity loss to optimize ACG independent of the concept number based on estimating the intensity of pixel pairs belonging to the same concept. Finally, we turn the USS task into classifying the discovered concepts in an unsupervised manner. Extensive experiments with state-of-the-art results demonstrate the effectiveness of the proposed ACSeg.


title: On polynomial invariant rings in modular invariant theory

abstract: Let $\Bbbk$ be a field of characteristic $p>0$, $V$ a finite-dimensional $\Bbbk$-vector-space, and $G$ a finite $p$-group acting $\Bbbk$-linearly on $V$. Let $S = \Sym V^*$. We show that $S^G$ is a polynomial ring if and only if the dimension of its singular locus is less than $\rank_\Bbbk V^G$. Confirming a conjecture of Shank-Wehlau-Broer, we show that if $S^G$ is a direct summand of $S$, then $S^G$ is a polynomial ring, in the following cases: \begin{enumerate} \item $\Bbbk = \bbF_p$ and $\rank_\Bbbk V^G = 4$; or \item $|G| = p^3$. \end{enumerate} In order to prove the above result, we also show that if $\rank_\Bbbk V^G \geq \rank_\Bbbk V - 2$, then the Hilbert ideal $\hilbertIdeal_{G,S}$ is a complete intersection.


title: Self-Supervised Equivariant Regularization Reconciles Multiple Instance Learning: Joint Referable Diabetic Retinopathy Classification and Lesion Segmentation

abstract: Lesion appearance is a crucial clue for medical providers to distinguish referable diabetic retinopathy (rDR) from non-referable DR. Most existing large-scale DR datasets contain only image-level labels rather than pixel-based annotations. This motivates us to develop algorithms to classify rDR and segment lesions via image-level labels. This paper leverages self-supervised equivariant learning and attention-based multi-instance learning (MIL) to tackle this problem. MIL is an effective strategy to differentiate positive and negative instances, helping us discard background regions (negative instances) while localizing lesion regions (positive ones). However, MIL only provides coarse lesion localization and cannot distinguish lesions located across adjacent patches. Conversely, a self-supervised equivariant attention mechanism (SEAM) generates a segmentation-level class activation map (CAM) that can guide patch extraction of lesions more accurately. Our work aims at integrating both methods to improve rDR classification accuracy. We conduct extensive validation experiments on the Eyepacs dataset, achieving an area under the receiver operating characteristic curve (AU ROC) of 0.958, outperforming current state-of-the-art algorithms.


title: Adaptive Dual Channel Convolution Hypergraph Representation Learning for Technological Intellectual Property

abstract: In the age of big data, the demand for hidden information mining in technological intellectual property is increasing in discrete countries. Definitely, a considerable number of graph learning algorithms for technological intellectual property have been proposed. The goal is to model the technological intellectual property entities and their relationships through the graph structure and use the neural network algorithm to extract the hidden structure information in the graph. However, most of the existing graph learning algorithms merely focus on the information mining of binary relations in technological intellectual property, ignoring the higherorder information hidden in non-binary relations. Therefore, a hypergraph neural network model based on dual channel convolution is proposed. For the hypergraph constructed from technological intellectual property data, the hypergraph channel and the line expanded graph channel of the hypergraph are used to learn the hypergraph, and the attention mechanism is introduced to adaptively fuse the output representations of the two channels. The proposed model outperforms the existing approaches on a variety of datasets.


title: Non-Hermitian acoustic waveguides with periodic electroacoustic feedback

abstract: In this work, we investigate non-Hermitian acoustic waveguides designed with periodically applied feedback efforts using electrodynamic actuators. One-dimensional spectral (infinite-dimensional) and finite element (finite-dimensional) models for plane acoustic waves in ducts are used. It is shown that dispersion diagrams of this family of metamaterials exhibit non-reciprocal imaginary frequency components, manifesting as wave attenuation or amplification along opposite directions for all pass bands. The effects of different feedback laws are investigated. Furthermore, the non-Hermitian skin effect manifesting as topological modes localized at the boundaries of finite domains is investigated and successfully predicted by the topology of the reciprocal space. This work extends previous numerical results obtained for a piezoelectric rod system and contributes to recent efforts in designing active metamaterials with novel properties associated with the physics of non-Hermitian systems, which may find fruitful technological applications related to noise control, wave localization, filtering and multiplexing.


title: Defect in Gauge Theory and Quantum Hall States

abstract: We study the surface defect in $\mathcal{N}=2^*$ $U(N)$ gauge theory in four dimensions and its relation to quantum Hall states in two dimensions. We first prove that the defect partition function becomes the Jack polynomial of the variables describing the brane positions by imposing the Higgsing condition and taking the bulk decoupling limit. Further tuning the adjoint mass parameter, we may obtain various fractional quantum Hall states, including Laughlin, Moore-Read, and Read-Rezayi states, due to the admissible condition of the Jack polynomial.


title: ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priors

abstract: Image inpainting involves filling missing areas of a corrupted image. Despite impressive results have been achieved recently, restoring images with both vivid textures and reasonable structures remains a significant challenge. Previous methods have primarily addressed regular textures while disregarding holistic structures due to the limited receptive fields of Convolutional Neural Networks (CNNs). To this end, we study learning a Zero-initialized residual addition based Incremental Transformer on Structural priors (ZITS++), an improved model upon our conference work, ZITS. Specifically, given one corrupt image, we present the Transformer Structure Restorer (TSR) module to restore holistic structural priors at low image resolution, which are further upsampled by Simple Structure Upsampler (SSU) module to higher image resolution. To recover image texture details, we use the Fourier CNN Texture Restoration (FTR) module, which is strengthened by Fourier and large-kernel attention convolutions. Furthermore, to enhance the FTR, the upsampled structural priors from TSR are further processed by Structure Feature Encoder (SFE) and optimized with the Zero-initialized Residual Addition (ZeroRA) incrementally. Besides, a new masking positional encoding is proposed to encode the large irregular masks. Compared with ZITS, ZITS++ improves the FTR's stability and inpainting ability with several techniques. More importantly, we comprehensively explore the effects of various image priors for inpainting and investigate how to utilize them to address high-resolution image inpainting with extensive experiments. This investigation is orthogonal to most inpainting approaches and can thus significantly benefit the community. Codes and models will be released in https://github.com/ewrfcas/ZITS-PlusPlus.


title: Genesis of thunderstorm ground enhancements

abstract: Proceeding from a stormy day of 22 September 2022, when 7 thunderstorm ground enhancements occurred (TGEs, 3 of them very large), we perform an analysis of the most important conditions, on which depend the origination of the large particle fluxes in the thunderous atmosphere. Among these conditions are the near-surface electric field (NSEF), graupel fall, and lightning activity. We estimate the intensity of the largest particle flux of 1,25 mln gamma rays hitting each square meter of surface on Aragats with energy spectra extended up to 70 MeV. Only one TGE from 7 meets the conditions to recover the electron energy spectrum; the fraction of electrons with energies above 10 MeV relative to the gamma ray flux reaches 45%. By carefully examining the graupel fall, we demonstrate that the lower dipole, which accelerates electrons, is formed by the main negative and lower positively charged regions. The lower dipole decays with a graupel fall that coincides with TGE terminations (usually by a lightning flash).


title: 3D Brain and Heart Volume Generative Models: A Survey

abstract: Generative models such as generative adversarial networks and autoencoders have gained a great deal of attention in the medical field due to their excellent data generation capability. This paper provides a comprehensive survey of generative models for three-dimensional (3D) volumes, focusing on the brain and heart. A new and elaborate taxonomy of unconditional and conditional generative models is proposed to cover diverse medical tasks for the brain and heart: unconditional synthesis, classification, conditional synthesis, segmentation, denoising, detection, and registration. We provide relevant background, examine each task and also suggest potential future directions. A list of the latest publications will be updated on Github to keep up with the rapid influx of papers at https://github.com/csyanbin/3D-Medical-Generative-Survey.


title: Classification by estimating the cumulative distribution function for small data

abstract: In this paper, we study the classification problem by estimating the conditional probability function of the given data. Different from the traditional expected risk estimation theory on empirical data, we calculate the probability via Fredholm equation, this leads to estimate the distribution of the data. Based on the Fredholm equation, a new expected risk estimation theory by estimating the cumulative distribution function is presented. The main characteristics of the new expected risk estimation is to measure the risk on the distribution of the input space. The corresponding empirical risk estimation is also presented, and an $\varepsilon$-insensitive $L_{1}$ cumulative support vector machines ($\varepsilon$-$L_{1}VSVM$) is proposed by introducing an insensitive loss. It is worth mentioning that the classification models and the classification evaluation indicators based on the new mechanism are different from the traditional one. Experimental results show the effectiveness of the proposed $\varepsilon$-$L_{1}VSVM$ and the corresponding cumulative distribution function indicator on validity and interpretability of small data classification.


title: Image Projective Transformation Rectification with Synthetic Data for Smartphone-captured Chest X-ray Photos Classification

abstract: Classification on smartphone-captured chest X-ray (CXR) photos to detect pathologies is challenging due to the projective transformation caused by the non-ideal camera position. Recently, various rectification methods have been proposed for different photo rectification tasks such as document photos, license plate photos, etc. Unfortunately, we found that none of them is suitable for CXR photos, due to their specific transformation type, image appearance, annotation type, etc. In this paper, we propose an innovative deep learning-based Projective Transformation Rectification Network (PTRN) to automatically rectify CXR photos by predicting the projective transformation matrix. To the best of our knowledge, it is the first work to predict the projective transformation matrix as the learning goal for photo rectification. Additionally, to avoid the expensive collection of natural data, synthetic CXR photos are generated under the consideration of natural perturbations, extra screens, etc. We evaluate the proposed approach in the CheXphoto smartphone-captured CXR photos classification competition hosted by the Stanford University Machine Learning Group, our approach won first place with a huge performance improvement (ours 0.850, second-best 0.762, in AUC). A deeper study demonstrates that the use of PTRN successfully achieves the classification performance on the spatially transformed CXR photos to the same level as on the high-quality digital CXR images, indicating PTRN can eliminate all negative impacts of projective transformation on the CXR photos.


title: Identifiability and Asymptotics in Learning Homogeneous Linear ODE Systems from Discrete Observations

abstract: Ordinary Differential Equations (ODEs) have recently gained a lot of attention in machine learning. However, the theoretical aspects, e.g., identifiability and asymptotic properties of statistical estimation are still obscure. This paper derives a sufficient condition for the identifiability of homogeneous linear ODE systems from a sequence of equally-spaced error-free observations sampled from a single trajectory. When observations are disturbed by measurement noise, we prove that under mild conditions, the parameter estimator based on the Nonlinear Least Squares (NLS) method is consistent and asymptotic normal with $n^{-1/2}$ convergence rate. Based on the asymptotic normality property, we construct confidence sets for the unknown system parameters and propose a new method to infer the causal structure of the ODE system, i.e., inferring whether there is a causal link between system variables. Furthermore, we extend the results to degraded observations, including aggregated and time-scaled ones. To the best of our knowledge, our work is the first systematic study of the identifiability and asymptotic properties in learning linear ODE systems. We also construct simulations with various system dimensions to illustrate the established theoretical results.


title: Towards Theoretically Inspired Neural Initialization Optimization

abstract: Automated machine learning has been widely explored to reduce human efforts in designing neural architectures and looking for proper hyperparameters. In the domain of neural initialization, however, similar automated techniques have rarely been studied. Most existing initialization methods are handcrafted and highly dependent on specific architectures. In this paper, we propose a differentiable quantity, named GradCosine, with theoretical insights to evaluate the initial state of a neural network. Specifically, GradCosine is the cosine similarity of sample-wise gradients with respect to the initialized parameters. By analyzing the sample-wise optimization landscape, we show that both the training and test performance of a network can be improved by maximizing GradCosine under gradient norm constraint. Based on this observation, we further propose the neural initialization optimization (NIO) algorithm. Generalized from the sample-wise analysis into the real batch setting, NIO is able to automatically look for a better initialization with negligible cost compared with the training time. With NIO, we improve the classification performance of a variety of neural architectures on CIFAR-10, CIFAR-100, and ImageNet. Moreover, we find that our method can even help to train large vision Transformer architecture without warmup.


title: A local-density-approximation description of high-momentum tails in isospin asymmetric nuclei

abstract: We adapt the local density approximation to add the high-momentum tails (HMTs) to finite nuclei's Slater-determinant momentum distributions. The HMTs are extracted by the extended Brueckner-Hartree-Fock (EBHF) method or by the lowest order cluster approximation. With a correction factor being added to EBHF, it is sufficiently in agreement with the experimental benchmark, i.e., the high-momentum $N/Z$ ratios approximately equal to $1$, and the low-momentum $N/Z$ ratios approximately equal to $N/Z$ of the systems. It is also found that the tensor force makes the nucleon-nucleon correlations appear more easily on the nuclear surface region and the percentage of high-momentum ($p > 300$ MeV/c) nucleons, around $17\%$--$18\%$, independent of isospin asymmetry.


title: Bridging the Gap Between Vision Transformers and Convolutional Neural Networks on Small Datasets

abstract: There still remains an extreme performance gap between Vision Transformers (ViTs) and Convolutional Neural Networks (CNNs) when training from scratch on small datasets, which is concluded to the lack of inductive bias. In this paper, we further consider this problem and point out two weaknesses of ViTs in inductive biases, that is, the spatial relevance and diverse channel representation. First, on spatial aspect, objects are locally compact and relevant, thus fine-grained feature needs to be extracted from a token and its neighbors. While the lack of data hinders ViTs to attend the spatial relevance. Second, on channel aspect, representation exhibits diversity on different channels. But the scarce data can not enable ViTs to learn strong enough representation for accurate recognition. To this end, we propose Dynamic Hybrid Vision Transformer (DHVT) as the solution to enhance the two inductive biases. On spatial aspect, we adopt a hybrid structure, in which convolution is integrated into patch embedding and multi-layer perceptron module, forcing the model to capture the token features as well as their neighboring features. On channel aspect, we introduce a dynamic feature aggregation module in MLP and a brand new "head token" design in multi-head self-attention module to help re-calibrate channel representation and make different channel group representation interacts with each other. The fusion of weak channel representation forms a strong enough representation for classification. With this design, we successfully eliminate the performance gap between CNNs and ViTs, and our DHVT achieves a series of state-of-the-art performance with a lightweight model, 85.68% on CIFAR-100 with 22.8M parameters, 82.3% on ImageNet-1K with 24.0M parameters. Code is available at https://github.com/ArieSeirack/DHVT.


title: JuryGCN: Quantifying Jackknife Uncertainty on Graph Convolutional Networks

abstract: Graph Convolutional Network (GCN) has exhibited strong empirical performance in many real-world applications. The vast majority of existing works on GCN primarily focus on the accuracy while ignoring how confident or uncertain a GCN is with respect to its predictions. Despite being a cornerstone of trustworthy graph mining, uncertainty quantification on GCN has not been well studied and the scarce existing efforts either fail to provide deterministic quantification or have to change the training procedure of GCN by introducing additional parameters or architectures. In this paper, we propose the first frequentist-based approach named JuryGCN in quantifying the uncertainty of GCN, where the key idea is to quantify the uncertainty of a node as the width of confidence interval by a jackknife estimator. Moreover, we leverage the influence functions to estimate the change in GCN parameters without re-training to scale up the computation. The proposed JuryGCN is capable of quantifying uncertainty deterministically without modifying the GCN architecture or introducing additional parameters. We perform extensive experimental evaluation on real-world datasets in the tasks of both active learning and semi-supervised node classification, which demonstrate the efficacy of the proposed method.


title: Efficient Image Super-Resolution using Vast-Receptive-Field Attention

abstract: The attention mechanism plays a pivotal role in designing advanced super-resolution (SR) networks. In this work, we design an efficient SR network by improving the attention mechanism. We start from a simple pixel attention module and gradually modify it to achieve better super-resolution performance with reduced parameters. The specific approaches include: (1) increasing the receptive field of the attention branch, (2) replacing large dense convolution kernels with depth-wise separable convolutions, and (3) introducing pixel normalization. These approaches paint a clear evolutionary roadmap for the design of attention mechanisms. Based on these observations, we propose VapSR, the VAst-receptive-field Pixel attention network. Experiments demonstrate the superior performance of VapSR. VapSR outperforms the present lightweight networks with even fewer parameters. And the light version of VapSR can use only 21.68% and 28.18% parameters of IMDB and RFDN to achieve similar performances to those networks. The code and models are available at https://github.com/zhoumumu/VapSR.


title: The computational and learning benefits of Daleian neural networks

abstract: Dale's principle implies that biological neural networks are composed of neurons that are either excitatory or inhibitory. While the number of possible architectures of such Daleian networks is exponentially smaller than non-Daleian ones, the computational and functional implications of using Daleian networks by the brain are mostly unknown. Here, we use models of recurrent spiking neural networks and rate-based networks to show, surprisingly, that despite the structural limitations on Daleian networks, they can approximate the computation performed by non-Daleian networks to a very high degree of accuracy. Moreover, we find that Daleian networks are more functionally robust to synaptic noise. We then show that unlike non-Daleian networks, Daleian ones can learn efficiently by tuning single neuron features, nearly as well as learning by tuning individual synaptic weights - suggesting a simpler and more biologically plausible learning mechanism. We thus suggest that in addition to architectural simplicity, Dale's principle confers computational and learning benefits for biological networks, and offers new directions for constructing and training biologically-inspired artificial neural networks


title: Effects of equatorially-confined shear flow on MRG and Rossby waves

abstract: Linear modal stability analysis of a mean zonal shear flow is carried out in the framework of rotating shallow water equations (RSWE), both under the $\beta$-plane approximation and in the full spherical coordinate system. Two base flows -- equatorial easterly (EE) and westerly (EW) -- with Gaussian profiles highly confined to small latitudes are analyzed. At low Froude number, mixed Rossby-gravity (MRG) and Rossby waves are found to be particularly affected by shear, with prominent changes at higher wavenumbers. These waves become practically non-dispersive at large wavenumbers in EE. The perturbations are found to be more confined equatorially in EE than in EW with the degree of confinement being more pronounced in the $\beta$-plane system compared to the full spherical system. At high Froude number, the phase speeds are significantly larger in the $\beta$-plane system for all families of waves. Under the $\beta$-plane approximation, exponentially unstable modes can be excited, having negative (positive) phase speed in EE (EW). Strikingly, this flow is always neutrally stable with the full spherical system. This speaks for the importance of studying the whole spherical system even for equatorially confined shear.


title: A Note on the "Various Atmospheres over Water Oceans on Terrestrial Planets with a One-Dimensional Radiative-Convective Equilibrium Model

abstract: It has been investigated the possibility of the various atmospheres over water oceans. We have considered the H$_2$ atmosphere and He atmosphere concerning to N$_2$ atmosphere over oceans. One of the main subjects in astrobiology is to estimate the habitable zone. If there is an ocean on the planet with an atmosphere, there is an upper limit to the outgoing infrared radiation called the Komabayashi-Ingersoll limit (KI-limit). This limit depends on the components of the atmospheres. We have investigated this dependence under the simple model, using the one-dimensional gray radiative-convective equilibrium model adopted by Nakajima et al. (1992). The outgoing infrared radiation ($F_{IRout}$) with the surface temperature ($T_s$) has shown some peculiar behavior. The examples for H$_2$, He, and N$_2$ background gas for H$_2$O vapour are investigated. There is another limit called the Simpson-Nakajima limit (SN-limit) mainly composed of vapour. This steam limit does not depend on the background atmosphere components. Under super-Earth case ($g=2\times$9.8 m/s$^2$), several cases are also calculated. The KI-limit dependence on the initial pressure is presented. The various emission rates by Koll & Cronin (2019) are investigated.


title: First-Principles Ultrafast Exciton Dynamics and Time-Domain Spectroscopies: Dark-Exciton Mediated Valley Depolarization in Monolayer WSe$_2$

abstract: Calculations combining first-principles electron-phonon ($e$-ph) interactions with the Boltzmann equation enable studies of ultrafast carrier and phonon dynamics. However, in materials with weak Coulomb screening, electrons and holes form bound excitons and their scattering processes become correlated, posing additional challenges for modeling nonequilibrium physics. Here we show calculations of ultrafast exciton dynamics and related time-domain spectroscopies using $ab~initio$ exciton-phonon (ex-ph) interactions together with an excitonic Boltzmann equation. Starting from the nonequilibrium exciton populations, we develop simulations of time-domain absorption and photoemission spectra that take into account electron-hole correlations. We use this method to study monolayer WSe$_2$, where our calculations predict sub-picosecond timescales for exciton relaxation and valley depolarization and reveal the key role of intermediate dark excitons. The approach introduced in this work enables a quantitative description of nonequilibrium dynamics and ultrafast spectroscopies in materials with strongly bound excitons.


title: Resolving the Approximability of Offline and Online Non-monotone DR-Submodular Maximization over General Convex Sets

abstract: In recent years, maximization of DR-submodular continuous functions became an important research field, with many real-worlds applications in the domains of machine learning, communication systems, operation research and economics. Most of the works in this field study maximization subject to down-closed convex set constraints due to an inapproximability result by Vondr\'ak (2013). However, Durr et al. (2021) showed that one can bypass this inapproximability by proving approximation ratios that are functions of $m$, the minimum $\ell_{\infty}$-norm of any feasible vector. Given this observation, it is possible to get results for maximizing a DR-submodular function subject to general convex set constraints, which has led to multiple works on this problem. The most recent of which is a polynomial time $\tfrac{1}{4}(1 - m)$-approximation offline algorithm due to Du (2022). However, only a sub-exponential time $\tfrac{1}{3\sqrt{3}}(1 - m)$-approximation algorithm is known for the corresponding online problem. In this work, we present a polynomial time online algorithm matching the $\tfrac{1}{4}(1 - m)$-approximation of the state-of-the-art offline algorithm. We also present an inapproximability result showing that our online algorithm and Du's (2022) offline algorithm are both optimal in a strong sense. Finally, we study the empirical performance of our algorithm and the algorithm of Du (which was only theoretically studied previously), and show that they consistently outperform previously suggested algorithms on revenue maximization, location summarization and quadratic programming applications.


title: Spatial spin-spin correlations of the single-impurity Anderson model with a ferromagnetic bath

abstract: We investigate the interplay between the Kondo effect and the ferromagnetism by an one dimension Anderson impurity model with a spin partially polarized bath, using the projective truncation approximation under Lacroix basis.The equal-time spatial spin-spin correlation function (SSCF) is calculated. For the case of spin-unpolarized conduction electrons, it agrees qualitatively with the results from density matrix renormalization group (DMRG). For system with partially spin-polarized conduction electrons, an oscillation in the envelope of SSCF emerges due to the beating of two Friedel oscillations associated to two spin-split Fermi surfaces of conduction electrons. The period is proportional to the inverse of magnetic field $h$. A fitting formula is proposed to perfectly fits the numerical results of SSCF in both the short- and long-range regions. For large enough bath spin polarization, a bump appears in the curve of the integrated SSCF. It marks the boundary between the suppressed Kondo cloud and the polarized bath sites.


title: Effect of sociability and curiosity of senior developers in building agile scrum team competency

abstract: This paper aims to investigate the mechanisms that contribute to propagation of competence in an Agile Scrum team. This study seeks to challenge the traditional view of bounded rationality (BR). An Agile Scrum team (Team) is expected to build problem solving competence quickly as the expected ramp up time continues to shrink. But the team has a mixture of expertise, competence and sociability levels that affect out-of-the-box performance. The objective is to expand BR into the social realm and see how teams can self-organize and reconfigure to allow effective problem solving. Studies have shown that agent-based computational simulation is an appropriate technique to explore this point from a theoretical perspective. (Fioretti, 2013) (Secchi, 2015). The first step is to define the problem, discuss how senior team members exhibit high curiosity and apply sociability and cognitive resources to develop overall team competence. This dynamic is modeled and simulated in NetLogoR and the results are analyzed. Finally, some key findings are presented and discussed.


title: Boosting the Transferability of Adversarial Attacks with Reverse Adversarial Perturbation

abstract: Deep neural networks (DNNs) have been shown to be vulnerable to adversarial examples, which can produce erroneous predictions by injecting imperceptible perturbations. In this work, we study the transferability of adversarial examples, which is significant due to its threat to real-world applications where model architecture or parameters are usually unknown. Many existing works reveal that the adversarial examples are likely to overfit the surrogate model that they are generated from, limiting its transfer attack performance against different target models. To mitigate the overfitting of the surrogate model, we propose a novel attack method, dubbed reverse adversarial perturbation (RAP). Specifically, instead of minimizing the loss of a single adversarial point, we advocate seeking adversarial example located at a region with unified low loss value, by injecting the worst-case perturbation (the reverse adversarial perturbation) for each step of the optimization procedure. The adversarial attack with RAP is formulated as a min-max bi-level optimization problem. By integrating RAP into the iterative process for attacks, our method can find more stable adversarial examples which are less sensitive to the changes of decision boundary, mitigating the overfitting of the surrogate model. Comprehensive experimental comparisons demonstrate that RAP can significantly boost adversarial transferability. Furthermore, RAP can be naturally combined with many existing black-box attack techniques, to further boost the transferability. When attacking a real-world image recognition system, Google Cloud Vision API, we obtain 22% performance improvement of targeted attacks over the compared method. Our codes are available at https://github.com/SCLBD/Transfer_attack_RAP.


title: Why $\psi$ is incomplete indeed: a simple illustration

abstract: With the Nobel Prize attributed to Aspect, Clauser, and Zeilinger, the international scientific community acknowledged the fundamental importance of the experimental violation of Bell's inequalities. It is however still debated what fails in Bell's hypotheses, leading to these inequalities, and usually summarized as "local realism", or maybe more appropriately "classical local realism". The most common explanation is "quantum non-locality", that remains however fully compatible with relativistic causality; this makes wondering whether any non-local phenomenon is really involved in these experiments. Here we want to recapitulate another option, sometimes called "predictive incompleteness", closely related to the idea that the usual state vector $\psi$ is incomplete indeed, as it was claimed by Einstein, Podolsky and Rosen. However, the right way to complete $\psi$ has nothing to do with hidden variables, but requires to specify the measurement context, as it was claimed by Bohr. Here we will consider the simple case of two spin 1/2, or two qubits, in order to keep the argument simple, but it does apply generally in quantum mechanics.


title: Modeling the impact of rainfall and temperature on sterile insect control strategies in a Tropical environment

abstract: The sterile insect technique (SIT) is a biological control technique that can be used either to eliminate or decay a wild mosquito population under a given threshold to reduce the nuisance or the epidemiological risk. In this work, we propose a model using a differential system that takes into account the variations of rainfall and temperature over time and study their impacts on sterile males releases strategies. Our model is as simple as possible to avoid complexity while being able to capture the temporal variations of an Aedes albopictus mosquito population in a domain treated by SIT, located in R{\'e}union island. The main objective is to determine what period of the year is the most suitable to start a SIT control to minimize the duration of massive releases and the amount of sterile males to release, either to reduce the mosquito nuisance, or to reduce the epidemiological risk. Since sterilization is not 100% efficient, we also study the impact of different levels of residual fertility within the released sterile male population. Our study shows that rainfall plays a major role in the dynamics of the mosquito and the SIT control, that the best period to start a massive SIT treatment lasts from July to December, that residual fertility has to be as small as possible, and that increasing the size of the releases is not always necessarily interesting. We also highlight the importance of combining SIT with mechanical control, i.e. the removal of breeding sites, in particular when the initial mosquito population is large.


title: Operator theory on generalized Hartogs triangles

abstract: We consider the family $\mathcal P$ of $n$-tuples $P$ consisting of polynomials $P_1, \ldots, P_n$ with nonnegative coefficients which satisfy $\partial_i P_j(0) = \delta_{i, j},$ $i, j=1, \ldots, n.$ With any such $P,$ we associate a Reinhardt domain $\triangle^{\!n}_{_P}$ that we will call the generalized Hartogs triangle. We are particularly interested in the choices $P_a = (P_{1, a}, \ldots, P_{n, a}),$ $a \geq 0,$ where $P_{j, a}(z) = z_j + a \prod_{k=1}^n z_k,~ j=1, \ldots, n.$ The generalized Hartogs triangle associated with $P_a$ is given by \begin{equation} \triangle^{\!n}_a = \Big\{z \in \mathbb C \times \mathbb C^{n-1}_* : |z_j|^2 < |z_{j+1}|^2(1-a|z_1|^2), ~j=1, \ldots, n-1, |z_n|^2 + a|z_1|^2 < 1\Big\}. \end{equation} The domain $\triangle^{\!n}_{_P},$ $n \geq 2$ is never polynomially convex. However, $\triangle^{\!n}_{_P}$ is always holomorphically convex. With any $P \in \mathcal P$ and $m \in \mathbb N^n,$ we associate a positive semi-definite kernel $\mathscr K_{_{P, m}}$ on $\triangle^{\!n}_{_P}.$ This combined with the Moore's theorem yields a reproducing kernel Hilbert space $\mathscr H^2_m(\triangle^{\!n}_{_P})$ of holomorphic functions on $\triangle^{\!n}_{_P}.$ We study the space $\mathscr H^2_m(\triangle^{\!n}_{_P})$ and the multiplication $n$-tuple $\mathscr M_z$ acting on $\mathscr H^2_m(\triangle^{\!n}_{_P}).$ It turns out that $\mathscr M_z$ is never rationally cyclic. Although the dimension of the joint kernel of $\mathscr M^*_z-\lambda$ is constant of value $1$ for every $\lambda \in \triangle^{\!n}_{_P}$, it has jump discontinuity at the serious singularity $0$ of the boundary of $\triangle^{\!n}_{_P}$ with value equal to $\infty.$ We capitalize on the notion of joint subnormality to define a Hardy space on $\triangle^{\!n}_{_0}.$ This in turn gives an analog of the von Neumann's inequality for $\triangle^{\!n}_{_0}.$


title: Unsupervised Learning of Equivariant Structure from Sequences

abstract: In this study, we present meta-sequential prediction (MSP), an unsupervised framework to learn the symmetry from the time sequence of length at least three. Our method leverages the stationary property (e.g. constant velocity, constant acceleration) of the time sequence to learn the underlying equivariant structure of the dataset by simply training the encoder-decoder model to be able to predict the future observations. We will demonstrate that, with our framework, the hidden disentangled structure of the dataset naturally emerges as a by-product by applying simultaneous block-diagonalization to the transition operators in the latent space, the procedure which is commonly used in representation theory to decompose the feature-space based on the type of response to group actions. We will showcase our method from both empirical and theoretical perspectives. Our result suggests that finding a simple structured relation and learning a model with extrapolation capability are two sides of the same coin. The code is available at https://github.com/takerum/meta_sequential_prediction.


title: The stochastic primitive equations with non-isothermal turbulent pressure

abstract: In this paper we introduce and study the primitive equations with $\textit{non}$-isothermal turbulent pressure and transport noise. They are derived from the Navier-Stokes equations by employing stochastic versions of the Boussinesq and the hydrostatic approximations. The temperature dependence of the turbulent pressure can be seen as a consequence of an additive noise acting on the small vertical dynamics. For such model we prove global well-posedness in $H^1$ where the noise is considered in both the It\^{o} and Stratonovich formulations. Compared to previous variants of the primitive equations, the one considered here present a more intricate coupling between the velocity field and the temperature. The corresponding analysis is seriously more involved than in the deterministic setting. Finally, the continuous dependence on the initial data and the energy estimates proven here are new, even in the case of isothermal turbulent pressure.


title: Clustering the Sketch: A Novel Approach to Embedding Table Compression

abstract: Embedding tables are used by machine learning systems to work with categorical features. In modern Recommendation Systems, these tables can be very large, necessitating the development of new methods for fitting them in memory, even during training. We suggest Clustered Compositional Embeddings (CCE) which combines clustering-based compression like quantization to codebooks with dynamic methods like The Hashing Trick and Compositional Embeddings (Shi et al., 2020). Experimentally CCE achieves the best of both worlds: The high compression rate of codebook-based quantization, but *dynamically* like hashing-based methods, so it can be used during training. Theoretically, we prove that CCE is guaranteed to converge to the optimal codebook and give a tight bound for the number of iterations required.


title: Comment on Bilayer aggregate microstructure determines viscoelasticity of lung surfactant suspensions by C.O. Ciutara and J.A. Zasadzinski, Soft Matter, 2021, 17, 5170-5182

abstract: For applications of pulmonary surfactant delivery to the lungs, the question of rheology of the existing clinical formulations is of upmost importance. Recently, Ciutara and Zasadsinky (Soft Matter, 2021, 17, 5170-5182) measured the rheological properties of Infasurf, Survanta and Curosurf, three of the most used pulmonary surfactant substitutes. This study revealed that these fluids are shear-thinning and characterized by a yield stress. The results obtained by Ciutara et al. on Curosurf differ from our results published in Colloids and Surfaces B: Biointerfaces, 2019, 178, 337-345 and in ACS Nano, 2020, 14, 466 - 475. In contrast, we found that Curosurf suspensions are viscous Newtonian or slightly shear-thinning fluids, with no evidence of yield stress. The purpose of this Comment is to discuss possible causes for the discrepancy between the two studies, and to suggest that for biological fluids such as surfactant substitutes, the microrheology technique of rotational magnetic spectroscopy (MRS) can provide valuable results.


title: Human Joint Kinematics Diffusion-Refinement for Stochastic Motion Prediction

abstract: Stochastic human motion prediction aims to forecast multiple plausible future motions given a single pose sequence from the past. Most previous works focus on designing elaborate losses to improve the accuracy, while the diversity is typically characterized by randomly sampling a set of latent variables from the latent prior, which is then decoded into possible motions. This joint training of sampling and decoding, however, suffers from posterior collapse as the learned latent variables tend to be ignored by a strong decoder, leading to limited diversity. Alternatively, inspired by the diffusion process in nonequilibrium thermodynamics, we propose MotionDiff, a diffusion probabilistic model to treat the kinematics of human joints as heated particles, which will diffuse from original states to a noise distribution. This process offers a natural way to obtain the "whitened" latents without any trainable parameters, and human motion prediction can be regarded as the reverse diffusion process that converts the noise distribution into realistic future motions conditioned on the observed sequence. Specifically, MotionDiff consists of two parts: a spatial-temporal transformer-based diffusion network to generate diverse yet plausible motions, and a graph convolutional network to further refine the outputs. Experimental results on two datasets demonstrate that our model yields the competitive performance in terms of both accuracy and diversity.


title: BORA: Bayesian Optimization for Resource Allocation

abstract: Optimal resource allocation is gaining a renewed interest due its relevance as a core problem in managing, over time, cloud and high-performance computing facilities. Semi-Bandit Feedback (SBF) is the reference method for efficiently solving this problem. In this paper we propose (i) an extension of the optimal resource allocation to a more general class of problems, specifically with resources availability changing over time, and (ii) Bayesian Optimization as a more efficient alternative to SBF. Three algorithms for Bayesian Optimization for Resource Allocation, namely BORA, are presented, working on allocation decisions represented as numerical vectors or distributions. The second option required to consider the Wasserstein distance as a more suitable metric to use into one of the BORA algorithms. Results on (i) the original SBF case study proposed in the literature, and (ii) a real-life application (i.e., the optimization of multi-channel marketing) empirically prove that BORA is a more efficient and effective learning-and-optimization framework than SBF.


title: From the Hardness of Detecting Superpositions to Cryptography: Quantum Public Key Encryption and Commitments

abstract: Recently, Aaronson et al. (arXiv:2009.07450) showed that detecting interference between two orthogonal states is as hard as swapping these states. While their original motivation was from quantum gravity, we show its applications in quantum cryptography. 1. We construct the first public key encryption scheme from cryptographic \emph{non-abelian} group actions. Interestingly, the ciphertexts of our scheme are quantum even if messages are classical. This resolves an open question posed by Ji et al. (TCC '19). We construct the scheme through a new abstraction called swap-trapdoor function pairs, which may be of independent interest. 2. We give a simple and efficient compiler that converts the flavor of quantum bit commitments. More precisely, for any prefix X,Y $\in$ {computationally,statistically,perfectly}, if the base scheme is X-hiding and Y-binding, then the resulting scheme is Y-hiding and X-binding. Our compiler calls the base scheme only once. Previously, all known compilers call the base schemes polynomially many times (Cr\'epeau et al., Eurocrypt '01 and Yan, Asiacrypt '22). For the security proof of the conversion, we generalize the result of Aaronson et al. by considering quantum auxiliary inputs.


title: Adversarial Speaker-Consistency Learning Using Untranscribed Speech Data for Zero-Shot Multi-Speaker Text-to-Speech

abstract: Several recently proposed text-to-speech (TTS) models achieved to generate the speech samples with the human-level quality in the single-speaker and multi-speaker TTS scenarios with a set of pre-defined speakers. However, synthesizing a new speaker's voice with a single reference audio, commonly known as zero-shot multi-speaker text-to-speech (ZSM-TTS), is still a very challenging task. The main challenge of ZSM-TTS is the speaker domain shift problem upon the speech generation of a new speaker. To mitigate this problem, we propose adversarial speaker-consistency learning (ASCL). The proposed method first generates an additional speech of a query speaker using the external untranscribed datasets at each training iteration. Then, the model learns to consistently generate the speech sample of the same speaker as the corresponding speaker embedding vector by employing an adversarial learning scheme. The experimental results show that the proposed method is effective compared to the baseline in terms of the quality and speaker similarity in ZSM-TTS.


title: Efficient Offline Policy Optimization with a Learned Model

abstract: MuZero Unplugged presents a promising approach for offline policy learning from logged data. It conducts Monte-Carlo Tree Search (MCTS) with a learned model and leverages Reanalyze algorithm to learn purely from offline data. For good performance, MCTS requires accurate learned models and a large number of simulations, thus costing huge computing time. This paper investigates a few hypotheses where MuZero Unplugged may not work well under the offline RL settings, including 1) learning with limited data coverage; 2) learning from offline data of stochastic environments; 3) improperly parameterized models given the offline data; 4) with a low compute budget. We propose to use a regularized one-step look-ahead approach to tackle the above issues. Instead of planning with the expensive MCTS, we use the learned model to construct an advantage estimation based on a one-step rollout. Policy improvements are towards the direction that maximizes the estimated advantage with regularization of the dataset. We conduct extensive empirical studies with BSuite environments to verify the hypotheses and then run our algorithm on the RL Unplugged Atari benchmark. Experimental results show that our proposed approach achieves stable performance even with an inaccurate learned model. On the large-scale Atari benchmark, the proposed method outperforms MuZero Unplugged by 43%. Most significantly, it uses only 5.6% wall-clock time (i.e., 1 hour) compared to MuZero Unplugged (i.e., 17.8 hours) to achieve a 150% IQM normalized score with the same hardware and software stacks. Our implementation is open-sourced at https://github.com/sail-sg/rosmo.


title: Generalized ideal convergence on quasi-continuous domains

abstract: In this paper,the concepts of generalized ideal inf-limit and generalized ideal final lower bound limit are introduced in the directed complete poset,and their relations with Scott topology and Lawson topology are studied. The main results are as follows: (1) On directed complete posets,generalized ideal inf-limit topology is consistent with Scott topology; (2) Generalized ideal inf-limiti convergence is topological if and only if directed complete posets are quasi-continuous domains; (3) In quasi-continuous domain,generalized ideal final lower bound limit topology is consistent with Lawson topology;(4) In meet continuous directed complete posets,the generalized ideal final lower bound limit convergence is topological if and only if the directed complete poset is continuous.


title: A nearly optimal randomized algorithm for explorable heap selection

abstract: Explorable heap selection is the problem of selecting the $n$th smallest value in a binary heap. The key values can only be accessed by traversing through the underlying infinite binary tree, and the complexity of the algorithm is measured by the total distance traveled in the tree (each edge has unit cost). This problem was originally proposed as a model to study search strategies for the branch-and-bound algorithm with storage restrictions by Karp, Saks and Widgerson (FOCS '86), who gave deterministic and randomized $n\cdot \exp(O(\sqrt{\log{n}}))$ time algorithms using $O(\log(n)^{2.5})$ and $O(\sqrt{\log n})$ space respectively. We present a new randomized algorithm with running time $O(n\log(n)^3)$ using $O(\log n)$ space, substantially improving the previous best randomized running time at the expense of slightly increased space usage. We also show an $\Omega(\log(n)n/\log(\log(n)))$ for any algorithm that solves the problem in the same amount of space, indicating that our algorithm is nearly optimal.


title: Model-based clustering in simple hypergraphs through a stochastic blockmodel

abstract: We propose a model to address the overlooked problem of node clustering in simple hypergraphs. Simple hypergraphs are suitable when a node may not appear multiple times in the same hyperedge, such as in co-authorship datasets. Our model generalizes the stochastic blockmodel for graphs and assumes the existence of latent node groups and hyperedges are conditionally independent given these groups. We first establish the generic identifiability of the model parameters. We then develop a variational approximation Expectation-Maximization algorithm for parameter inference and node clustering, and derive a statistical criterion for model selection. To illustrate the performance of our R package HyperSBM, we compare it with other node clustering methods using synthetic data generated from the model, as well as from a line clustering experiment and a co-authorship dataset.


title: RING++: Roto-translation Invariant Gram for Global Localization on a Sparse Scan Map

abstract: Global localization plays a critical role in many robot applications. LiDAR-based global localization draws the community's focus with its robustness against illumination and seasonal changes. To further improve the localization under large viewpoint differences, we propose RING++ which has roto-translation invariant representation for place recognition, and global convergence for both rotation and translation estimation. With the theoretical guarantee, RING++ is able to address the large viewpoint difference using a lightweight map with sparse scans. In addition, we derive sufficient conditions of feature extractors for the representation preserving the roto-translation invariance, making RING++ a framework applicable to generic multi-channel features. To the best of our knowledge, this is the first learning-free framework to address all subtasks of global localization in the sparse scan map. Validations on real-world datasets show that our approach demonstrates better performance than state-of-the-art learning-free methods, and competitive performance with learning-based methods. Finally, we integrate RING++ into a multi-robot/session SLAM system, performing its effectiveness in collaborative applications.


title: Sharing Quantum Nonlocality in Star Network Scenarios

abstract: The Bell nonlocality is closely related to the foundations of quantum physics and has significant applications to security questions in quantum key distributions. In recent years, the sharing ability of the Bell nonlocality has been extensively studied. The nonlocality of quantum network states is more complex. We first discuss the sharing ability of the simplest bilocality under unilateral or bilateral POVM measurements, and show that the nonlocality sharing ability of network quantum states under unilateral measurements is similar to the Bell nonlocality sharing ability, but different under bilateral measurements. For the star network scenarios, we present for the first time comprehensive results on the nonlocality sharing properties of quantum network states, for which the quantum nonlocality of the network quantum states has a stronger sharing ability than the Bell nonlocality.


title: Weyl's Law for Arbitrary Archimedean Type

abstract: We generalize the work of Lindenstrauss and Venkatesh establishing Weyl's Law for cusp forms from the spherical spectrum to arbitrary Archimedean type. Weyl's law for the spherical spectrum gives an asymptotic formula for the number of cusp forms that are bi-spherical in terms of eigenvalue T of the Laplacian. We prove an analogous asymptotic holds for cusp forms with Archimedean type {\tau}, where the main term is multiplied by dim {\tau}. While in the spherical case the surjectivity of the Satake Map was used, in the more general case that is not available and we use Arthur's Paley-Wiener theorem and multipliers.


title: A Momentum Accelerated Adaptive Cubic Regularization Method for Nonconvex Optimization

abstract: The cubic regularization method (CR) and its adaptive version (ARC) are popular Newton-type methods in solving unconstrained non-convex optimization problems, due to its global convergence to local minima under mild conditions. The main aim of this paper is to develop a momentum-accelerated adaptive cubic regularization method (ARCm) to improve the convergent performance. With the proper choice of momentum step size, we show the global convergence of ARCm and the local convergence can also be guaranteed under the \KL property. Such global and local convergence can also be established when inexact solvers with low computational costs are employed in the iteration procedure. Numerical results for non-convex logistic regression and robust linear regression models are reported to demonstrate that the proposed ARCm significantly outperforms state-of-the-art cubic regularization methods (e.g., CR, momentum-based CR, ARC) and the trust region method. In particular, the number of iterations required by ARCm is less than 10\% to 50\% required by the most competitive method (ARC) in the experiments.


title: CLEEGN: A Convolutional Neural Network for Plug-and-Play Automatic EEG Reconstruction

abstract: Human electroencephalography (EEG) is a brain monitoring modality that senses cortical neuroelectrophysiological activity in high-temporal resolution. One of the greatest challenges posed in applications of EEG is the unstable signal quality susceptible to inevitable artifacts during recordings. To date, most existing techniques for EEG artifact removal and reconstruction are applicable to offline analysis solely, or require individualized training data to facilitate online reconstruction. We have proposed CLEEGN, a novel convolutional neural network for plug-and-play automatic EEG reconstruction. CLEEGN is based on a subject-independent pre-trained model using existing data and can operate on a new user without any further calibration. The performance of CLEEGN was validated using multiple evaluations including waveform observation, reconstruction error assessment, and decoding accuracy on well-studied labeled datasets. The results of simulated online validation suggest that, even without any calibration, CLEEGN can largely preserve inherent brain activity and outperforms leading online/offline artifact removal methods in the decoding accuracy of reconstructed EEG data. In addition, visualization of model parameters and latent features exhibit the model behavior and reveal explainable insights related to existing knowledge of neuroscience. We foresee pervasive applications of CLEEGN in prospective works of online plug-and-play EEG decoding and analysis.


title: Probabilities Are Not Enough: Formal Controller Synthesis for Stochastic Dynamical Models with Epistemic Uncertainty

abstract: Capturing uncertainty in models of complex dynamical systems is crucial to designing safe controllers. Stochastic noise causes aleatoric uncertainty, whereas imprecise knowledge of model parameters leads to epistemic uncertainty. Several approaches use formal abstractions to synthesize policies that satisfy temporal specifications related to safety and reachability. However, the underlying models exclusively capture aleatoric but not epistemic uncertainty, and thus require that model parameters are known precisely. Our contribution to overcoming this restriction is a novel abstraction-based controller synthesis method for continuous-state models with stochastic noise and uncertain parameters. By sampling techniques and robust analysis, we capture both aleatoric and epistemic uncertainty, with a user-specified confidence level, in the transition probability intervals of a so-called interval Markov decision process (iMDP). We synthesize an optimal policy on this iMDP, which translates (with the specified confidence level) to a feedback controller for the continuous model with the same performance guarantees. Our experimental benchmarks confirm that accounting for epistemic uncertainty leads to controllers that are more robust against variations in parameter values.


title: GGViT:Multistream Vision Transformer Network in Face2Face Facial Reenactment Detection

abstract: Detecting manipulated facial images and videos on social networks has been an urgent problem to be solved. The compression of videos on social media has destroyed some pixel details that could be used to detect forgeries. Hence, it is crucial to detect manipulated faces in videos of different quality. We propose a new multi-stream network architecture named GGViT, which utilizes global information to improve the generalization of the model. The embedding of the whole face extracted by ViT will guide each stream network. Through a large number of experiments, we have proved that our proposed model achieves state-of-the-art classification accuracy on FF++ dataset, and has been greatly improved on scenarios of different compression rates. The accuracy of Raw/C23, Raw/C40 and C23/C40 was increased by 24.34%, 15.08% and 10.14% respectively.


title: Text-Derived Knowledge Helps Vision: A Simple Cross-modal Distillation for Video-based Action Anticipation

abstract: Anticipating future actions in a video is useful for many autonomous and assistive technologies. Most prior action anticipation work treat this as a vision modality problem, where the models learn the task information primarily from the video features in the action anticipation datasets. However, knowledge about action sequences can also be obtained from external textual data. In this work, we show how knowledge in pretrained language models can be adapted and distilled into vision-based action anticipation models. We show that a simple distillation technique can achieve effective knowledge transfer and provide consistent gains on a strong vision model (Anticipative Vision Transformer) for two action anticipation datasets (3.5% relative gain on EGTEA-GAZE+ and 7.2% relative gain on EPIC-KITCHEN 55), giving a new state-of-the-art result.


title: Fast Convergence to Unanimity in Dense Erd\H{o}s-R\'enyi Graphs

abstract: Majority dynamics on the binomial Erd\H{o}s-R\'enyi graph $\mathsf{G}(n,p)$ with $p=\lambda/\sqrt{n}$ is studied. In this process, each vertex has a state in $\{0,1\}$ and at each round, every vertex adopts the state of the majority of its neighbors, retaining its state in the case of a tie. It was conjectured by Benjamini et al. and proved by Fountoulakis et al. that this process reaches unanimity with high probability in at most four rounds. By adding some extra randomness and allowing the underlying graph to be drawn anew in each communication round, we improve on their result and prove that this process reaches consensus in only three communication rounds with probability approaching $1$ as $n$ grows to infinity. We also provide a converse result, showing that three rounds are not only sufficient, but also necessary.


title: Feasible and Desirable Counterfactual Generation by Preserving Human Defined Constraints

abstract: We present a human-in-the-loop approach to generate counterfactual (CF) explanations that preserve global and local feasibility constraints. Global feasibility constraints refer to the causal constraints that are necessary for generating actionable CF explanation. Assuming a domain expert with knowledge on unary and binary causal constraints, our approach efficiently employs this knowledge to generate CF explanation by rejecting gradient steps that violate these constraints. Local feasibility constraints encode end-user's constraints for generating desirable CF explanation. We extract these constraints from the end-user of the model and exploit them during CF generation via user-defined distance metric. Through user studies, we demonstrate that incorporating causal constraints during CF generation results in significantly better explanations in terms of feasibility and desirability for participants. Adopting local and global feasibility constraints simultaneously, although improves user satisfaction, does not significantly improve desirability of the participants compared to only incorporating global constraints.


title: SARAH-based Variance-reduced Algorithm for Stochastic Finite-sum Cocoercive Variational Inequalities

abstract: Variational inequalities are a broad formalism that encompasses a vast number of applications. Motivated by applications in machine learning and beyond, stochastic methods are of great importance. In this paper we consider the problem of stochastic finite-sum cocoercive variational inequalities. For this class of problems, we investigate the convergence of the method based on the SARAH variance reduction technique. We show that for strongly monotone problems it is possible to achieve linear convergence to a solution using this method. Experiments confirm the importance and practical applicability of our approach.


title: SGDA with shuffling: faster convergence for nonconvex-P{\L} minimax optimization

abstract: Stochastic gradient descent-ascent (SGDA) is one of the main workhorses for solving finite-sum minimax optimization problems. Most practical implementations of SGDA randomly reshuffle components and sequentially use them (i.e., without-replacement sampling); however, there are few theoretical results on this approach for minimax algorithms, especially outside the easier-to-analyze (strongly-)monotone setups. To narrow this gap, we study the convergence bounds of SGDA with random reshuffling (SGDA-RR) for smooth nonconvex-nonconcave objectives with Polyak-{\L}ojasiewicz (P{\L}) geometry. We analyze both simultaneous and alternating SGDA-RR for nonconvex-P{\L} and primal-P{\L}-P{\L} objectives, and obtain convergence rates faster than with-replacement SGDA. Our rates extend to mini-batch SGDA-RR, recovering known rates for full-batch gradient descent-ascent (GDA). Lastly, we present a comprehensive lower bound for GDA with an arbitrary step-size ratio, which matches the full-batch upper bound for the primal-P{\L}-P{\L} case.


title: Line Search-Based Feature Transformation for Fast, Stable, and Tunable Content-Style Control in Photorealistic Style Transfer

abstract: Photorealistic style transfer is the task of synthesizing a realistic-looking image when adapting the content from one image to appear in the style of another image. Modern models commonly embed a transformation that fuses features describing the content image and style image and then decodes the resulting feature into a stylized image. We introduce a general-purpose transformation that enables controlling the balance between how much content is preserved and the strength of the infused style. We offer the first experiments that demonstrate the performance of existing transformations across different style transfer models and demonstrate how our transformation performs better in its ability to simultaneously run fast, produce consistently reasonable results, and control the balance between content and style in different models. To support reproducing our method and models, we share the code at https://github.com/chiutaiyin/LS-FT.


title: Fitting State-space Model for Long-term Prediction of the Log-likelihood of Nonstationary Time Series Models

abstract: The goodness of the long-term prediction in the state-space model was evaluated using the squared long-term prediction error. In order to estimate the model parameters suitable for long-term prediction, we devised a modified log-likelihood corresponding to the long-term prediction error variance. Trend models and seasonally adjusted models with and without AR component are examined as examples.


title: New black hole solutions with a dynamical traceless nonmetricity tensor in Metric-Affine Gravity

abstract: In the framework of Metric-Affine Gravity, the existing correspondence between the Einstein tensor and the energy-momentum tensor of matter provided by General Relativity is extended towards a post-Riemannian description in terms of the torsion and nonmetricity fields, which are sourced by the spin, dilation and shear currents of matter. In this work, we focus on the dynamical role of the traceless part of the nonmetricity tensor and its intrinsic connection with shears, defining a model which encloses a new black hole solution endowed with shear charges. We show that the extension in the presence of dynamical torsion and Weyl vector leads to the broadest family of static and spherically symmetric black hole solutions with spin, dilation and shear charges in Metric-Affine Gravity so far.


title: Improving Graph-Based Text Representations with Character and Word Level N-grams

abstract: Graph-based text representation focuses on how text documents are represented as graphs for exploiting dependency information between tokens and documents within a corpus. Despite the increasing interest in graph representation learning, there is limited research in exploring new ways for graph-based text representation, which is important in downstream natural language processing tasks. In this paper, we first propose a new heterogeneous word-character text graph that combines word and character n-gram nodes together with document nodes, allowing us to better learn dependencies among these entities. Additionally, we propose two new graph-based neural models, WCTextGCN and WCTextGAT, for modeling our proposed text graph. Extensive experiments in text classification and automatic text summarization benchmarks demonstrate that our proposed models consistently outperform competitive baselines and state-of-the-art graph-based models.


title: Bounds for DP color function and canonical labelings

abstract: The DP-coloring is a generalization of the list coloring, introduced by Dvo\v{r}\'{a}k and Postle. Let $\mathcal{H}=(L,H)$ be a cover of a graph $G$ and $P_{DP}(G,\mathcal{H})$ be the number of $\mathcal{H}$-colorings of $G$. The DP color function $P_{DP}(G,m)$ of $G$, introduced by Kaul and Mudrock, is the minimum value of $P_{DP}(G,\mathcal{H})$ where the minimum is taken over all possible $m$-fold covers $\mathcal{H}$ of $G$. For the family of $n$-vertex connected graphs, one can deduce that trees maximize the DP color function, from two results of Kaul and Mudrock. In this paper we obtain tight upper bounds for the DP color function of $n$-vertex $2$-connected graphs. Another concern in this paper is the canonical labeling in a cover. It is well known that if an $m$-fold cover $\mathcal{H}$ of a graph $G$ has a canonical labeling, then $P_{DP}(G,\mathcal{H})=P(G,m)$ in which $P(G,m)$ is the chromatic polynomial of $G$. However the converse statement of this conclusion is not always true. We give examples that for some $m$ and $G$, there exists an $m$-fold cover $\mathcal{H}$ of $G$ such that $P_{DP}(G,\mathcal{H})=P(G,m)$, but $\mathcal{H}$ has no canonical labelings. We also prove that when $G$ is a unicyclic graph or a theta graph, for each $m\geq 3$, if $P_{DP}(G,\mathcal{H})=P(G,m)$, then $\mathcal{H}$ has a canonical labeling.


title: Estimating the Pose of a Euro Pallet with an RGB Camera based on Synthetic Training Data

abstract: Estimating the pose of a pallet and other logistics objects is crucial for various use cases, such as automatized material handling or tracking. Innovations in computer vision, computing power, and machine learning open up new opportunities for device-free localization based on cameras and neural networks. Large image datasets with annotated poses are required for training the network. Manual annotation, especially of 6D poses, is an extremely labor-intensive process. Hence, newer approaches often leverage synthetic training data to automatize the process of generating annotated image datasets. In this work, the generation of synthetic training data for 6D pose estimation of pallets is presented. The data is then used to train the Deep Object Pose Estimation (DOPE) algorithm. The experimental validation of the algorithm proves that the 6D pose estimation of a standardized Euro pallet with a Red-Green-Blue (RGB) camera is feasible. The comparison of the results from three varying datasets under different lighting conditions shows the relevance of an appropriate dataset design to achieve an accurate and robust localization. The quantitative evaluation shows an average position error of less than 20 cm for the preferred dataset. The validated training dataset and a photorealistic model of a Euro pallet are publicly provided.


title: Face Super-Resolution with Progressive Embedding of Multi-scale Face Priors

abstract: The face super-resolution (FSR) task is to reconstruct high-resolution face images from low-resolution inputs. Recent works have achieved success on this task by utilizing facial priors such as facial landmarks. Most existing methods pay more attention to global shape and structure information, but less to local texture information, which makes them cannot recover local details well. In this paper, we propose a novel recurrent convolutional network based framework for face super-resolution, which progressively introduces both global shape and local texture information. We take full advantage of the intermediate outputs of the recurrent network, and landmarks information and facial action units (AUs) information are extracted in the output of the first and second steps respectively, rather than low-resolution input. Moreover, we introduced AU classification results as a novel quantitative metric for facial details restoration. Extensive experiments show that our proposed method significantly outperforms state-of-the-art FSR methods in terms of image quality and facial details restoration.


title: A Complementary Framework for Human-Robot Collaboration with a Mixed AR-Haptic Interface

abstract: There is invariably a trade-off between safety and efficiency for collaborative robots (cobots) in human-robot collaborations. Robots that interact minimally with humans can work with high speed and accuracy but cannot adapt to new tasks or respond to unforeseen changes, whereas robots that work closely with humans can but only by becoming passive to humans, meaning that their main tasks suspended and efficiency compromised. Accordingly, this paper proposes a new complementary framework for human-robot collaboration that balances the safety of humans and the efficiency of robots. In this framework, the robot carries out given tasks using a vision-based adaptive controller, and the human expert collaborates with the robot in the null space. Such a decoupling drives the robot to deal with existing issues in task space (e.g., uncalibrated camera, limited field of view) and in null space (e.g., joint limits) by itself while allowing the expert to adjust the configuration of the robot body to respond to unforeseen changes (e.g., sudden invasion, change of environment) without affecting the robot's main task. Additionally, the robot can simultaneously learn the expert's demonstration in task space and null space beforehand with dynamic movement primitives (DMP). Therefore, an expert's knowledge and a robot's capability are both explored and complementary. Human demonstration and involvement are enabled via a mixed interaction interface, i.e., augmented reality (AR) and haptic devices. The stability of the closed-loop system is rigorously proved with Lyapunov methods. Experimental results in various scenarios are presented to illustrate the performance of the proposed method.


title: A heuristic algorithm for the Air Transport Unit Consolidation Problem

abstract: Consolidation of loose packages into transport units is a fundamental activity offered by logistics service-providers. Moving the transport units instead of loose packages is faster (with one movement only, multiple packages are loaded instead of having one load operation for each package), safer (chances of damage and loss is reduced) and cheaper. One of the typical objective of consolidation problems is the minimization of the number of transport units used, e.g. containers. In air transportation, however, transport units have multiple aspects which concur in the calculation of the cost and thus optimization in the number and characteristics of the transport units is required. In this paper, we present the air transport unit consolidation problem where the aim is to determine how to consolidate loose packages in transport units with the goal of minimizing the corresponding cost. The problem is a variant of the three-dimensional bin packing problem where the objective function is formulated according to the way costs are calculated in the air transport business. In addition, side constraints are included to take into account specific requirements. We propose a heuristic algorithm which construct an initial feasible solution and then improves it through a local search algorithm. Computational tests on randomly generated instances show that the algorithm provides high quality solutions in a reasonable computing time. In addition, tests on real data show that it improves solutions found in practice by the company providing the data.


title: Generative Adversarial Nets: Can we generate a new dataset based on only one training set?

abstract: A generative adversarial network (GAN) is a class of machine learning frameworks designed by Goodfellow et al. in 2014. In the GAN framework, the generative model is pitted against an adversary: a discriminative model that learns to determine whether a sample is from the model distribution or the data distribution. GAN generates new samples from the same distribution as the training set. In this work, we aim to generate a new dataset that has a different distribution from the training set. In addition, the Jensen-Shannon divergence between the distributions of the generative and training datasets can be controlled by some target $\delta \in [0, 1]$. Our work is motivated by applications in generating new kinds of rice that have similar characteristics as good rice.


title: BEV-LaneDet: a Simple and Effective 3D Lane Detection Baseline

abstract: 3D lane detection which plays a crucial role in vehicle routing, has recently been a rapidly developing topic in autonomous driving. Previous works struggle with practicality due to their complicated spatial transformations and inflexible representations of 3D lanes. Faced with the issues, our work proposes an efficient and robust monocular 3D lane detection called BEV-LaneDet with three main contributions. First, we introduce the Virtual Camera that unifies the in/extrinsic parameters of cameras mounted on different vehicles to guarantee the consistency of the spatial relationship among cameras. It can effectively promote the learning procedure due to the unified visual space. We secondly propose a simple but efficient 3D lane representation called Key-Points Representation. This module is more suitable to represent the complicated and diverse 3D lane structures. At last, we present a light-weight and chip-friendly spatial transformation module named Spatial Transformation Pyramid to transform multiscale front-view features into BEV features. Experimental results demonstrate that our work outperforms the state-of-the-art approaches in terms of F-Score, being 10.6% higher on the OpenLane dataset and 5.9% higher on the Apollo 3D synthetic dataset, with a speed of 185 FPS. The source code will released at https://github.com/gigo-team/bev_lane_det.


title: JukeDrummer: Conditional Beat-aware Audio-domain Drum Accompaniment Generation via Transformer VQ-VAE

abstract: This paper proposes a model that generates a drum track in the audio domain to play along to a user-provided drum-free recording. Specifically, using paired data of drumless tracks and the corresponding human-made drum tracks, we train a Transformer model to improvise the drum part of an unseen drumless recording. We combine two approaches to encode the input audio. First, we train a vector-quantized variational autoencoder (VQ-VAE) to represent the input audio with discrete codes, which can then be readily used in a Transformer. Second, using an audio-domain beat tracking model, we compute beat-related features of the input audio and use them as embeddings in the Transformer. Instead of generating the drum track directly as waveforms, we use a separate VQ-VAE to encode the mel-spectrogram of a drum track into another set of discrete codes, and train the Transformer to predict the sequence of drum-related discrete codes. The output codes are then converted to a mel-spectrogram with a decoder, and then to the waveform with a vocoder. We report both objective and subjective evaluations of variants of the proposed model, demonstrating that the model with beat information generates drum accompaniment that is rhythmically and stylistically consistent with the input audio.


title: BoxMask: Revisiting Bounding Box Supervision for Video Object Detection

abstract: We present a new, simple yet effective approach to uplift video object detection. We observe that prior works operate on instance-level feature aggregation that imminently neglects the refined pixel-level representation, resulting in confusion among objects sharing similar appearance or motion characteristics. To address this limitation, we propose BoxMask, which effectively learns discriminative representations by incorporating class-aware pixel-level information. We simply consider bounding box-level annotations as a coarse mask for each object to supervise our method. The proposed module can be effortlessly integrated into any region-based detector to boost detection. Extensive experiments on ImageNet VID and EPIC KITCHENS datasets demonstrate consistent and significant improvement when we plug our BoxMask module into numerous recent state-of-the-art methods.


title: Adding quark spin effects to PYTHIA string fragmentation

abstract: Quark spin effects in hadronization have been recently included in the PYTHIA 8 event generator for the simulation of the deep inelastic scattering (DIS) process off a polarized nucleon target via the external StringSpinner package. The spin effects can be simulated for the production of pseudoscalar mesons using the string+${}^3P_0$ model of polarized quark fragmentation and parametrizations of the transversity PDFs. We present here a major development of StringSpinner which includes the production of vector mesons in the polarized PYTHIA 8 string fragmentation as well as their polarized decays. The package is validated and used to simulate the transverse-spin asymmetries in semi-inclusive DIS (SIDIS). The simulation results on the Collins and dihadron asymmetries for the final state mesons are compared with the asymmetries measured in SIDIS off transversely polarized protons. Also shown are the predictions for the Collins asymmetries for $\rho$ mesons produced in SIDIS off transversely polarized protons.


title: Simulating Spreading of Multiple Interacting Processes in Complex Networks

abstract: Investigating the interaction between spreading processes in complex networks is one of the most important challenges in network science. However, whether we would like to know how the information campaign will affect virus spreading or how the advertising campaign of the new iPhone will affect the sales of Samsung phones, we need an environment that will allow us to evaluate under what conditions our spreading campaign will be effective. Network Diffusion is a Python package that should help do that. In this paper, we introduce its operating principle and main functionalities, including simple examples of simulations that can be performed using it.


title: Optimal Disturbances of Blocking: A Barotropic View

abstract: In this paper, we explore optimal disturbances of blockings in the equivalent barotropic atmosphere using the conditional nonlinear optimal perturbation (CNOP) approach. Considering the initial blocking amplitude, the optimal disturbance exhibits a solitary wave-like pattern. As the size increases incrementally, the spatial pattern becomes more concentrated, and the nonlinear evolution becomes more pronounced. During the evolution, it only focuses on gradually intensifying the blocking amplitude without any other influence. Additionally, based on the medium-range experiments, the time-delay optimal disturbance appears to lead to larger errors, making it more challenging to predict. Considering the preexisting synoptic-scale eddies, the optimal disturbance displays a sharply concentrated pattern, even more concentrated by increasing the size. However, it is worth noting that the nonlinear evolution undergoes significant changes, compared to disturbances of the initial blocking amplitude. Meanwhile, we find that the optimal disturbance not only strongly impacts the amplitude of blockings but also their shape, making eddy straining and wave breaking more chaotic and predominant, further influencing the development of weather extremes. This suggests that blockings are more sensitive to perturbations of preexisting synoptic-scale eddies than initial blocking amplitudes. Furthermore, the perturbations of the synoptic-scale eddies are more likely to lead to the development of weather extremes, making them less predictable. In medium-range experiments, it is also found that time-delay disturbances result in larger errors, particularly during the decay period. Finally, we discuss how the variations of westerly wind influence optimal disturbances in spatial patterns and nonlinear evolution as well as their relation to predictability.


title: Phantom -- A RL-driven multi-agent framework to model complex systems

abstract: Agent based modelling (ABM) is a computational approach to modelling complex systems by specifying the behaviour of autonomous decision-making components or agents in the system and allowing the system dynamics to emerge from their interactions. Recent advances in the field of Multi-agent reinforcement learning (MARL) have made it feasible to study the equilibrium of complex environments where multiple agents learn simultaneously. However, most ABM frameworks are not RL-native, in that they do not offer concepts and interfaces that are compatible with the use of MARL to learn agent behaviours. In this paper, we introduce a new open-source framework, Phantom, to bridge the gap between ABM and MARL. Phantom is an RL-driven framework for agent-based modelling of complex multi-agent systems including, but not limited to economic systems and markets. The framework aims to provide the tools to simplify the ABM specification in a MARL-compatible way - including features to encode dynamic partial observability, agent utility functions, heterogeneity in agent preferences or types, and constraints on the order in which agents can act (e.g. Stackelberg games, or more complex turn-taking environments). In this paper, we present these features, their design rationale and present two new environments leveraging the framework.


title: The height of chitinous ridges alone produces the entire structural colour palette

abstract: The colourful wings of butterflies result from the interaction between light and the intricate chitinous nanostructures on butterflies' scales. This study demonstrates that just by reproducing the chitinous ridges present in butterfly scales (i.e., without any other secondary structure), the entire colour palette is achieved. This result was achieved using a new methodology based on the controlled reproduction of parts of the biological structure of complex chitinous systems using their native chemistry, enabling the isolation of different features' contributions. Here we isolate the contribution of the ridges and their variations as producing and modulating colour hue. The results suggest that complicated butterfly scales may be non-ideal solutions for producing colour when multifunctionality is not considered.