title: GLT-T: Global-Local Transformer Voting for 3D Single Object Tracking in Point Clouds

abstract: Current 3D single object tracking methods are typically based on VoteNet, a 3D region proposal network. Despite the success, using a single seed point feature as the cue for offset learning in VoteNet prevents high-quality 3D proposals from being generated. Moreover, seed points with different importance are treated equally in the voting process, aggravating this defect. To address these issues, we propose a novel global-local transformer voting scheme to provide more informative cues and guide the model pay more attention on potential seed points, promoting the generation of high-quality 3D proposals. Technically, a global-local transformer (GLT) module is employed to integrate object- and patch-aware prior into seed point features to effectively form strong feature representation for geometric positions of the seed points, thus providing more robust and accurate cues for offset learning. Subsequently, a simple yet effective training strategy is designed to train the GLT module. We develop an importance prediction branch to learn the potential importance of the seed points and treat the output weights vector as a training constraint term. By incorporating the above components together, we exhibit a superior tracking method GLT-T. Extensive experiments on challenging KITTI and NuScenes benchmarks demonstrate that GLT-T achieves state-of-the-art performance in the 3D single object tracking task. Besides, further ablation studies show the advantages of the proposed global-local transformer voting scheme over the original VoteNet. Code and models will be available at https://github.com/haooozi/GLT-T.


title: Exponential sums over Piatetski-Shapiro primes in arithmetic progressions

abstract: Let $\gamma<1<c$ and $19(c-1)+171(1-\gamma)<9$. In this paper, we establish an asymptotic formula for exponential sums over Piatetski-Shapiro primes $p=[n^{1/\gamma}]$ in arithmetic progressions.


title: Towards Generalizable Graph Contrastive Learning: An Information Theory Perspective

abstract: Graph contrastive learning (GCL) emerges as the most representative approach for graph representation learning, which leverages the principle of maximizing mutual information (InfoMax) to learn node representations applied in downstream tasks. To explore better generalization from GCL to downstream tasks, previous methods heuristically define data augmentation or pretext tasks. However, the generalization ability of GCL and its theoretical principle are still less reported. In this paper, we first propose a metric named GCL-GE for GCL generalization ability. Considering the intractability of the metric due to the agnostic downstream task, we theoretically prove a mutual information upper bound for it from an information-theoretic perspective. Guided by the bound, we design a GCL framework named InfoAdv with enhanced generalization ability, which jointly optimizes the generalization metric and InfoMax to strike the right balance between pretext task fitting and the generalization ability on downstream tasks. We empirically validate our theoretical findings on a number of representative benchmarks, and experimental results demonstrate that our model achieves state-of-the-art performance.


title: Soft dipole resonance in neutron-rich $^8$He

abstract: In neutron-rich $^8$He, we study the soft dipole resonance, which is regarded as a dipole oscillation of four valence neutrons against the $^4$He core, and its effect on the low-energy electric dipole strength with a $^4$He+$n$+$n$+$n$+$n$ five-body cluster model. This work is an extended study of an earlier letter [T. Myo and K. Kat\=o, Phys. Rev. C106, L021302 (2022)]. The five-body unbound $1^-$ states of $^8$He are obtained with the complex energy eigenvalues by using the complex scaling method and the dipole strength is calculated in terms of the complex-scaled Green's function. Two kinds of the dominant excitation modes are confirmed in the dipole strength below 20 MeV of the excitation energy. The strengths below 10 MeV are exhausted by the $^7$He+$n$ channel, which sequentially decays to $^6$He+$n$+$n$. Above 10 MeV, the strengths arise from the soft dipole mode of four neutrons ($4n$) oscillating against the $^4$He core. We further explore the possibility of the soft dipole resonance for this state by carefully searching for the resonance pole and finally predict the corresponding resonance with the excitation energy of 14 MeV and the decay width of 21 MeV. The soft dipole resonance exhausts about half of the dipole strength in the relative motion between the $^4$He core and $4n$.


title: Attention-based Class Activation Diffusion for Weakly-Supervised Semantic Segmentation

abstract: Extracting class activation maps (CAM) is a key step for weakly-supervised semantic segmentation (WSSS). The CAM of convolution neural networks fails to capture long-range feature dependency on the image and result in the coverage on only foreground object parts, i.e., a lot of false negatives. An intuitive solution is ``coupling'' the CAM with the long-range attention matrix of visual transformers (ViT) We find that the direct ``coupling'', e.g., pixel-wise multiplication of attention and activation, achieves a more global coverage (on the foreground), but unfortunately goes with a great increase of false positives, i.e., background pixels are mistakenly included. This paper aims to tackle this issue. It proposes a new method to couple CAM and Attention matrix in a probabilistic Diffusion way, and dub it AD-CAM. Intuitively, it integrates ViT attention and CAM activation in a conservative and convincing way. Conservative is achieved by refining the attention between a pair of pixels based on their respective attentions to common neighbors, where the intuition is two pixels having very different neighborhoods are rarely dependent, i.e., their attention should be reduced. Convincing is achieved by diffusing a pixel's activation to its neighbors (on the CAM) in proportion to the corresponding attentions (on the AM). In experiments, our results on two challenging WSSS benchmarks PASCAL VOC and MS~COCO show that AD-CAM as pseudo labels can yield stronger WSSS models than the state-of-the-art variants of CAM.


title: Quantaloidal Completions of Order-enriched Categories and Their Applications

abstract: By introducing the concept of quantaloidal completions for an order-enriched category, relationships between the category of quantaloids and the category of order-enriched categories are studied. It is proved that quantaloidal completions for an order-enriched category can be fully characterized as compatible quotients of the power-set completion. As applications, we show that a special type of injective hull of an order-enriched category is the MacNeille completion; the free quantaloid over an order-enriched category is the Down-set completion.


title: Invisible Backdoor Attack with Dynamic Triggers against Person Re-identification

abstract: In recent years, person Re-identification (ReID) has rapidly progressed with wide real-world applications, but also poses significant risks of adversarial attacks. In this paper, we focus on the backdoor attack on deep ReID models. Existing backdoor attack methods follow an all-to-one or all-to-all attack scenario, where all the target classes in the test set have already been seen in the training set. However, ReID is a much more complex fine-grained open-set recognition problem, where the identities in the test set are not contained in the training set. Thus, previous backdoor attack methods for classification are not applicable for ReID. To ameliorate this issue, we propose a novel backdoor attack on deep ReID under a new all-to-unknown scenario, called Dynamic Triggers Invisible Backdoor Attack (DT-IBA). Instead of learning fixed triggers for the target classes from the training set, DT-IBA can dynamically generate new triggers for any unknown identities. Specifically, an identity hashing network is proposed to first extract target identity information from a reference image, which is then injected into the benign images by image steganography. We extensively validate the effectiveness and stealthiness of the proposed attack on benchmark datasets, and evaluate the effectiveness of several defense methods against our attack.


title: Active Exploration based on Information Gain by Particle Filter for Efficient Spatial Concept Formation

abstract: Autonomous robots need to learn the categories of various places by exploring their environments and interacting with users. However, preparing training datasets with linguistic instructions from users is time-consuming and labor-intensive. Moreover, effective exploration is essential for appropriate concept formation and rapid environmental coverage. To address this issue, we propose an active inference method, referred to as spatial concept formation with information gain-based active exploration (SpCoAE) that combines sequential Bayesian inference using particle filters and information gain-based destination determination in a probabilistic generative model. This study interprets the robot's action as a selection of destinations to ask the user, `What kind of place is this?' in the context of active inference. This study provides insights into the technical aspects of the proposed method, including active perception and exploration by the robot, and how the method can enable mobile robots to learn spatial concepts through active exploration. Our experiment demonstrated the effectiveness of the SpCoAE in efficiently determining a destination for learning appropriate spatial concepts in home environments.


title: Components of domino tilings under flips in quadriculated cylinder and torus

abstract: In a region $R$ consisting of unit squares, a domino is the union of two adjacent squares and a (domino) tiling is a collection of dominoes with disjoint interior whose union is the region. The flip graph $\mathcal{T}(R)$ is defined on the set of all tilings of $R$ such that two tilings are adjacent if we change one to another by a flip (a $90^{\circ}$ rotation of a pair of side-by-side dominoes). It is well-known that $\mathcal{T}(R)$ is connected when $R$ is simply connected. By using graph theoretical approach, we show that the flip graph of $2m\times(2n+1)$ quadriculated cylinder is still connected, but the flip graph of $2m\times(2n+1)$ quadriculated torus is disconnected and consists of exactly two isomorphic components. For a tiling $t$, we associate an integer $f(t)$, forcing number, as the minimum number of dominoes in $t$ that is contained in no other tilings. As an application, we obtain that the forcing numbers of all tilings in $2m\times (2n+1)$ quadriculated cylinder and torus form respectively an integer interval whose maximum value is $(n+1)m$.


title: Deep Reinforcement Learning Guided Improvement Heuristic for Job Shop Scheduling

abstract: Recent studies in using deep reinforcement learning (DRL) to solve Job-shop scheduling problems (JSSP) focus on construction heuristics. However, their performance is still far from optimality, mainly because the underlying graph representation scheme is unsuitable for modelling partial solutions at each construction step. This paper proposes a novel DRL-guided improvement heuristic for solving JSSP, where graph representation is employed to encode complete solutions. We design a Graph Neural-Network-based representation scheme, consisting of two modules to effectively capture the information of dynamic topology and different types of nodes in graphs encountered during the improvement process. To speed up solution evaluation during improvement, we present a novel message-passing mechanism that can evaluate multiple solutions simultaneously. We prove that the computational complexity of our method scales linearly with problem size. Experiments on classic benchmarks show that the improvement policy learned by our method outperforms state-of-the-art DRL-based methods by a large margin.


title: A feasibility study of the reflection readout method of Resistive-Plate Chambers

abstract: The conventional readout method of the RPC detector uses two sets of orthogonal readout strips placed at the both sides of the gas gap to collect signals of opposite polarities to obtain space points. A new readout method utilizing the reflected signals is proposed which only requires one set of readout strips. The reflection readout method utilizes the differences in the arrival time of the direct and reflected signals to determine the hit position. Customized transmission cables are introduced to extend the propagation distance of reflected signals to ensure sufficient separation of the two signals. Because only one side of the readout panel is connected to the FEE boards, reflection readout method can increase the geometrical acceptance and save the readout channels. Experimental setup and test results of this novel readout method is shown in this paper. It is demonstrated that a spatial resolution of sub centimeter can be achieved by processing the rising edges of the original and reflected pulses with commonly used electronics.


title: AI-KD: Adversarial learning and Implicit regularization for self-Knowledge Distillation

abstract: We present a novel adversarial penalized self-knowledge distillation method, named adversarial learning and implicit regularization for self-knowledge distillation (AI-KD), which regularizes the training procedure by adversarial learning and implicit distillations. Our model not only distills the deterministic and progressive knowledge which are from the pre-trained and previous epoch predictive probabilities but also transfers the knowledge of the deterministic predictive distributions using adversarial learning. The motivation is that the self-knowledge distillation methods regularize the predictive probabilities with soft targets, but the exact distributions may be hard to predict. Our method deploys a discriminator to distinguish the distributions between the pre-trained and student models while the student model is trained to fool the discriminator in the trained procedure. Thus, the student model not only can learn the pre-trained model's predictive probabilities but also align the distributions between the pre-trained and student models. We demonstrate the effectiveness of the proposed method with network architectures on multiple datasets and show the proposed method achieves better performance than state-of-the-art methods.


title: The weak saturation number of $\boldsymbol{K_{2, t}}$

abstract: For two graphs $G$ and $F$, we say that $G$ is weakly $F$-saturated if $G$ contains no copy of $F$ as a subgraph and one could join all the nonadjacent pairs of vertices of $G$ in some order so that a new copy of $F$ is created at each step. The weak saturation number $\mathrm{wsat}(n, F)$ is the minimum number of edges of a weakly $F$-saturated graph on $n$ vertices. In this paper, we examine $\mathrm{wsat}(n, K_{s, t})$, where $K_{s, t}$ is the complete bipartite graph with parts of sizes $s$ and $ t $. We determine $\mathrm{wsat}(n, K_{2, t})$, correcting a previous report in the literature. It is also shown that $\mathrm{wsat}(s+t, K_{s,t})=\binom{s+t-1}{2}$ if $\gcd(s, t)=1$ and $\mathrm{wsat}(s+t, K_{s,t})=\binom{s+t-1}{2}+1$, otherwise.


title: Inversionless gain in a lossy medium

abstract: We study gain without inversion due to coherence effects in a Doppler-broadened degenerate three-level system of a rubidium-hydrogen mixture in a miniaturized micron scale custom vapor cell. The cell miniaturization gives rise to collisions of atoms with the walls of the cell. This, combined with the high collision rate with the hydrogen buffer gas allows us to observe gain in the absorption spectra. Furthermore, we analyze the role of cell miniaturization in the evolution of the gain profile. In addition to fundamental interest, the observation of gain without inversion in our miniaturized cells paves the way for applications such as miniaturized lasers without inversion.


title: Logarithmic supertranslations and supertranslation-invariant Lorentz charges

abstract: We extend the BMS(4) group by adding logarithmic supertranslations. This is done by relaxing the boundary conditions on the metric and its conjugate momentum at spatial infinity in order to allow logarithmic terms of carefully designed form in the asymptotic expansion, while still preserving finiteness of the action. Standard theorems of the Hamiltonian formalism are used to derive the (finite) generators of the logarithmic supertranslations. As the ordinary supertranslations, these depend on a function of the angles. Ordinary and logarithmic supertranslations are then shown to form an abelian subalgebra with non-vanishing central extension. Because of this central term, one can make nonlinear redefinitions of the generators of the algebra so that the pure supertranslations ($\ell >1$ in a spherical harmonic expansion) and the logarithmic supertranslations have vanishing brackets with all the Poincar\'e generators, and, in particular, transform in the trivial representation of the Lorentz group. The symmetry algebra is then the direct sum of the Poincar\'e algebra and the infinite-dimensional abelian algebra formed by the pure supertranslations and the logarithmic supertranslations (with central extension). The pure supertranslations are thus completely decoupled from the standard Poincar\'e algebra in the asymptotic symmetry algebra. This implies in particular that one can provide a definition of the angular momentum which is manifestly free from supertranslation ambiguities. An intermediate redefinition providing a partial decoupling of the pure and logarithmic supertranslations is also given.


title: On the convergence analysis of DCA

abstract: In this paper, we propose a clean and general proof framework to establish the convergence analysis of the Difference-of-Convex (DC) programming algorithm (DCA) for both standard DC program and convex constrained DC program. We first discuss suitable assumptions for the well-definiteness of DCA. Then, we focus on the convergence analysis of DCA, in particular, the global convergence of the sequence $\{x^k\}$ generated by DCA under the Lojasiewicz subgradient inequality and the Kurdyka-Lojasiewicz property respectively. Moreover, the convergence rate for the sequences $\{f(x^k)\}$ and $\{\|x^k-x^*\|\}$ are also investigated. We hope that the proof framework presented in this article will be a useful tool to conveniently establish the convergence analysis for many variants of DCA and new DCA-type algorithms.


title: Scalable Collaborative Learning via Representation Sharing

abstract: Privacy-preserving machine learning has become a key conundrum for multi-party artificial intelligence. Federated learning (FL) and Split Learning (SL) are two frameworks that enable collaborative learning while keeping the data private (on device). In FL, each data holder trains a model locally and releases it to a central server for aggregation. In SL, the clients must release individual cut-layer activations (smashed data) to the server and wait for its response (during both inference and back propagation). While relevant in several settings, both of these schemes have a high communication cost, rely on server-level computation algorithms and do not allow for tunable levels of collaboration. In this work, we present a novel approach for privacy-preserving machine learning, where the clients collaborate via online knowledge distillation using a contrastive loss (contrastive w.r.t. the labels). The goal is to ensure that the participants learn similar features on similar classes without sharing their input data. To do so, each client releases averaged last hidden layer activations of similar labels to a central server that only acts as a relay (i.e., is not involved in the training or aggregation of the models). Then, the clients download these last layer activations (feature representations) of the ensemble of users and distill their knowledge in their personal model using a contrastive objective. For cross-device applications (i.e., small local datasets and limited computational capacity), this approach increases the utility of the models compared to independent learning and other federated knowledge distillation (FD) schemes, is communication efficient and is scalable with the number of clients. We prove theoretically that our framework is well-posed, and we benchmark its performance against standard FD and FL on various datasets using different model architectures.


title: Feature Weaken: Vicinal Data Augmentation for Classification

abstract: Deep learning usually relies on training large-scale data samples to achieve better performance. However, over-fitting based on training data always remains a problem. Scholars have proposed various strategies, such as feature dropping and feature mixing, to improve the generalization continuously. For the same purpose, we subversively propose a novel training method, Feature Weaken, which can be regarded as a data augmentation method. Feature Weaken constructs the vicinal data distribution with the same cosine similarity for model training by weakening features of the original samples. In especially, Feature Weaken changes the spatial distribution of samples, adjusts sample boundaries, and reduces the gradient optimization value of back-propagation. This work can not only improve the classification performance and generalization of the model, but also stabilize the model training and accelerate the model convergence. We conduct extensive experiments on classical deep convolution neural models with five common image classification datasets and the Bert model with four common text classification datasets. Compared with the classical models or the generalization improvement methods, such as Dropout, Mixup, Cutout, and CutMix, Feature Weaken shows good compatibility and performance. We also use adversarial samples to perform the robustness experiments, and the results show that Feature Weaken is effective in improving the robustness of the model.


title: Flat model structures and Gorenstein objects in functor categories

abstract: We construct a flat model structure on the category $_{\mathcal{Q},R}{\mathsf{Mod}}$ of additive functors from a small preadditive category $\mathcal{Q}$ satisfying certain conditions to the module category $_{R}{\mathsf{Mod}}$ over an associative ring $R$, whose homotopy category is the $\mathcal{Q}$-shaped derived category introduced by Holm and Jorgensen. Moreover, we prove that for an arbitrary associative ring $R$, an object in $_{\mathcal{Q},R}{\mathsf{Mod}}$ is Gorenstein projective (resp., Gorenstein injective, Gorenstein flat, projective coresolving Gorenstein flat) if and only if so is its value on each object of $\mathcal{Q}$, and hence improve a result by Dell'Ambrogio, Stevenson and \v{S}\v{t}ov\'{\i}\v{c}ek.


title: Normalizing Flows for Human Pose Anomaly Detection

abstract: Video anomaly detection is an ill-posed problem because it relies on many parameters such as appearance, pose, camera angle, background, and more. We distill the problem to anomaly detection of human pose, thus decreasing the risk of nuisance parameters such as appearance affecting the result. Focusing on pose alone also has the side benefit of reducing bias against distinct minority groups. Our model works directly on human pose graph sequences and is exceptionally lightweight (~1K parameters), capable of running on any machine able to run the pose estimation with negligible additional resources. We leverage the highly compact pose representation in a normalizing flows framework, which we extend to tackle the unique characteristics of spatio-temporal pose data and show its advantages in this use case. The algorithm is quite general and can handle training data of only normal examples as well as a supervised setting that consists of labeled normal and abnormal examples. We report state-of-the-art results on two anomaly detection benchmarks - the unsupervised ShanghaiTech dataset and the recent supervised UBnormal dataset.


title: Dynamical interplay between superconductivity and charge-density-wave: a nonlinear terahertz study of coherently-driven 2H-NbSe2 and La2-xSrxCuO4

abstract: 2H-NbSe2 is an archetypal system in which superconductivity and charge-density-wave (CDW) coexist and compete macroscopically with each other. In particular, this interplay also manifests in their dynamical fluctuations. As a result, the superconducting amplitude fluctuations (i.e. Higgs mode) is pushed below the quasiparticle continuum, allowing it to become a coherent excitation observable by Raman scattering. In the present study, we coherently drive the collective oscillations of the two orders and visualize their interplay in the driven states in the time domain. We find that both collective modes contribute to terahertz third harmonic generation (THG) and the THG signals interfere below Tc, leading to an anti-resonance of the integrated THG signal. The dynamical Ginzburg-Landau model suggests that around the anti-resonance a periodic energy transfer between the driven Higgs oscillations and the driven CDW oscillations is possible. In addition to 2H-NbSe2, we also studied an underdoped La2-xSrxCuO4 (x ~ 0.12) driven beyond the perturbative regime of THG. A similar interference between two sources of THG is observed below Tc. While there might be additional sources of THG in these experiments, our results illustrate the roles of coupled modes in the terahertz THG process and the tantalizing possibility of coherent control via such couplings.


title: FedDCT: Federated Learning of Large Convolutional Neural Networks on Resource Constrained Devices using Divide and Collaborative Training

abstract: We introduce FedDCT, a novel distributed learning paradigm that enables the usage of large, high-performance CNNs on resource-limited edge devices. As opposed to traditional FL approaches, which require each client to train the full-size neural network independently during each training round, the proposed FedDCT allows a cluster of several clients to collaboratively train a large deep learning model by dividing it into an ensemble of several small sub-models and train them on multiple devices in parallel while maintaining privacy. In this collaborative training process, clients from the same cluster can also learn from each other, further improving their ensemble performance. In the aggregation stage, the server takes a weighted average of all the ensemble models trained by all the clusters. FedDCT reduces the memory requirements and allows low-end devices to participate in FL. We empirically conduct extensive experiments on standardized datasets, including CIFAR-10, CIFAR-100, and two real-world medical datasets HAM10000 and VAIPE. Experimental results show that FedDCT outperforms a set of current SOTA FL methods with interesting convergence behaviors. Furthermore, compared to other existing approaches, FedDCT achieves higher accuracy and substantially reduces the number of communication rounds (with $4-8$ times fewer memory requirements) to achieve the desired accuracy on the testing dataset without incurring any extra training cost on the server side.


title: Microstructure reconstruction using diffusion-based generative models

abstract: Microstructure reconstruction has been an essential part of computational material engineering to reveal the relationship between microstructures and material properties. However, finding a general solution for microstructure characterization and reconstruction (MCR) tasks is still challenging, although there have been many attempts such as the descriptor-based MCR methods. To address this generality problem, the denoising diffusion models are first employed for the microstructure reconstruction task in this study. The applicability of the diffusion-based models is validated with several types of microstructures (e.g., polycrystalline alloy, carbonate, ceramics, copolymer, fiber composite, etc.) that have different morphological characteristics. The quality of the generated images is assessed with the quantitative evaluation metrics (FID score, precision, and recall) and the conventional statistical microstructure descriptors. Furthermore, the formulation of implicit probabilistic models (which yields non-Markovian diffusion processes) is adopted to accelerate the sampling process, thereby controlling the computational cost considering the practicability and reliability. The results show that the denoising diffusion models are well applicable to the reconstruction of various types of microstructures with different spatial distributions and morphological features. The diffusion-based approach provides a stable training process with simple implementation for generating visually similar and statistically equivalent microstructures. In these regards, the diffusion model has great potential to be used as a universal microstructure reconstruction method for handling complex microstructures for materials science.


title: Synthesizing Coherent Story with Auto-Regressive Latent Diffusion Models

abstract: Conditioned diffusion models have demonstrated state-of-the-art text-to-image synthesis capacity. Recently, most works focus on synthesizing independent images; While for real-world applications, it is common and necessary to generate a series of coherent images for story-stelling. In this work, we mainly focus on story visualization and continuation tasks and propose AR-LDM, a latent diffusion model auto-regressively conditioned on history captions and generated images. Moreover, AR-LDM can generalize to new characters through adaptation. To our best knowledge, this is the first work successfully leveraging diffusion models for coherent visual story synthesizing. Quantitative results show that AR-LDM achieves SoTA FID scores on PororoSV, FlintstonesSV, and the newly introduced challenging dataset VIST containing natural images. Large-scale human evaluations show that AR-LDM has superior performance in terms of quality, relevance, and consistency.


title: Simulation of the Signal Propagation for Thin-gap RPC in the ATLAS Phase-II Upgrade

abstract: Thin-gap Resistive Plate Chambers (RPCs) with a 1 mm gap size are introduced in the Phase-II ATLAS upgrade. Smaller avalanche charge due to the reduced gap size raises concerns for signal integrity. This work focuses on the RPC signal propagation process in lossless conditions, and an analytical study is implemented for the ATLAS RPC. Detector modeling is presented, and the simulation of the RPC signal is discussed in detail. Simulated characteristic impedance and crosstalk have been compared with the measured value to validate this model. This method is applied to different RPC design geometries, including the newly proposed $\eta-\eta$ readout scheme.


title: Extracting causation from millennial-scale climate fluctuations in the last 800 kyr

abstract: The detection of cause-effect relationships from the analysis of paleoclimatic records is a crucial step to disentangle the main mechanisms at work in the climate system. Here, we show that the approach based on the generalized Fluctuation-Dissipation Relation, complemented by the analysis of the Transfer Entropy, allows the causal links to be identified between temperature, CO2 concentration and astronomical forcing during the glacial cycles of the last 800 kyr based on Antarctic ice core records. When considering the whole spectrum of time scales, the results of the analysis suggest that temperature drives CO2 concentration, or that are both driven by the common astronomical forcing. However, considering only millennial-scale fluctuations, the results reveal the presence of more complex causal links, indicating that CO2 variations contribute to driving the changes of temperature on such time scales. The results also evidence a slow temporal variability in the strength of the millennial-scale causal links between temperature and CO2 concentration.


title: Option pricing under path-dependent stock models

abstract: This paper studies how to price and hedge options under stock models given as a path-dependent SDE solution. When the path-dependent SDE coefficients have Fr\'{e}chet derivatives, an option price is differentiable with respect to time and the path, and is given as a solution to the path-dependent PDE. This can be regarded as a path-dependent version of the Feynman-Kac formula. As a byproduct, we obtain the differentiability of path-dependent SDE solutions and the SDE representation of their derivatives. In addition, we provide formulas for Greeks with path-dependent coefficient perturbations. A stock model having coefficients with time integration forms of paths is covered as an example.


title: A Survey of Scheduling Algorithms for the Time-Aware Shaper in Time-Sensitive Networking (TSN)

abstract: Time-Sensitive Networking (TSN) is an enhancement of Ethernet which provides various mechanisms for real-time communication. Time-triggered (TT) traffic represents periodic data streams with strict real-time requirements. Amongst others, TSN supports scheduled transmission of TT streams, i.e., the transmission of their frames by end stations is coordinated in such a way that none or very little queuing delay occurs in intermediate nodes. TSN supports multiple priority queues per egress port. The TAS uses so-called gates to explicitly allow and block these queues for transmission on a short periodic timescale. The TAS is utilized to protect scheduled traffic from other traffic to minimize its queuing delay. In this work, we consider scheduling in TSN which comprises the computation of periodic transmission instants at end stations and the periodic opening and closing of queue gates. In this paper, we first give a brief overview of TSN features and standards. We state the TSN scheduling problem and explain common extensions which also include optimization problems. We review scheduling and optimization methods that have been used in this context. Then, the contribution of currently available research work is surveyed. We extract and compile optimization objectives, solved problem instances, and evaluation results. Research domains are identified, and specific contributions are analyzed. Finally, we discuss potential research directions and open problems.


title: When Noisy Labels Meet Long Tail Dilemmas: A Representation Calibration Method

abstract: Real-world large-scale datasets are both noisily labeled and class-imbalanced. The issues seriously hurt the generalization of trained models. It is hence significant to address the simultaneous incorrect labeling and class-imbalance, i.e., the problem of learning with noisy labels on long-tailed data. Previous works develop several methods for the problem. However, they always rely on strong assumptions that are invalid or hard to be checked in practice. In this paper, to handle the problem and address the limitations of prior works, we propose a representation calibration method RCAL. Specifically, RCAL works with the representations extracted by unsupervised contrastive learning. We assume that without incorrect labeling and class imbalance, the representations of instances in each class conform to a multivariate Gaussian distribution, which is much milder and easier to be checked. Based on the assumption, we recover underlying representation distributions from polluted ones resulting from mislabeled and class-imbalanced data. Additional data points are then sampled from the recovered distributions to help generalization. Moreover, during classifier training, representation learning takes advantage of representation robustness brought by contrastive learning, which further improves the classifier performance. We derive theoretical results to discuss the effectiveness of our representation calibration. Experiments on multiple benchmarks justify our claims and confirm the superiority of the proposed method.


title: On the Lp Gaussian Minkowski problem

abstract: Existence of symmetric (resp. asymmetric) solutions to the $L_p$ Gaussian Minkowski problem for $p\leq 0$ (resp. $p\geq 1$) will be provided. Moreover, existence and uniqueness of smooth solutions to the problem for $p>n$ will also be proved without the restriction that the Gaussian volumes of convex bodies are not less than one-second.


title: Efficient Representations of Object Geometry for Reinforcement Learning of Interactive Grasping Policies

abstract: Grasping objects of different shapes and sizes - a foundational, effortless skill for humans - remains a challenging task in robotics. Although model-based approaches can predict stable grasp configurations for known object models, they struggle to generalize to novel objects and often operate in a non-interactive open-loop manner. In this work, we present a reinforcement learning framework that learns the interactive grasping of various geometrically distinct real-world objects by continuously controlling an anthropomorphic robotic hand. We explore several explicit representations of object geometry as input to the policy. Moreover, we propose to inform the policy implicitly through signed distances and show that this is naturally suited to guide the search through a shaped reward component. Finally, we demonstrate that the proposed framework is able to learn even in more challenging conditions, such as targeted grasping from a cluttered bin. Necessary pre-grasping behaviors such as object reorientation and utilization of environmental constraints emerge in this case. Videos of learned interactive policies are available at https://maltemosbach.github. io/geometry_aware_grasping_policies.


title: Noncommutative crossing partitions

abstract: We define and study noncommutative crossing partitions which are a generalization of non-crossing partitions. By introducing a new cover relation on binary trees, we show that the partially ordered set of noncommutative crossing partitions is a graded lattice. This new lattice contains the Kreweras lattice, the lattice of non-crossing partitions, as a sublattice. We calculate the M\"obius function, the number of maximal chains and the number of $k$-chains in this new lattice by constructing an explicit $EL$-labeling on the lattice. By use of the $EL$-labeling, we recover the classical results on the Kreweras lattice. We characterize two endomorphism on the Kreweras lattice, the Kreweras complement map and the involution defined by Simion and Ullman, in terms of the maps on the noncommutative crossing partitions. We also establish relations among three combinatorial objects: labeled $k+1$-ary trees, $k$-chains in the lattice, and $k$-Dyck tilings.


title: Proton quark distributions from a light-front Faddeev-Bethe-Salpeter approach

abstract: The projection onto the Light-Front of a Minkowski space Faddeev-Bethe-Salpeter equation model truncated at the valence level is applied to study the proton structure with constituent quarks. The dynamics of the model has built-in: (i) a bound diquark brought by a contact interaction, and (ii) the separation by \Lambda_QCD of the infrared and ultraviolet interaction regions. The model parameters are fine tuned to reproduce the proton Dirac electromagnetic form factor and mass. From that, the non-polarized longitudinal and transverse momentum distributions were computed. The results for the evolved non-polarized valence parton distributions suggest that: (i) the explicit consideration of the spin degree of freedom of both quark and diquark seems not relevant to it, and (ii) the comparison with the global fit from the NNPDF4.0 calls for higher Fock components of the wave function beyond the valence one.


title: CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusion

abstract: Infrared and visible image fusion targets to provide an informative image by combining complementary information from different sensors. Existing learning-based fusion approaches attempt to construct various loss functions to preserve complementary features, while neglecting to discover the inter-relationship between the two modalities, leading to redundant or even invalid information on the fusion results. Moreover, most methods focus on strengthening the network with an increase in depth while neglecting the importance of feature transmission, causing vital information degeneration. To alleviate these issues, we propose a coupled contrastive learning network, dubbed CoCoNet, to realize infrared and visible image fusion in an end-to-end manner. Concretely, to simultaneously retain typical features from both modalities and to avoid artifacts emerging on the fused result, we develop a coupled contrastive constraint in our loss function. In a fused image, its foreground target / background detail part is pulled close to the infrared / visible source and pushed far away from the visible / infrared source in the representation space. We further exploit image characteristics to provide data-sensitive weights, allowing our loss function to build a more reliable relationship with source images. A multi-level attention module is established to learn rich hierarchical feature representation and to comprehensively transfer features in the fusion process. We also apply the proposed CoCoNet on medical image fusion of different types, e.g., magnetic resonance image, positron emission tomography image, and single photon emission computed tomography image. Extensive experiments demonstrate that our method achieves state-of-the-art (SOTA) performance under both subjective and objective evaluation, especially in preserving prominent targets and recovering vital textural details.


title: A many-body Szilard engine with giant number fluctuations

abstract: Szil\'ard's information engine is a canonical example in the field of thermodynamics of information. We realize experimentally a macroscopic many-particle Szil\'ard engine that consists of active particles and use it to lift a mass against gravity. We show that the extractable work per cycle increases when the raised weight is changed more gradually during the process. Interestingly, we find that the ideal extractable work grows with the number of particles due to giant number fluctuations. This is in contrast to the calculated behavior of a similar engine operating on thermal particles.


title: PG-Schema: Schemas for Property Graphs

abstract: Property graphs have reached a high level of maturity, witnessed by multiple robust graph database systems as well as the ongoing ISO standardization effort aiming at creating a new standard Graph Query Language (GQL). Yet, despite documented demand, schema support is limited both in existing systems and in the first version of the GQL Standard. It is anticipated that the second version of the GQL Standard will include a rich DDL. Aiming to inspire the development of GQL and enhance the capabilities of graph database systems, we propose PG-Schema, a simple yet powerful formalism for specifying property graph schemas. It features PG-Types with flexible type definitions supporting multi-inheritance, as well as expressive constraints based on the recently proposed PG-Keys formalism. We provide the formal syntax and semantics of PG-Schema, which meet principled design requirements grounded in contemporary property graph management scenarios, and offer a detailed comparison of its features with those of existing schema languages and graph database systems.


title: A Lightweight Domain Adaptive Absolute Pose Regressor Using Barlow Twins Objective

abstract: Identifying the camera pose for a given image is a challenging problem with applications in robotics, autonomous vehicles, and augmented/virtual reality. Lately, learning-based methods have shown to be effective for absolute camera pose estimation. However, these methods are not accurate when generalizing to different domains. In this paper, a domain adaptive training framework for absolute pose regression is introduced. In the proposed framework, the scene image is augmented for different domains by using generative methods to train parallel branches using Barlow Twins objective. The parallel branches leverage a lightweight CNN-based absolute pose regressor architecture. Further, the efficacy of incorporating spatial and channel-wise attention in the regression head for rotation prediction is investigated. Our method is evaluated with two datasets, Cambridge landmarks and 7Scenes. The results demonstrate that, even with using roughly 24 times fewer FLOPs, 12 times fewer activations, and 5 times fewer parameters than MS-Transformer, our approach outperforms all the CNN-based architectures and achieves performance comparable to transformer-based architectures. Our method ranks 2nd and 4th with the Cambridge Landmarks and 7Scenes datasets, respectively. In addition, for augmented domains not encountered during training, our approach significantly outperforms the MS-transformer. Furthermore, it is shown that our domain adaptive framework achieves better performance than the single branch model trained with the identical CNN backbone with all instances of the unseen distribution.


title: A space-time framework for periodic flows with applications to hydrofoils

abstract: In this paper we propose a space-time framework for the computation of periodic flows. We employ the isogeometric analysis framework to achieve higher-order smoothness in both space and time. The discretization is performed using residual-based variational multiscale modelling and weak boundary conditions are adopted to enhance the accuracy near the moving boundaries of the computational domain. We show conservation properties and present a conservative method for force extraction. We apply our framework to the computation of a heaving and pitching hydrofoil. Numerical results display very accurate results on course meshes.


title: Persistence of the Omicron variant of SARS-CoV-2 in Australia: The impact of fluctuating social distancing

abstract: We modelled emergence and spread of the Omicron variant of SARS-CoV-2 in Australia between December 2021 and June 2022. This pandemic stage exhibited a diverse epidemiological profile with emergence of co-circulating sub-lineages of Omicron, further complicated by differences in social distancing behaviour which varied over time. Our study delineated distinct phases of the Omicron-associated pandemic stage, and retrospectively quantified the adoption of social distancing measures, fluctuating over different time periods in response to the observable incidence dynamics. We also modelled the corresponding disease burden, in terms of hospitalisations, intensive care unit occupancy, and mortality. Supported by good agreement between simulated and actual health data, our study revealed that the nonlinear dynamics observed in the daily incidence and disease burden were determined not only by introduction of sub-lineages of Omicron, but also by the fluctuating adoption of social distancing measures. Our high-resolution model can be used in design and evaluation of public health interventions during future crises.


title: Decoding Attention from Gaze: A Benchmark Dataset and End-to-End Models

abstract: Eye-tracking has potential to provide rich behavioral data about human cognition in ecologically valid environments. However, analyzing this rich data is often challenging. Most automated analyses are specific to simplistic artificial visual stimuli with well-separated, static regions of interest, while most analyses in the context of complex visual stimuli, such as most natural scenes, rely on laborious and time-consuming manual annotation. This paper studies using computer vision tools for "attention decoding", the task of assessing the locus of a participant's overt visual attention over time. We provide a publicly available Multiple Object Eye-Tracking (MOET) dataset, consisting of gaze data from participants tracking specific objects, annotated with labels and bounding boxes, in crowded real-world videos, for training and evaluating attention decoding algorithms. We also propose two end-to-end deep learning models for attention decoding and compare these to state-of-the-art heuristic methods.


title: Font Representation Learning via Paired-glyph Matching

abstract: Fonts can convey profound meanings of words in various forms of glyphs. Without typography knowledge, manually selecting an appropriate font or designing a new font is a tedious and painful task. To allow users to explore vast font styles and create new font styles, font retrieval and font style transfer methods have been proposed. These tasks increase the need for learning high-quality font representations. Therefore, we propose a novel font representation learning scheme to embed font styles into the latent space. For the discriminative representation of a font from others, we propose a paired-glyph matching-based font representation learning model that attracts the representations of glyphs in the same font to one another, but pushes away those of other fonts. Through evaluations on font retrieval with query glyphs on new fonts, we show our font representation learning scheme achieves better generalization performance than the existing font representation learning techniques. Finally on the downstream font style transfer and generation tasks, we confirm the benefits of transfer learning with the proposed method. The source code is available at https://github.com/junhocho/paired-glyph-matching.


title: Statistical Optimality of Divide and Conquer Kernel-based Functional Linear Regression

abstract: Previous analysis of regularized functional linear regression in a reproducing kernel Hilbert space (RKHS) typically requires the target function to be contained in this kernel space. This paper studies the convergence performance of divide-and-conquer estimators in the scenario that the target function does not necessarily reside in the underlying RKHS. As a decomposition-based scalable approach, the divide-and-conquer estimators of functional linear regression can substantially reduce the algorithmic complexities in time and memory. We develop an integral operator approach to establish sharp finite sample upper bounds for prediction with divide-and-conquer estimators under various regularity conditions of explanatory variables and target function. We also prove the asymptotic optimality of the derived rates by building the mini-max lower bounds. Finally, we consider the convergence of noiseless estimators and show that the rates can be arbitrarily fast under mild conditions.


title: Bidder Subset Selection Problem in Auction Design

abstract: Motivated by practical concerns in the online advertising industry, we study a bidder subset selection problem in single-item auctions. In this problem, a large pool of candidate bidders have independent values sampled from known prior distributions. The seller needs to pick a subset of bidders and run a given auction format on the selected subset to maximize her expected revenue. We propose two frameworks for the subset restrictions: (i) capacity constraint on the set of selected bidders; and (ii) incurred costs for the bidders invited to the auction. For the second-price auction with anonymous reserve (SPA-AR), we give constant approximation polynomial time algorithms in both frameworks (in the latter framework under mild assumptions about the market). Our results are in stark contrast to the previous work of Mehta, Nadav, Psomas, Rubinstein [NeurIPS 2020], who showed hardness of approximation for the SPA without a reserve price. We also give complimentary approximation results for other well-studied auction formats such as anonymous posted pricing and sequential posted pricing. On a technical level, we find that the revenue of SPA-AR as a set function $f(S)$ of its bidders $S$ is fractionally-subadditive but not submodular. Our bidder selection problem with invitation costs is a natural question about (approximately) answering a demand oracle for $f(\cdot)$ under a given vector of costs, a common computational assumption in the literature on combinatorial auctions.


title: Non-equilibrium diffusion limit of the compressible Navier-Stokes-Fourier-P1 approximation model at low Mach number: general initial data case

abstract: In this paper, we investigate the non-equilibrium diffusion limit of the compressible Navier-Stokes-Fourier-P1 (NSF-P1) approximation model at low Mach number, which arises in radiation hydrodynamics, with general initial data and a parameter $\delta \in [0,2]$ describing the intensity of scatting effect. In previous literature, only $\delta =2$ and well-prepared initial data case to the NSF-P1 model was considered. Here we prove that, for partial general initial data and $\delta =2$, this model converges to the system of low Mach number heat-conducting viscous flows coupled with a diffusion equation as the parameter $\epsilon \rightarrow 0$. Compared to the classical NSF system, the NSF-P1 model has additional new singular structures caused by the radiation pressure. To handle these structures, we construct an equivalent pressure and an equivalent velocity to balance the order of singularity and establish the uniform estimates of solutions by designating appropriate weighted norms and carrying out delicate energy analysis. We then obtain the convergence of the pressure and velocity from the local energy decay of the equivalent pressure and equivalent velocity. We also briefly discuss the variations of the limit equations as the scattering intensity changes, i.e., $\delta \in (0,2)$. We find that, with the weakening of scattering intensity, the ``diffusion property" of radiation intensity gradually weakens. Furthermore, when the scattering effect is sufficiently weak ($\delta =0$), we can obtain the singular limits of the NSF-P1 model with general initial data. To our best knowledge, this is the first result on the influence of scattering intensity in the non-equilibrium diffusion limit of the NSF-P1 model.


title: On Holistic Multi-Step Cyberattack Detection via a Graph-based Correlation Approach

abstract: While digitization of distribution grids through information and communications technology brings numerous benefits, it also increases the grid's vulnerability to serious cyber attacks. Unlike conventional systems, attacks on many industrial control systems such as power grids often occur in multiple stages, with the attacker taking several steps at once to achieve its goal. Detection mechanisms with situational awareness are needed to detect orchestrated attack steps as part of a coherent attack campaign. To provide a foundation for detection and prevention of such attacks, this paper addresses the detection of multi-stage cyber attacks with the aid of a graph-based cyber intelligence database and alert correlation approach. Specifically, we propose an approach to detect multi-stage attacks by leveraging heterogeneous data to form a knowledge base and employ a model-based correlation approach on the generated alerts to identify multi-stage cyber attack sequences taking place in the network. We investigate the detection quality of the proposed approach by using a case study of a multi-stage cyber attack campaign in a future-orientated power grid pilot.


title: A Comparative Analysis of Transfer Learning-based Techniques for the Classification of Melanocytic Nevi

abstract: Skin cancer is a fatal manifestation of cancer. Unrepaired deoxyribo-nucleic acid (DNA) in skin cells, causes genetic defects in the skin and leads to skin cancer. To deal with lethal mortality rates coupled with skyrocketing costs of medical treatment, early diagnosis is mandatory. To tackle these challenges, researchers have developed a variety of rapid detection tools for skin cancer. Lesion-specific criteria are utilized to distinguish benign skin cancer from malignant melanoma. In this study, a comparative analysis has been performed on five Transfer Learning-based techniques that have the potential to be leveraged for the classification of melanocytic nevi. These techniques are based on deep convolutional neural networks (DCNNs) that have been pre-trained on thousands of open-source images and are used for day-to-day classification tasks in many instances.


title: FakeSV: A Multimodal Benchmark with Rich Social Context for Fake News Detection on Short Video Platforms

abstract: Short video platforms have become an important channel for news sharing, but also a new breeding ground for fake news. To mitigate this problem, research of fake news video detection has recently received a lot of attention. Existing works face two roadblocks: the scarcity of comprehensive and largescale datasets and insufficient utilization of multimodal information. Therefore, in this paper, we construct the largest Chinese short video dataset about fake news named FakeSV, which includes news content, user comments, and publisher profiles simultaneously. To understand the characteristics of fake news videos, we conduct exploratory analysis of FakeSV from different perspectives. Moreover, we provide a new multimodal detection model named SV-FEND, which exploits the cross-modal correlations to select the most informative features and utilizes the social context information for detection. Extensive experiments evaluate the superiority of the proposed method and provide detailed comparisons of different methods and modalities for future works.


title: Investigating the Cybersecurity of Smart Grids Based on Cyber-Physical Twin Approach

abstract: While the increasing penetration of information and communication technology into distribution grid brings numerous benefits, it also opens up a new threat landscape, particularly through cyberattacks. To provide a basis for countermeasures against such threats, this paper addresses the investigation of the impact and manifestations of cyberattacks on smart grids by replicating the power grid in a secure, isolated, and controlled laboratory environment as a cyber-physical twin. Currently, detecting intrusions by unauthorized third parties into the central monitoring and control system of grid operators, especially attacks within the grid perimeter, is a major challenge. The development and validation of methods to detect and prevent coordinated and timed attacks on electric power systems depends not only on the availability and quality of data from such attack scenarios, but also on suitable realistic investigation environments. However, to create a comprehensive investigation environment, a realistic representation of the study object is required to thoroughly investigate critical cyberattacks on grid operations and evaluate their impact on the power grid using real data. In this paper, we demonstrate our cyber-physical twin approach using a microgrid in the context of a cyberattack case study.


title: Yang-Lee Zeros, Semicircle Theorem, and Nonunitary Criticality in Bardeen-Cooper-Schrieffer Superconductivity

abstract: Yang and Lee investigated phase transitions in terms of zeros of partition functions, namely, Yang-Lee zeros [Phys. Rev. 87, 404 (1952); Phys. Rev. 87, 410 (1952)]. We show that the essential singularity in the superconducting gap is directly related to the number of roots of the partition function of a BCS superconductor. Those zeros are found to be distributed on a semicircle in the complex plane of the interaction strength due to the Fermi-surface instability. A renormalization-group analysis shows that the semicircle theorem holds for a generic quantum many-body system with a marginal coupling, in sharp contrast with the Lee-Yang circle theorem for the Ising spin system. This indicates that the geometry of Yang-Lee zeros is directly connected to the Fermi-surface instability. Furthermore, we unveil the nonunitary criticality in BCS superconductivity that emerges at each individual Yang-Lee zero due to exceptional points and presents a universality class distinct from that of the conventional Yang-Lee edge singularity.


title: Federated deep transfer learning for EEG decoding using multiple BCI tasks

abstract: Deep learning has been successful in BCI decoding. However, it is very data-hungry and requires pooling data from multiple sources. EEG data from various sources decrease the decoding performance due to negative transfer. Recently, transfer learning for EEG decoding has been suggested as a remedy and become subject to recent BCI competitions (e.g. BEETL), but there are two complications in combining data from many subjects. First, privacy is not protected as highly personal brain data needs to be shared (and copied across increasingly tight information governance boundaries). Moreover, BCI data are collected from different sources and are often based on different BCI tasks, which has been thought to limit their reusability. Here, we demonstrate a federated deep transfer learning technique, the Multi-dataset Federated Separate-Common-Separate Network (MF-SCSN) based on our previous work of SCSN, which integrates privacy-preserving properties into deep transfer learning to utilise data sets with different tasks. This framework trains a BCI decoder using different source data sets obtained from different imagery tasks (e.g. some data sets with hands and feet, vs others with single hands and tongue, etc). Therefore, by introducing privacy-preserving transfer learning techniques, we unlock the reusability and scalability of existing BCI data sets. We evaluated our federated transfer learning method on the NeurIPS 2021 BEETL competition BCI task. The proposed architecture outperformed the baseline decoder by 3%. Moreover, compared with the baseline and other transfer learning algorithms, our method protects the privacy of the brain data from different data centres.


title: Cyclic sets from ribbon string links

abstract: In this paper, we first endow the set of ribbon string links (up to isotopy) with a structure of a cyclic and of a cocyclic set. Next, we relate these (co)cyclic sets with those associated with the coend of a ribbon category. The relationship is given by the universal quantum invariants \`a la Reshetikhin-Turaev.


title: On the limit of the sequence $\left\{ C^m(D) \right\}_{m=1}^{\infty}$ for a multipartite tournament $D$

abstract: For an integer $k \ge 2$, let $A$ be a Boolean block matrix with blocks $A_{ij}$ for $1 \le i,j \le k$ such that $A_{ii}$ is a zero matrix and $A_{ij}+A_{ji}^T$ is a matrix with all elements $1$ but not both corresponding elements of $A_{ij}$ and $A_{ji}^T$ equal to $1$ for $i \neq j$. Jung~{\em et al.} [Competition periods of multipartite tournaments. {\it Linear and Multilinear Algebra}, https://doi.org/10.1080/03081087.2022.2038057] studied the matrix sequence $\{A^m(A^T)^m\}_{m=1}^{\infty}$. This paper, which is a natural extension of the above paper and was initiated by the observation that $\{A^m(A^T)^m\}_{m=1}^{\infty}$ converges if $A$ has no zero rows, computes the limit of the matrix sequence $\{A^m(A^T)^m\}_{m=1}^{\infty}$ if $A$ has no zero rows. To this end, we take a graph theoretical approach: noting that $A$ is the adjacency matrix of a multipartite tournament $D$, we compute the limit of the graph sequence $\left\{ C^m(D) \right\}_{m=1}^{\infty}$ when $D$ has no sinks.


title: A Hybrid Multi-GPU Implementation of Simplex Algorithm with CPU Collaboration

abstract: The simplex algorithm has been successfully used for many years in solving linear programming (LP) problems. Due to the intensive computations required (especially for the solution of large LP problems), parallel approaches have also extensively been studied. The computational power provided by the modern GPUs as well as the rapid development of multicore CPU systems have led OpenMP and CUDA programming models to the top preferences during the last years. However, the desired efficient collaboration between CPU and GPU through the combined use of the above programming models is still considered a hard research problem. In the above context, we demonstrate here an excessively efficient implementation of standard simplex, targeting to the best possible exploitation of the concurrent use of all the computing resources, on a multicore platform with multiple CUDA-enabled GPUs. More concretely, we present a novel hybrid collaboration scheme which is based on the concurrent execution of suitably spread CPU-assigned (via multithreading) and GPU-offloaded computations. The experimental results extracted through the cooperative use of OpenMP and CUDA over a notably powerful modern hybrid platform (consisting of 32 cores and two high-spec GPUs, Titan Rtx and Rtx 2080Ti) highlight that the performance of the presented here hybrid GPU/CPU collaboration scheme is clearly superior to the GPU-only implementation under almost all conditions. The corresponding measurements validate the value of using all resources concurrently, even in the case of a multi-GPU configuration platform. Furthermore, the given implementations are completely comparable (and slightly superior in most cases) to other related attempts in the bibliography, and clearly superior to the native CPU-implementation with 32 cores.


title: Quantum Fluids of Light

abstract: In this Chapter, we give a brief review of the state of the art of theoretical and experimental studies of quantum fluids of light. Such systems consist of ensembles of photons that acquire a finite mass from spatial confinement or diffraction and finite binary interactions from the optical nonlinearity of the optical medium. The peculiar properties of these fluids are highlighted in comparison with standard condensed matter systems, with a special emphasis on the novel possibilities that they offer for the generation, the manipulation and the diagnostics of the fluid, as well as on their intrinsically non-equilibrium and/or dynamical nature. Perspectives towards a new generation of experiments on strongly correlated fluids of light and towards opto-electronic applications are finally sketched.


title: Real-time Local Feature with Global Visual Information Enhancement

abstract: Local feature provides compact and invariant image representation for various visual tasks. Current deep learning-based local feature algorithms always utilize convolution neural network (CNN) architecture with limited receptive field. Besides, even with high-performance GPU devices, the computational efficiency of local features cannot be satisfactory. In this paper, we tackle such problems by proposing a CNN-based local feature algorithm. The proposed method introduces a global enhancement module to fuse global visual clues in a light-weight network, and then optimizes the network by novel deep reinforcement learning scheme from the perspective of local feature matching task. Experiments on the public benchmarks demonstrate that the proposal can achieve considerable robustness against visual interference and meanwhile run in real time.


title: The saturation number of monomial ideals

abstract: Let $S=\mathbb{K}[x_1,\ldots, x_n]$ be the polynomial ring over a field $\mathbb{K}$ and $\mathfrak{m}= (x_1, \ldots, x_n)$ be the irredundant maximal ideal of $S$. For an ideal $I \subset S$, let $\mathrm{sat}(I)$ be the minimum number $k$ for which $I \colon \mathfrak{m}^k = I \colon \mathfrak{m}^{k+1}$. In this paper, we compute the saturation number of irreducible monomial ideals and their powers. We apply this result to find the saturation number of the ordinary powers and symbolic powers of some families of monomial ideals in terms of the saturation number of irreducible components appearing in an irreducible decomposition of these ideals. Moreover, we give an explicit formula for the saturation number of monomial ideals in two variables.


title: Electroconvective flow in presence of polyethylene glycol oligomer additives

abstract: Metal electrodeposition in batteries is fundamentally unstable and affected by different instabilities depending on operating conditions and chemical composition. Particularly at high charging rates, a hydrodynamic instability called electroconvection sets in that aggravates the situation by creating non-uniform ion flux and preferential deposition at the electrode. Here, we experimentally investigate how oligomer additives interact with the hydrodynamic instability at a cation selective interface. From electrochemical measurements and direct visualization experiments, we find that electroconvection is delayed and suppressed at all voltage in the presence of oligomers. Our results also reveal that it is important to consider the role of polymers at the interface, in addition to their bulk effects, to understand the stabilization effect and its mechanism.


title: DAQE: Enhancing the Quality of Compressed Images by Exploiting the Inherent Characteristic of Defocus

abstract: Image defocus is inherent in the physics of image formation caused by the optical aberration of lenses, providing plentiful information on image quality. Unfortunately, existing quality enhancement approaches for compressed images neglect the inherent characteristic of defocus, resulting in inferior performance. This paper finds that in compressed images, significantly defocused regions have better compression quality, and two regions with different defocus values possess diverse texture patterns. These observations motivate our defocus-aware quality enhancement (DAQE) approach. Specifically, we propose a novel dynamic region-based deep learning architecture of the DAQE approach, which considers the regionwise defocus difference of compressed images in two aspects. (1) The DAQE approach employs fewer computational resources to enhance the quality of significantly defocused regions and more resources to enhance the quality of other regions; (2) The DAQE approach learns to separately enhance diverse texture patterns for regions with different defocus values, such that texture-specific enhancement can be achieved. Extensive experiments validate the superiority of our DAQE approach over state-of-the-art approaches in terms of quality enhancement and resource savings.


title: The quadratic Artin conductor of a motivic spectrum

abstract: Given a motivic spectrum $K$ over a smooth proper scheme which is dualizable over an open subscheme, we define its quadratic Artin conductor under some assumptions, and prove a formula relating the quadratic Euler characteristic of $K$, the rank of $K$ and the quadratic Artin conductor. As a consequence, we obtain a quadratic refinement of the classical Grothendieck-Ogg-Shafarevich formula.


title: UnifiedABSA: A Unified ABSA Framework Based on Multi-task Instruction Tuning

abstract: Aspect-Based Sentiment Analysis (ABSA) aims to provide fine-grained aspect-level sentiment information. There are many ABSA tasks, and the current dominant paradigm is to train task-specific models for each task. However, application scenarios of ABSA tasks are often diverse. This solution usually requires a large amount of labeled data from each task to perform excellently. These dedicated models are separately trained and separately predicted, ignoring the relationship between tasks. To tackle these issues, we present UnifiedABSA, a general-purpose ABSA framework based on multi-task instruction tuning, which can uniformly model various tasks and capture the inter-task dependency with multi-task learning. Extensive experiments on two benchmark datasets show that UnifiedABSA can significantly outperform dedicated models on 11 ABSA tasks and show its superiority in terms of data efficiency.


title: Finding active galactic nuclei through Fink

abstract: We present the Active Galactic Nuclei (AGN) classifier as currently implemented within the Fink broker. Features were built upon summary statistics of available photometric points, as well as color estimation enabled by symbolic regression. The learning stage includes an active learning loop, used to build an optimized training sample from labels reported in astronomical catalogs. Using this method to classify real alerts from the Zwicky Transient Facility (ZTF), we achieved 98.0% accuracy, 93.8% precision and 88.5% recall. We also describe the modifications necessary to enable processing data from the upcoming Vera C. Rubin Observatory Large Survey of Space and Time (LSST), and apply them to the training sample of the Extended LSST Astronomical Time-series Classification Challenge (ELAsTiCC). Results show that our designed feature space enables high performances of traditional machine learning algorithms in this binary classification task.


title: New one-parametric extension of the Starobinsky inflationary model

abstract: We propose a one-parametric extension of the Starobinsky $R+R^2$ model by adding the $(R+m^2\beta^2)^{3/2}$ term. The parameter $m$ is the inflaton mass, which is determined in the same way as in the Starobinsky model, and $\beta$ is a dimensionless constant. Using the Einstein frame and the scalar field potential, we get the inflationary parameters of the model proposed. The value of the tensor-to-scalar ratio $r$ can be significantly larger than in the Starobinsky model. The considered inflationary model is in a good agreement with the current observational data. The corresponding scalar field potential is a polynomial of the exponential function.


title: Long-distance propagation of high-velocity antiferromagnetic spin waves

abstract: We report on coherent propagation of antiferromagnetic (AFM) spin waves over a long distance ($\sim$10 $\mu$m) at room temperature in a canted AFM $\alpha$-Fe$_2$O$_3$ with the Dzyaloshinskii-Moriya interaction (DMI). Unprecedented high group velocities (up to 22.5 km/s) are characterized by microwave transmission using all-electrical spin wave spectroscopy. We derive analytically AFM spin-wave dispersion in the presence of the DMI which accounts for our experimental results. The AFM spin waves excited by nanometric coplanar waveguides with large wavevectors enter the exchange regime and follow a quasi-linear dispersion relation. Fitting of experimental data with our theoretical model yields an AFM exchange stiffness length of 1.7 angstrom. Our results provide key insights on AFM spin dynamics and demonstrate high-speed functionality for AFM magnonics.


title: Enhancing Intra-class Information Extraction for Heterophilous Graphs: One Neural Architecture Search Approach

abstract: In recent years, Graph Neural Networks (GNNs) have been popular in graph representation learning which assumes the homophily property, i.e., the connected nodes have the same label or have similar features. However, they may fail to generalize into the heterophilous graphs which in the low/medium level of homophily. Existing methods tend to address this problem by enhancing the intra-class information extraction, i.e., either by designing better GNNs to improve the model effectiveness, or re-designing the graph structures to incorporate more potential intra-class nodes from distant hops. Despite the success, we observe two aspects that can be further improved: (a) enhancing the ego feature information extraction from node itself which is more reliable in extracting the intra-class information; (b) designing node-wise GNNs can better adapt to the nodes with different homophily ratios. In this paper, we propose a novel method IIE-GNN (Intra-class Information Enhanced Graph Neural Networks) to achieve two improvements. A unified framework is proposed based on the literature, in which the intra-class information from the node itself and neighbors can be extracted based on seven carefully designed blocks. With the help of neural architecture search (NAS), we propose a novel search space based on the framework, and then provide an architecture predictor to design GNNs for each node. We further conduct experiments to show that IIE-GNN can improve the model performance by designing node-wise GNNs to enhance intra-class information extraction.


title: Modeling Fine-grained Information via Knowledge-aware Hierarchical Graph for Zero-shot Entity Retrieval

abstract: Zero-shot entity retrieval, aiming to link mentions to candidate entities under the zero-shot setting, is vital for many tasks in Natural Language Processing. Most existing methods represent mentions/entities via the sentence embeddings of corresponding context from the Pre-trained Language Model. However, we argue that such coarse-grained sentence embeddings can not fully model the mentions/entities, especially when the attention scores towards mentions/entities are relatively low. In this work, we propose GER, a \textbf{G}raph enhanced \textbf{E}ntity \textbf{R}etrieval framework, to capture more fine-grained information as complementary to sentence embeddings. We extract the knowledge units from the corresponding context and then construct a mention/entity centralized graph. Hence, we can learn the fine-grained information about mention/entity by aggregating information from these knowledge units. To avoid the graph information bottleneck for the central mention/entity node, we construct a hierarchical graph and design a novel Hierarchical Graph Attention Network~(HGAN). Experimental results on popular benchmarks demonstrate that our proposed GER framework performs better than previous state-of-the-art models. The code has been available at https://github.com/wutaiqiang/GER-WSDM2023.


title: How to Describe Images in a More Funny Way? Towards a Modular Approach to Cross-Modal Sarcasm Generation

abstract: Sarcasm generation has been investigated in previous studies by considering it as a text-to-text generation problem, i.e., generating a sarcastic sentence for an input sentence. In this paper, we study a new problem of cross-modal sarcasm generation (CMSG), i.e., generating a sarcastic description for a given image. CMSG is challenging as models need to satisfy the characteristics of sarcasm, as well as the correlation between different modalities. In addition, there should be some inconsistency between the two modalities, which requires imagination. Moreover, high-quality training data is insufficient. To address these problems, we take a step toward generating sarcastic descriptions from images without paired training data and propose an Extraction-Generation-Ranking based Modular method (EGRM) for cross-model sarcasm generation. Specifically, EGRM first extracts diverse information from an image at different levels and uses the obtained image tags, sentimental descriptive caption, and commonsense-based consequence to generate candidate sarcastic texts. Then, a comprehensive ranking algorithm, which considers image-text relation, sarcasticness, and grammaticality, is proposed to select a final text from the candidate texts. Human evaluation at five criteria on a total of 1200 generated image-text pairs from eight systems and auxiliary automatic evaluation show the superiority of our method.


title: Singular Lagrangian torus fibrations on the smoothing of algebraic cones

abstract: Given a lattice polytope $Q\subset \mathbb{R}^n$, we can consider the cone $\sigma=C(Q)=\{\lambda(q,1)\in \mathbb{R}^{n+1}|\lambda \in \mathbb{R}_{\geq0}, q\in Q\} \subset \mathbb{R}^{n+1}$, and the affine toric variety $Y_{\sigma}$ associated to $\sigma$. Altmann showed that the versal deformation space of $Y_\sigma$ can be described by the Minkowski decomposition of the polytope $Q$. Under some conditions on $Q$, we can obtain a smooth deformation $Y_\epsilon$ of $Y_\sigma$ using Altmann's result. In this article, we consider $Y_\epsilon$ inside some $\mathbb{C}^N$ and construct a complex fibration on $Y_\epsilon$, with general fibre $(\mathbb{C}^*)^n$ and finite singular fibres described using global coordinates related to the components of the Minkowski decomposition. We construct a singular Lagrangian torus fibration out of the complex fibration. This singular fibration admits a convex base diagram representation with cuts as a natural generalization of base diagrams described by Symington for Almost Toric Fibrations ($\dim=4$). In particular, we obtain a convex base diagram whose image is the dual cone of $C(Q)$. There is a 1-parameter family of monotone Lagrangian tori in each of these fibrations. Using the wall-crossing formula, we describe the potential associated with this family in terms of the Minkowski decomposition of $Q$, recovering the result of Lau, and discuss non-displaceability. We also discuss some other consequences of our results.


title: DesNet: Decomposed Scale-Consistent Network for Unsupervised Depth Completion

abstract: Unsupervised depth completion aims to recover dense depth from the sparse one without using the ground-truth annotation. Although depth measurement obtained from LiDAR is usually sparse, it contains valid and real distance information, i.e., scale-consistent absolute depth values. Meanwhile, scale-agnostic counterparts seek to estimate relative depth and have achieved impressive performance. To leverage both the inherent characteristics, we thus suggest to model scale-consistent depth upon unsupervised scale-agnostic frameworks. Specifically, we propose the decomposed scale-consistent learning (DSCL) strategy, which disintegrates the absolute depth into relative depth prediction and global scale estimation, contributing to individual learning benefits. But unfortunately, most existing unsupervised scale-agnostic frameworks heavily suffer from depth holes due to the extremely sparse depth input and weak supervised signal. To tackle this issue, we introduce the global depth guidance (GDG) module, which attentively propagates dense depth reference into the sparse target via novel dense-to-sparse attention. Extensive experiments show the superiority of our method on outdoor KITTI benchmark, ranking 1st and outperforming the best KBNet more than 12% in RMSE. In addition, our approach achieves state-of-the-art performance on indoor NYUv2 dataset.


title: Distinctive Self-Similar Object Detection

abstract: Deep learning-based object detection has demonstrated a significant presence in the practical applications of artificial intelligence. However, objects such as fire and smoke, pose challenges to object detection because of their non-solid and various shapes, and consequently difficult to truly meet requirements in practical fire prevention and control. In this paper, we propose that the distinctive fractal feature of self-similar in fire and smoke can relieve us from struggling with their various shapes. To our best knowledge, we are the first to discuss this problem. In order to evaluate the self-similarity of the fire and smoke and improve the precision of object detection, we design a semi-supervised method that use Hausdorff distance to describe the resemblance between instances. Besides, based on the concept of self-similar, we have devised a novel methodology for evaluating this particular task in a more equitable manner. We have meticulously designed our network architecture based on well-established and representative baseline networks such as YOLO and Faster R-CNN. Our experiments have been conducted on publicly available fire and smoke detection datasets, which we have thoroughly verified to ensure the validity of our approach. As a result, we have observed significant improvements in the detection accuracy.


title: MINTIME: Multi-Identity Size-Invariant Video Deepfake Detection

abstract: In this paper, we introduce MINTIME, a video deepfake detection approach that captures spatial and temporal anomalies and handles instances of multiple people in the same video and variations in face sizes. Previous approaches disregard such information either by using simple a-posteriori aggregation schemes, i.e., average or max operation, or using only one identity for the inference, i.e., the largest one. On the contrary, the proposed approach builds on a Spatio-Temporal TimeSformer combined with a Convolutional Neural Network backbone to capture spatio-temporal anomalies from the face sequences of multiple identities depicted in a video. This is achieved through an Identity-aware Attention mechanism that attends to each face sequence independently based on a masking operation and facilitates video-level aggregation. In addition, two novel embeddings are employed: (i) the Temporal Coherent Positional Embedding that encodes each face sequence's temporal information and (ii) the Size Embedding that encodes the size of the faces as a ratio to the video frame size. These extensions allow our system to adapt particularly well in the wild by learning how to aggregate information of multiple identities, which is usually disregarded by other methods in the literature. It achieves state-of-the-art results on the ForgeryNet dataset with an improvement of up to 14% AUC in videos containing multiple people and demonstrates ample generalization capabilities in cross-forgery and cross-dataset settings. The code is publicly available at https://github.com/davide-coccomini/MINTIME-Multi-Identity-size-iNvariant-TIMEsformer-for-Video-Deepfake-Detection.


title: Embracing Ambiguity: Improving Similarity-oriented Tasks with Contextual Synonym Knowledge

abstract: Contextual synonym knowledge is crucial for those similarity-oriented tasks whose core challenge lies in capturing semantic similarity between entities in their contexts, such as entity linking and entity matching. However, most Pre-trained Language Models (PLMs) lack synonym knowledge due to inherent limitations of their pre-training objectives such as masked language modeling (MLM). Existing works which inject synonym knowledge into PLMs often suffer from two severe problems: (i) Neglecting the ambiguity of synonyms, and (ii) Undermining semantic understanding of original PLMs, which is caused by inconsistency between the exact semantic similarity of the synonyms and the broad conceptual relevance learned from the original corpus. To address these issues, we propose PICSO, a flexible framework that supports the injection of contextual synonym knowledge from multiple domains into PLMs via a novel entity-aware Adapter which focuses on the semantics of the entities (synonyms) in the contexts. Meanwhile, PICSO stores the synonym knowledge in additional parameters of the Adapter structure, which prevents it from corrupting the semantic understanding of the original PLM. Extensive experiments demonstrate that PICSO can dramatically outperform the original PLMs and the other knowledge and synonym injection models on four different similarity-oriented tasks. In addition, experiments on GLUE prove that PICSO also benefits general natural language understanding tasks. Codes and data will be public.


title: Magnetostatic response and field-controlled haloing in binary superparamagnetic mixtures

abstract: Nowadays, magnetoresponsive soft materials, based not simply on magnetic nanoparticles, but rather on multiple components with distinct sizes and magnetic properties, both in liquid and polymeric carriers, are becoming more and more wide-spread due to their unique and versatile macroscopic response to an applied magnetic field. The variability of the latter is related to a complex interplay of the magnetic interactions in a highly non-uniform internal fields caused by spatial inhomogeneity in multicomponent systems. In this work, we present a combine analytical and simulation study of binary superparamagnetic systems, containing nanoclusters and dispersed single-domain nanoparticles, both in liquid and solid carrier matrices. We investigate the equilibrium magnetic response of these systems in wide ranges of concentrations and interaction energies. It turns out that, while the magnetisation of a binary solid can be both above and below that of an ideal superparamagnetic gas, depending on the concentration of the dispersed phase and the interparticle interactions, the system in a liquid carrier is highly magnetically responsive. In liquid, a spatial redistribution of the initially homogeneously dispersed phase in the vicinity of the nanocluster is observed -- the effect that is reminiscent of the so-called ``haloing'' effect previously observed experimentally on micro- and milli-scales.


title: LA-VocE: Low-SNR Audio-visual Speech Enhancement using Neural Vocoders

abstract: Audio-visual speech enhancement aims to extract clean speech from a noisy environment by leveraging not only the audio itself but also the target speaker's lip movements. This approach has been shown to yield improvements over audio-only speech enhancement, particularly for the removal of interfering speech. Despite recent advances in speech synthesis, most audio-visual approaches continue to use spectral mapping/masking to reproduce the clean audio, often resulting in visual backbones added to existing speech enhancement architectures. In this work, we propose LA-VocE, a new two-stage approach that predicts mel-spectrograms from noisy audio-visual speech via a transformer-based architecture, and then converts them into waveform audio using a neural vocoder (HiFi-GAN). We train and evaluate our framework on thousands of speakers and 11+ different languages, and study our model's ability to adapt to different levels of background noise and speech interference. Our experiments show that LA-VocE outperforms existing methods according to multiple metrics, particularly under very noisy scenarios.


title: Topological Distance Games

abstract: We introduce a class of strategic games in which agents are assigned to nodes of a topology graph and the utility of an agent depends on both the agent's inherent utilities for other agents as well as her distance from these agents on the topology graph. This model of topological distance games (TDGs) offers an appealing combination of important aspects of several prominent settings in coalition formation, including (additively separable) hedonic games, social distance games, and Schelling games. We study the existence and complexity of stable outcomes in TDGs -- for instance, while a jump stable assignment may not exist in general, we show that the existence is guaranteed in several special cases. We also investigate the dynamics induced by performing beneficial jumps.


title: F2SD: A dataset for end-to-end group detection algorithms

abstract: The lack of large-scale datasets has been impeding the advance of deep learning approaches to the problem of F-formation detection. Moreover, most research works on this problem rely on input sensor signals of object location and orientation rather than image signals. To address this, we develop a new, large-scale dataset of simulated images for F-formation detection, called F-formation Simulation Dataset (F2SD). F2SD contains nearly 60,000 images simulated from GTA-5, with bounding boxes and orientation information on images, making it useful for a wide variety of modelling approaches. It is also closer to practical scenarios, where three-dimensional location and orientation information are costly to record. It is challenging to construct such a large-scale simulated dataset while keeping it realistic. Furthermore, the available research utilizes conventional methods to detect groups. They do not detect groups directly from the image. In this work, we propose (1) a large-scale simulation dataset F2SD and a pipeline for F-formation simulation, (2) a first-ever end-to-end baseline model for the task, and experiments on our simulation dataset.


title: Spin-wave spectra in antidot lattice with inhomogeneous perpendicular magnetocrystalline anisotropy

abstract: Magnonic crystals are structures with periodically varied magnetic properties that are used to control collective spin-wave excitations. With micromagnetic simulations, we study spin-wave spectra in a 2D antidot lattice based on a multilayered thin film with perpendicular magnetic anisotropy (PMA). We show that the modification of the PMA near the antidot edges introduces interesting modifications to the spin-wave spectra, even in a fully saturated state. In particular, the spectra split in two types of excitations, bulk modes with amplitude concentrated in a homogeneous part of antidot lattice, and edge modes with an amplitude localized in the rims of reduced PMA at the antidot edges. Their dependence on the geometrical or material parameters is distinct but at resonance conditions fulfilled, we found strong hybridization between bulk and radial edge modes. Interestingly, the hybridization between the fundamental modes in bulk and rim is of magnetostatic origin but the exchange interactions determine the coupling between higher-order radial rim modes and the fundamental bulk mode of the antidot lattice.


title: Unadjusted Hamiltonian MCMC with Stratified Monte Carlo Time Integration

abstract: A novel randomized time integrator is suggested for unadjusted Hamiltonian Monte Carlo (uHMC) in place of the usual Verlet integrator; namely, a stratified Monte Carlo (sMC) integrator which involves a minor modification to Verlet, and hence, is easy to implement. For target distributions of the form $\mu(dx) \propto e^{-U(x)} dx$ where $U: \mathbb{R}^d \to \mathbb{R}_{\ge 0}$ is both $K$-strongly convex and $L$-gradient Lipschitz, and initial distributions $\nu$ with finite second moment, coupling proofs reveal that an $\varepsilon$-accurate approximation of the target distribution $\mu$ in $L^2$-Wasserstein distance $\boldsymbol{\mathcal{W}}^2$ can be achieved by the uHMC algorithm with sMC time integration using $O\left((d/K)^{1/3} (L/K)^{5/3} \varepsilon^{-2/3} \log( \boldsymbol{\mathcal{W}}^2(\mu, \nu) / \varepsilon)^+\right)$ gradient evaluations; whereas without additional assumptions the corresponding complexity of the uHMC algorithm with Verlet time integration is in general $O\left((d/K)^{1/2} (L/K)^2 \varepsilon^{-1} \log( \boldsymbol{\mathcal{W}}^2(\mu, \nu) / \varepsilon)^+ \right)$. Duration randomization, which has a similar effect as partial momentum refreshment, is also treated. In this case, without additional assumptions on the target distribution, the complexity of duration-randomized uHMC with sMC time integration improves to $O\left(\max\left((d/K)^{1/4} (L/K)^{3/2} \varepsilon^{-1/2},(d/K)^{1/3} (L/K)^{4/3} \varepsilon^{-2/3} \right) \right)$ up to logarithmic factors. The improvement due to duration randomization turns out to be analogous to that of time integrator randomization.

categories: math.PR cs.NA math.NA math.ST stat.CO stat.ML stat.TH


title: Minimizing the Accumulated Trajectory Error to Improve Dataset Distillation

abstract: Model-based deep learning has achieved astounding successes due in part to the availability of large-scale real-world data. However, processing such massive amounts of data comes at a considerable cost in terms of computations, storage, training and the search for good neural architectures. Dataset distillation has thus recently come to the fore. This paradigm involves distilling information from large real-world datasets into tiny and compact synthetic datasets such that processing the latter ideally yields similar performances as the former. State-of-the-art methods primarily rely on learning the synthetic dataset by matching the gradients obtained during training between the real and synthetic data. However, these gradient-matching methods suffer from the so-called accumulated trajectory error caused by the discrepancy between the distillation and subsequent evaluation. To mitigate the adverse impact of this accumulated trajectory error, we propose a novel approach that encourages the optimization algorithm to seek a flat trajectory. We show that the weights trained on synthetic data are robust against the accumulated errors perturbations with the regularization towards the flat trajectory. Our method, called Flat Trajectory Distillation (FTD), is shown to boost the performance of gradient-matching methods by up to 4.7% on a subset of images of the ImageNet dataset with higher resolution images. We also validate the effectiveness and generalizability of our method with datasets of different resolutions and demonstrate its applicability to neural architecture search. Code is available at https://github.com/AngusDujw/FTD-distillation.


title: Double Multiple-Relaxation-Time model of Lattice-Boltzmann Magnetohydrodynamics at Low Magnetic Reynolds Numbers

abstract: We develop an improved lattice-Boltzmann numerical scheme to solve magnetohydrodynamic (MHD) equations in the regime of low magnetic Reynolds numbers, grounded on a manifestly Galilean covariant modeling of the Navier-Stokes equations. The simulation of the magnetic induction equation within the lattice-Boltzmann approach to MHD has been usually devised along the lines of the simplest phenomenological description, the single relaxation time (SRT) model. In order to deal with well-known stability difficulties of the SRT framework, we introduce, alternatively, a multi-relaxation-time technique for the solution of the magnetic induction equation, combined with a novel boundary condition method to cope with the subtleties of magnetic Boltzmann-like distributions on curved boundaries. As an application, we investigate open issues related to the description of transient flow regimes in MHD pipe flows, subject to non-uniform magnetic fields.


title: Regularity of solutions to the Muskat equation

abstract: In this paper, we show that if a solution to the Muskat problem in the case of different densities and the same viscosity is sufficiently smooth, then it must be analytic except at the points where a turnover of the fluids happens.


title: Anomalous dimension of transverse momentum broadening in planar $\mathcal{N}=4$ SYM

abstract: The typical transverse momentum $Q_s(t)$ (or "saturation" momentum) acquired by a hard particle propagating through a $\mathcal{N}=4$ SYM plasma increases over time like $t^\gamma$, with an anomalous exponent $\gamma>1/2$ characteristic of super-diffusion. This anomalous exponent is a function of the 't Hooft coupling $\lambda=g^2N_c$. Recently, a method has been proposed to systematically compute the perturbative series of $\gamma(\lambda)$ at weak coupling. This method relies on the traveling wave interpretation of the time evolution of $Q_s(t)$ and on the dominance of soft-collinear radiative corrections at large times. In this paper, we compute $\gamma(\lambda)$ up to $\mathcal{O}(\lambda^{2})$ using the double logarithmic behaviour of the BFKL equation in planar $\mathcal{N}=4$ SYM at three loops. This calculation allows us to discuss the transition towards the strong coupling regime where AdS/CFT calculations predict $\gamma\to 1$.