title: Episodic Logit-Q Dynamics for Efficient Learning in Stochastic Teams

abstract: We present new learning dynamics combining (independent) log-linear learning and value iteration for stochastic games within the auxiliary stage game framework. The dynamics presented provably attain the efficient equilibrium (also known as optimal equilibrium) in identical-interest stochastic games, beyond the recent concentration of progress on provable convergence to some (possibly inefficient) equilibrium. The dynamics are also independent in the sense that agents take actions consistent with their local viewpoint to a reasonable extent rather than seeking equilibrium. These aspects can be of practical interest in the control applications of intelligent and autonomous systems. The key challenges are the convergence to an inefficient equilibrium and the non-stationarity of the environment from a single agent's viewpoint due to the adaptation of others. The log-linear update plays an important role in addressing the former. We address the latter through the play-in-episodes scheme in which the agents update their Q-function estimates only at the end of the episodes.


title: Task-Customized Self-Supervised Pre-training with Scalable Dynamic Routing

abstract: Self-supervised learning (SSL), especially contrastive methods, has raised attraction recently as it learns effective transferable representations without semantic annotations. A common practice for self-supervised pre-training is to use as much data as possible. For a specific downstream task, however, involving irrelevant data in pre-training may degenerate the downstream performance, observed from our extensive experiments. On the other hand, for existing SSL methods, it is burdensome and infeasible to use different downstream-task-customized datasets in pre-training for different tasks. To address this issue, we propose a novel SSL paradigm called Scalable Dynamic Routing (SDR), which can be trained once and deployed efficiently to different downstream tasks with task-customized pre-trained models. Specifically, we construct the SDRnet with various sub-nets and train each sub-net with only one subset of the data by data-aware progressive training. When a downstream task arrives, we route among all the pre-trained sub-nets to get the best along with its corresponding weights. Experiment results show that our SDR can train 256 sub-nets on ImageNet simultaneously, which provides better transfer performance than a unified model trained on the full ImageNet, achieving state-of-the-art (SOTA) averaged accuracy over 11 downstream classification tasks and AP on PASCAL VOC detection task.


title: MemeTector: Enforcing deep focus for meme detection

abstract: Image memes and specifically their widely-known variation image macros, is a special new media type that combines text with images and is used in social media to playfully or subtly express humour, irony, sarcasm and even hate. It is important to accurately retrieve image memes from social media to better capture the cultural and social aspects of online phenomena and detect potential issues (hate-speech, disinformation). Essentially, the background image of an image macro is a regular image easily recognized as such by humans but cumbersome for the machine to do so due to feature map similarity with the complete image macro. Hence, accumulating suitable feature maps in such cases can lead to deep understanding of the notion of image memes. To this end, we propose a methodology, called Visual Part Utilization, that utilizes the visual part of image memes as instances of the regular image class and the initial image memes as instances of the image meme class to force the model to concentrate on the critical parts that characterize an image meme. Additionally, we employ a trainable attention mechanism on top of a standard ViT architecture to enhance the model's ability to focus on these critical parts and make the predictions interpretable. Several training and test scenarios involving web-scraped regular images of controlled text presence are considered for evaluating the model in terms of robustness and accuracy. The findings indicate that light visual part utilization combined with sufficient text presence during training provides the best and most robust model, surpassing state of the art. Source code and dataset are available at https://github.com/mever-team/memetector.


title: The expected measurement precision of the branching ratio of the Higgs decaying to the di-photon at the CEPC

abstract: This paper presents the prospects of measuring $\sigma(e^{+}e^{-}\to ZH)\times Br(H \to \gamma\gamma)$ in 3 $Z$ decay channels $Z \to q\bar{q} / \mu^{+} \mu^{-} / \nu\bar{\nu}$ using the baseline detector with $\sqrt{s} = 240 GeV$ at the Circular Electron Positron Collider (CEPC) . The simulated Monte Carlo events are generated and scaled to an integrated luminosity of 5.6 $ab^{-1}$ to mimic the data. Extrapolated results to 20 $ab^{-1}$ are also shown. The expected statistical precision of this measurement after combining 3 channels of $Z$ boson decay is 7.7\%. With some preliminary estimation on the systematical uncertainties, the total precision is 7.9\%. The performance of CEPC electro-magnetic calorimeter (ECAL) is studied by smearing the photon energy resolution in simulated events in $e^{+}e^{-} \to ZH \to q\bar{q}\gamma\gamma$ channel. In present ECAL design, the stochastic term in resolution plays the dominant role in the precision of Higgs measurements in $H \to \gamma\gamma$ channel. The impact of the resolution on the measured precision of $\sigma(ZH)\times Br(ZH \to q\bar{q}\gamma\gamma)$ as well as the optimization of ECAL constant term and stochastic term are studied for the further detector design.


title: Computing homomorphisms in hereditary graph classes: the peculiar case of the 5-wheel and graphs with no long claws

abstract: For graphs $G$ and $H$, an $H$-coloring of $G$ is an edge-preserving mapping from $V(G)$ to $V(H)$. In the $H$-Coloring problem the graph $H$ is fixed and we ask whether an instance graph $G$ admits an $H$-coloring. A generalization of this problem is $H$-ColoringExt, where some vertices of $G$ are already mapped to vertices of $H$ and we ask if this partial mapping can be extended to an $H$-coloring. We study the complexity of variants of $H$-Coloring in $F$-free graphs, i.e., graphs excluding a fixed graph $F$ as an induced subgraph. For integers $a,b,c \geq 1$, by $S_{a,b,c}$ we denote the graph obtained by identifying one endvertex of three paths on $a+1$, $b+1$, and $c+1$ vertices, respectively. For odd $k \geq 5$, by $W_k$ we denote the graph obtained from the $k$-cycle by adding a universal vertex. As our main algorithmic result we show that $W_5$-ColoringExt is polynomial-time solvable in $S_{2,1,1}$-free graphs. This result exhibits an interesting non-monotonicity of $H$-ColoringExt with respect to taking induced subgraphs of $H$. Indeed, $W_5$ contains a triangle, and $K_3$-Coloring, i.e., classical 3-coloring, is NP-hard already in claw-free (i.e., $S_{1,1,1}$-free) graphs. Our algorithm is based on two main observations: 1. $W_5$-ColoringExt in $S_{2,1,1}$-free graphs can be in polynomial time reduced to a variant of the problem of finding an independent set intersecting all triangles, and 2. the latter problem can be solved in polynomial time in $S_{2,1,1}$-free graphs. We complement this algorithmic result with several negative ones. In particular, we show that $W_5$-ColoringExt is NP-hard in $S_{3,3,3}$-free graphs. This is again uncommon, as usually problems that are NP-hard in $S_{a,b,c}$-free graphs for some constant $a,b,c$ are already hard in claw-free graphs.


title: Unsupervised Multi-object Segmentation Using Attention and Soft-argmax

abstract: We introduce a new architecture for unsupervised object-centric representation learning and multi-object detection and segmentation, which uses a translation-equivariant attention mechanism to predict the coordinates of the objects present in the scene and to associate a feature vector to each object. A transformer encoder handles occlusions and redundant detections, and a convolutional autoencoder is in charge of background reconstruction. We show that this architecture significantly outperforms the state of the art on complex synthetic benchmarks.


title: FCN-Pose: A Pruned and Quantized CNN for Robot Pose Estimation for Constrained Devices

abstract: IoT devices suffer from resource limitations, such as processor, RAM, and disc storage. These limitations become more evident when handling demanding applications, such as deep learning, well-known for their heavy computational requirements. A case in point is robot pose estimation, an application that predicts the critical points of the desired image object. One way to mitigate processing and storage problems is compressing that deep learning application. This paper proposes a new CNN for the pose estimation while applying the compression techniques of pruning and quantization to reduce his demands and improve the response time. While the pruning process reduces the total number of parameters required for inference, quantization decreases the precision of the floating-point. We run the approach using a pose estimation task for a robotic arm and compare the results in a high-end device and a constrained device. As metrics, we consider the number of Floating-point Operations Per Second(FLOPS), the total of mathematical computations, the calculation of parameters, the inference time, and the number of video frames processed per second. In addition, we undertake a qualitative evaluation where we compare the output image predicted for each pruned network with the corresponding original one. We reduce the originally proposed network to a 70% pruning rate, implying an 88.86% reduction in parameters, 94.45% reduction in FLOPS, and for the disc storage, we reduced the requirement in 70% while increasing error by a mere $1\%$. With regard input image processing, this metric increases from 11.71 FPS to 41.9 FPS for the Desktop case. When using the constrained device, image processing augmented from 2.86 FPS to 10.04 FPS. The higher processing rate of image frames achieved by the proposed approach allows a much shorter response time.


title: Acute Lymphoblastic Leukemia Detection Using Hypercomplex-Valued Convolutional Neural Networks

abstract: This paper features convolutional neural networks defined on hypercomplex algebras applied to classify lymphocytes in blood smear digital microscopic images. Such classification is helpful for the diagnosis of acute lymphoblast leukemia (ALL), a type of blood cancer. We perform the classification task using eight hypercomplex-valued convolutional neural networks (HvCNNs) along with real-valued convolutional networks. Our results show that HvCNNs perform better than the real-valued model, showcasing higher accuracy with a much smaller number of parameters. Moreover, we found that HvCNNs based on Clifford algebras processing HSV-encoded images attained the highest observed accuracies. Precisely, our HvCNN yielded an average accuracy rate of 96.6% using the ALL-IDB2 dataset with a 50% train-test split, a value extremely close to the state-of-the-art models but using a much simpler architecture with significantly fewer parameters.


title: Evaluating Multimodal Interactive Agents

abstract: Creating agents that can interact naturally with humans is a common goal in artificial intelligence (AI) research. However, evaluating these interactions is challenging: collecting online human-agent interactions is slow and expensive, yet faster proxy metrics often do not correlate well with interactive evaluation. In this paper, we assess the merits of these existing evaluation metrics and present a novel approach to evaluation called the Standardised Test Suite (STS). The STS uses behavioural scenarios mined from real human interaction data. Agents see replayed scenario context, receive an instruction, and are then given control to complete the interaction offline. These agent continuations are recorded and sent to human annotators to mark as success or failure, and agents are ranked according to the proportion of continuations in which they succeed. The resulting STS is fast, controlled, interpretable, and representative of naturalistic interactions. Altogether, the STS consolidates much of what is desirable across many of our standard evaluation metrics, allowing us to accelerate research progress towards producing agents that can interact naturally with humans. A video may be found at https://youtu.be/YR1TngGORGQ.


title: Tailoring Optical Excitation to Control Magnetic Skyrmion Nucleation

abstract: In ferromagnetic multilayers, a single laser pulse with a fluence above an optical nucleation threshold can create magnetic skyrmions, which are randomly distributed over the area of the laser spot. However, in order to study the dynamics of skyrmions and for their application in future data technology, a controllable localization of the skyrmion nucleation sites is crucial. Here, it is demonstrated that patterned reflective masks behind a thin magnetic film can be designed to locally tailor the optical excitation amplitudes reached, leading to spatially controlled skyrmion nucleation on the nanometer scale. Using x-ray microscopy, the influence of nanopatterned back-side aluminum masks on the optical excitation is studied in two sample geometries with varying layer sequence of substrate and magnetic Co/Pt multilayer. Surprisingly, the masks' effect on suppressing or enhancing skymion nucleation reverses when changing this sequence. Moreover, optical near-field enhancements additionally affect the spatial arrangement of the nucleated skyrmions. Simulations of the spatial modulation of the laser excitation, and the following heat transfer across the interfaces in the two sample geometries are employed to explain these observations. The results demonstrate a reliable approach to add nanometer-scale spatial control to optically induced magnetization processes on ultrafast timescales.


title: Nonlocal Gravity: Modification of Newtonian Gravitational Force in the Solar System

abstract: Nonlocal gravity (NLG) is a classical nonlocal generalization of Einstein's theory of gravitation developed in close analogy with the nonlocal electrodynamics of media. It appears that the nonlocal aspect of the universal gravitational interaction could simulate dark matter. Within the Newtonian regime of NLG, we investigate the deviation of the gravitational force from the Newtonian inverse square law as a consequence of the existence of the effective dark matter. In particular, we work out the magnitude of this deviation in the solar system out to 100 astronomical units. Moreover, we give an improved lower limit for the short-range parameter of the reciprocal kernel of NLG.


title: VIDI: A Video Dataset of Incidents

abstract: Automatic detection of natural disasters and incidents has become more important as a tool for fast response. There have been many studies to detect incidents using still images and text. However, the number of approaches that exploit temporal information is rather limited. One of the main reasons for this is that a diverse video dataset with various incident types does not exist. To address this need, in this paper we present a video dataset, Video Dataset of Incidents, VIDI, that contains 4,534 video clips corresponding to 43 incident categories. Each incident class has around 100 videos with a duration of ten seconds on average. To increase diversity, the videos have been searched in several languages. To assess the performance of the recent state-of-the-art approaches, Vision Transformer and TimeSformer, as well as to explore the contribution of video-based information for incident classification, we performed benchmark experiments on the VIDI and Incidents Dataset. We have shown that the recent methods improve the incident classification accuracy. We have found that employing video data is very beneficial for the task. By using the video data, the top-1 accuracy is increased to 76.56% from 67.37%, which was obtained using a single frame. VIDI will be made publicly available. Additional materials can be found at the following link: https://github.com/vididataset/VIDI.


title: Semantic Segmentation for Thermal Images: A Comparative Survey

abstract: Semantic segmentation is a challenging task since it requires excessively more low-level spatial information of the image compared to other computer vision problems. The accuracy of pixel-level classification can be affected by many factors, such as imaging limitations and the ambiguity of object boundaries in an image. Conventional methods exploit three-channel RGB images captured in the visible spectrum with deep neural networks (DNN). Thermal images can significantly contribute during the segmentation since thermal imaging cameras are capable of capturing details despite the weather and illumination conditions. Using infrared spectrum in semantic segmentation has many real-world use cases, such as autonomous driving, medical imaging, agriculture, defense industry, etc. Due to this wide range of use cases, designing accurate semantic segmentation algorithms with the help of infrared spectrum is an important challenge. One approach is to use both visible and infrared spectrum images as inputs. These methods can accomplish higher accuracy due to enriched input information, with the cost of extra effort for the alignment and processing of multiple inputs. Another approach is to use only thermal images, enabling less hardware cost for smaller use cases. Even though there are multiple surveys on semantic segmentation methods, the literature lacks a comprehensive survey centered explicitly around semantic segmentation using infrared spectrum. This work aims to fill this gap by presenting algorithms in the literature and categorizing them by their input images.


title: Triangular Contrastive Learning on Molecular Graphs

abstract: Recent contrastive learning methods have shown to be effective in various tasks, learning generalizable representations invariant to data augmentation thereby leading to state of the art performances. Regarding the multifaceted nature of large unlabeled data used in self-supervised learning while majority of real-word downstream tasks use single format of data, a multimodal framework that can train single modality to learn diverse perspectives from other modalities is an important challenge. In this paper, we propose TriCL (Triangular Contrastive Learning), a universal framework for trimodal contrastive learning. TriCL takes advantage of Triangular Area Loss, a novel intermodal contrastive loss that learns the angular geometry of the embedding space through simultaneously contrasting the area of positive and negative triplets. Systematic observation on embedding space in terms of alignment and uniformity showed that Triangular Area Loss can address the line-collapsing problem by discriminating modalities by angle. Our experimental results also demonstrate the outperformance of TriCL on downstream task of molecular property prediction which implies that the advantages of the embedding space indeed benefits the performance on downstream tasks.


title: Objects Matter: Learning Object Relation Graph for Robust Camera Relocalization

abstract: Visual relocalization aims to estimate the pose of a camera from one or more images. In recent years deep learning based pose regression methods have attracted many attentions. They feature predicting the absolute poses without relying on any prior built maps or stored images, making the relocalization very efficient. However, robust relocalization under environments with complex appearance changes and real dynamics remains very challenging. In this paper, we propose to enhance the distinctiveness of the image features by extracting the deep relationship among objects. In particular, we extract objects in the image and construct a deep object relation graph (ORG) to incorporate the semantic connections and relative spatial clues of the objects. We integrate our ORG module into several popular pose regression models. Extensive experiments on various public indoor and outdoor datasets demonstrate that our method improves the performance significantly and outperforms the previous approaches.


title: Surround-view Fisheye Camera Perception for Automated Driving: Overview, Survey and Challenges

abstract: Surround-view fisheye cameras are commonly used for near-field sensing in automated driving. Four fisheye cameras on four sides of the vehicle are sufficient to cover 360{\deg} around the vehicle capturing the entire near-field region. Some primary use cases are automated parking, traffic jam assist, and urban driving. There are limited datasets and very little work on near-field perception tasks as the focus in automotive perception is on far-field perception. In contrast to far-field, surround-view perception poses additional challenges due to high precision object detection requirements of 10cm and partial visibility of objects. Due to the large radial distortion of fisheye cameras, standard algorithms cannot be extended easily to the surround-view use case. Thus, we are motivated to provide a self-contained reference for automotive fisheye camera perception for researchers and practitioners. Firstly, we provide a unified and taxonomic treatment of commonly used fisheye camera models. Secondly, we discuss various perception tasks and existing literature. Finally, we discuss the challenges and future direction.


title: On the Eigenvalues of Global Covariance Pooling for Fine-grained Visual Recognition

abstract: The Fine-Grained Visual Categorization (FGVC) is challenging because the subtle inter-class variations are difficult to be captured. One notable research line uses the Global Covariance Pooling (GCP) layer to learn powerful representations with second-order statistics, which can effectively model inter-class differences. In our previous conference paper, we show that truncating small eigenvalues of the GCP covariance can attain smoother gradient and improve the performance on large-scale benchmarks. However, on fine-grained datasets, truncating the small eigenvalues would make the model fail to converge. This observation contradicts the common assumption that the small eigenvalues merely correspond to the noisy and unimportant information. Consequently, ignoring them should have little influence on the performance. To diagnose this peculiar behavior, we propose two attribution methods whose visualizations demonstrate that the seemingly unimportant small eigenvalues are crucial as they are in charge of extracting the discriminative class-specific features. Inspired by this observation, we propose a network branch dedicated to magnifying the importance of small eigenvalues. Without introducing any additional parameters, this branch simply amplifies the small eigenvalues and achieves state-of-the-art performances of GCP methods on three fine-grained benchmarks. Furthermore, the performance is also competitive against other FGVC approaches on larger datasets. Code is available at \href{https://github.com/KingJamesSong/DifferentiableSVD}{https://github.com/KingJamesSong/DifferentiableSVD}.


title: Embedding Principle in Depth for the Loss Landscape Analysis of Deep Neural Networks

abstract: Understanding the relation between deep and shallow neural networks is extremely important for the theoretical study of deep learning. In this work, we discover an embedding principle in depth that loss landscape of an NN "contains" all critical points of the loss landscapes for shallower NNs. The key tool for our discovery is the critical lifting operator proposed in this work that maps any critical point of a network to critical manifolds of any deeper network while preserving the outputs. This principle provides new insights to many widely observed behaviors of DNNs. Regarding the easy training of deep networks, we show that local minimum of an NN can be lifted to strict saddle points of a deeper NN. Regarding the acceleration effect of batch normalization, we demonstrate that batch normalization helps avoid the critical manifolds lifted from shallower NNs by suppressing layer linearization. We also prove that increasing training data shrinks the lifted critical manifolds, which can result in acceleration of training as demonstrated in experiments. Overall, our discovery of the embedding principle in depth uncovers the depth-wise hierarchical structure of deep learning loss landscape, which serves as a solid foundation for the further study about the role of depth for DNNs.


title: YASMIN: Yet Another State MachINe library for ROS 2

abstract: State machines are a common mechanism for defining behaviors in robots, defining them based on identifiable stages. There are several libraries available for easing the implementation of state machines in ROS 1, as SMACH or SMACC, but there are fewer alternatives for ROS 2. YASMIN is yet another library specifically designed for ROS 2 for easing the design of robotic behaviors using state machines. It is available in C++ and Python, provides some default states to speed up the development, and a web viewer for monitoring the execution of the system and helping in the debugging.


title: The Babylonian Graph

abstract: The Babylonian graph B has the positive integers as vertices and connects two if they define a Pythagorean triple. Triangular subgraphs correspond to Euler bricks. What are the properties of this graph? Are there tetrahedral subgraphs corresponding to Euler tesseracts? Is there only one infinite connected component? Are there two Euler bricks in the graph that are disconnected? Do the number of edges or triangles in the subgraph generated by the first n vertices grow like of the order n W(n), where n is the product log? We prove here some first results like the threshold where B(n) becomes non-planar. In an appendix, we include handout from a talk on Euler cuboids given in the year 2009.


title: Ergodic Achievable Rate Maximization of RIS-assisted Millimeter-Wave MIMO-OFDM Communication Systems

abstract: Reconfigurable intelligent surface (RIS) has attracted extensive attention in recent years. However, most research focuses on the scenario of the narrowband and/or instantaneous channel state information (CSI), while wide bandwidth with the use of millimeter-wave (mmWave) (including sub-Terahertz) spectrum is a major trend in next-generation wireless communications, and statistical CSI is more practical to obtain in realistic systems. Thus, we {consider} the ergodic achievable rate of RIS-assisted mmWave multiple-input multiple-output orthogonal frequency division multiplexing communication systems. The widely used Saleh-Valenzuela channel model is adopted to characterize the mmWave channels and only the statistical CSI is available. We first derive the approximations of the ergodic achievable rate by means of the majorization theory and Jensen's inequality. Then, an alternating optimization based algorithm is proposed to maximize the ergodic achievable rate by jointly designing the transmit covariance matrix at the base station and the reflection coefficients at the RIS. Specifically, the design of the transmit covariance matrix is transformed into a power allocation problem and solved by spatial-frequency water-filling. The reflection coefficients are optimized by the Riemannian conjugate gradient algorithm. Simulation results corroborate the effectiveness of the proposed algorithms.


title: Diameter two properties for spaces of Lipschitz functions

abstract: We solve some open problems regarding diameter two properties within the class of Banach spaces of real-valued Lipschitz functions by using the de Leeuw transform. Namely, we show that: the diameter two property, the strong diameter two property, and the symmetric strong diameter two property are all different for these spaces of Lipschitz functions; the space $\operatorname{Lip}_0(K_n)$ has the symmetric strong diameter two property for every $n\in \mathbb{N}$, including the case of $n=2$; every local norm-one Lipschitz function is a Daugavet point.


title: Noise resilience in path-polarization hyperentangled probe states

abstract: Most quantum systems that are used for generating entanglement and for practical applications are not isolated from the environment, and are hence susceptible to noise. Entanglement in more than one degree of freedom between two systems, known as hyperentanglement, is known to have certain advantages, including robustness against noise over conventional entangled states. Quantum illumination, imaging and communication schemes that involve sending one photon from a pair of entangled photons and retaining the other photon usually involve exposing only the signal photon to environmental noise. The disruptive nature of noise degrades entanglement and other correlations which are crucial for many of these applications. In this paper, we study the advantages of using photon pairs in certain path-polarization hyperentangled states in a noisy interaction where photons in only one of the paths are affected by noise. We model such noise and study the effect of noise on the correlations present in the hyperentangled photons. Three different methods, entanglement negativity, entanglement witnesses and Bell nonlocality are used to show the resilience of path-polarization hyperentangled probe state against noise.


title: Dynamic disorder in Bi sub-lattice of $\delta$-Bi$_2$O$_3$

abstract: $\delta$-Bi$_2$O$_3$ is one of the fastest known solid oxide ion conductors owing to its intrinsically defective fluorite-like structure with 25\% vacant sites in the O sub-lattice. Numerous diffraction measurements and molecular dynamics simulations indicate that the Bi ions construct a cubic, fcc lattice, and the O ions are %distributing and migrating through it. Nonetheless, in this study we present Raman scattering measurements that clearly show that the Bi sub-lattice preserves the monoclinic symmetry of the low temperature phase ($\alpha$-Bi$_2$O$_3$) up to the melting temperature of the crystal. The apparent contradiction between our observations and previous findings suggests that Bi ions oscillate between local minima of the effective potential energy surface. These minima represent the monoclinic phase while the time-averaged structure is the cubic phase. We discuss the implication of these low-frequency oscillations on ion conduction.


title: Finite-time quantum Otto engine with a squeezed thermal bath: Role of quantum coherence and squeezing in the performance and fluctuations

abstract: We consider a finite-time quantum Otto heat engine that consists of two isochoric (thermal-contact) process, where the system is alternatively coupled to a hot squeezed and a cold thermal reservoir, and two unitary driven strokes, where the system is isolated from these two baths and its von Neumann entropy keeps constant. Both quantum inner friction and coherence are generated along the driven stroke and coherence cannot be fully erased after the finite-time hot isochore. Using full counting statistics, we present the probability distribution functions of heat injection and total work per cycle, which are dependent on the time duration along each process. With these, we derive the analytical expressions for the thermodynamic quantities of the two-level heat engine, such as total work, thermodynamic efficiency, entropy production, and work fluctuations, in which effects of coherence, squeezing, inner friction and finite-time heat exchange are included. We then numerically determine the thermodynamic quantities and the fluctuations using the parameters employed in the experimental implementation. Our results clarify the role of coherence and squeezing in the performance and fluctuations in the quantum Otto engines.


title: Constraining pseudo-Dirac neutrinos from a galactic core-collapse supernova

abstract: Neutrinos can be pseudo-Dirac in nature -- Majorana fermions behaving as Dirac fermions for all practical purposes. In such a scenario, active and sterile neutrinos are quasi-degenerate in mass, and hence oscillations between the two, due to their tiny mass-squared difference $(\delta m^2)$, can develop only over very long baselines. Under this hypothesis, we analyze the neutrino data from SN1987A, and find a mild preference for a non-zero mass-squared difference. The same data can also be used to exclude values of $\delta m^2\sim 10^{-20}{\rm eV}^2$ - the smallest constrained so far. We also discuss how next-generation experiments like the DUNE and Hyper-Kamiokande can probe this scenario for a future galactic supernova.


title: An Event-Driven Compressive Neuromorphic System for Cardiac Arrhythmia Detection

abstract: Wearable electrocardiograph (ECG) recording and processing systems have been developed to detect cardiac arrhythmia to help prevent heart attacks. Conventional wearable systems, however, suffer from high energy consumption at both circuit and system levels. To overcome the design challenges, this paper proposes an event-driven compressive ECG recording and neuromorphic processing system for cardiac arrhythmia detection. The proposed system achieves low power consumption and high arrhythmia detection accuracy via system level co-design with spike-based information representation. Event-driven level-crossing ADC (LC-ADC) is exploited in the recording system, which utilizes the sparsity of ECG signal to enable compressive recording and save ADC energy during the silent signal period. Meanwhile, the proposed spiking convolutional neural network (SCNN) based neuromorphic arrhythmia detection method is inherently compatible with the spike-based output of LC-ADC, hence realizing accurate detection and low energy consumption at system level. Simulation results show that the proposed system with 5-bit LC-ADC achieves 88.6\% reduction of sampled data points compared with Nyquist sampling in the MIT-BIH dataset, and 93.59\% arrhythmia detection accuracy with SCNN, demonstrating the compression ability of LC-ADC and the effectiveness of system level co-design with SCNN.


title: Joint Training of Speech Enhancement and Self-supervised Model for Noise-robust ASR

abstract: Speech enhancement (SE) is usually required as a front end to improve the speech quality in noisy environments, while the enhanced speech might not be optimal for automatic speech recognition (ASR) systems due to speech distortion. On the other hand, it was shown that self-supervised pre-training enables the utilization of a large amount of unlabeled noisy data, which is rather beneficial for the noise robustness of ASR. However, the potential of the (optimal) integration of SE and self-supervised pre-training still remains unclear. In order to find an appropriate combination and reduce the impact of speech distortion caused by SE, in this paper we therefore propose a joint pre-training approach for the SE module and the self-supervised model. First, in the pre-training phase the original noisy waveform or the waveform obtained by SE is fed into the self-supervised model to learn the contextual representation, where the quantified clean speech acts as the target. Second, we propose a dual-attention fusion method to fuse the features of noisy and enhanced speeches, which can compensate the information loss caused by separately using individual modules. Due to the flexible exploitation of clean/noisy/enhanced branches, the proposed method turns out to be a generalization of some existing noise-robust ASR models, e.g., enhanced wav2vec2.0. Finally, experimental results on both synthetic and real noisy datasets show that the proposed joint training approach can improve the ASR performance under various noisy settings, leading to a stronger noise robustness.


title: Analytical Interpretation of Latent Codes in InfoGAN with SAR Images

abstract: Generative Adversarial Networks (GANs) can synthesize abundant photo-realistic synthetic aperture radar (SAR) images. Some recent GANs (e.g., InfoGAN), are even able to edit specific properties of the synthesized images by introducing latent codes. It is crucial for SAR image synthesis since the targets in real SAR images are with different properties due to the imaging mechanism. Despite the success of InfoGAN in manipulating properties, there still lacks a clear explanation of how these latent codes affect synthesized properties, thus editing specific properties usually relies on empirical trials, unreliable and time-consuming. In this paper, we show that latent codes are disentangled to affect the properties of SAR images in a non-linear manner. By introducing some property estimators for latent codes, we are able to provide a completely analytical nonlinear model to decompose the entangled causality between latent codes and different properties. The qualitative and quantitative experimental results further reveal that the properties can be calculated by latent codes, inversely, the satisfying latent codes can be estimated given desired properties. In this case, properties can be manipulated by latent codes as we expect.


title: Unpredictable repeatability in molecular evolution

abstract: The extent of parallel evolution at the genotypic level is quantitatively linked to the distribution of beneficial fitness effects (DBFE) of mutations. The standard view, based on light-tailed distributions (i.e. distributions with finite moments), is that the probability of parallel evolution in duplicate populations is inversely proportional to the number of available mutations, and moreover that the DBFE is sufficient to determine the probability when the number of available mutations is large. Here we show that when the DBFE is heavy-tailed, as found in several recent experiments, these expectations are defied. The probability of parallel evolution decays anomalously slowly in the number of mutations or even becomes independent of it, implying higher repeatability of evolution. At the same time, the probability of parallel evolution is non-self-averaging, that is, it does not converge to its mean value even when a large number of mutations are involved. This behavior arises because the evolutionary process is dominated by only a few mutations of high weight. Consequently, the probability varies widely across systems with the same DBFE. Contrary to the standard view, the DBFE is no longer sufficient to determine the extent of parallel evolution, making it much less predictable. We illustrate these ideas theoretically and through analysis of empirical data on antibiotic resistance evolution.


title: Social Interpretable Tree for Pedestrian Trajectory Prediction

abstract: Understanding the multiple socially-acceptable future behaviors is an essential task for many vision applications. In this paper, we propose a tree-based method, termed as Social Interpretable Tree (SIT), to address this multi-modal prediction task, where a hand-crafted tree is built depending on the prior information of observed trajectory to model multiple future trajectories. Specifically, a path in the tree from the root to leaf represents an individual possible future trajectory. SIT employs a coarse-to-fine optimization strategy, in which the tree is first built by high-order velocity to balance the complexity and coverage of the tree and then optimized greedily to encourage multimodality. Finally, a teacher-forcing refining operation is used to predict the final fine trajectory. Compared with prior methods which leverage implicit latent variables to represent possible future trajectories, the path in the tree can explicitly explain the rough moving behaviors (e.g., go straight and then turn right), and thus provides better interpretability. Despite the hand-crafted tree, the experimental results on ETH-UCY and Stanford Drone datasets demonstrate that our method is capable of matching or exceeding the performance of state-of-the-art methods. Interestingly, the experiments show that the raw built tree without training outperforms many prior deep neural network based approaches. Meanwhile, our method presents sufficient flexibility in long-term prediction and different best-of-$K$ predictions.


title: DeepTechnome: Mitigating Unknown Bias in Deep Learning Based Assessment of CT Images

abstract: Reliably detecting diseases using relevant biological information is crucial for real-world applicability of deep learning techniques in medical imaging. We debias deep learning models during training against unknown bias - without preprocessing/filtering the input beforehand or assuming specific knowledge about its distribution or precise nature in the dataset. We use control regions as surrogates that carry information regarding the bias, employ the classifier model to extract features, and suppress biased intermediate features with our custom, modular DecorreLayer. We evaluate our method on a dataset of 952 lung computed tomography scans by introducing simulated biases w.r.t. reconstruction kernel and noise level and propose including an adversarial test set in evaluations of bias reduction techniques. In a moderately sized model architecture, applying the proposed method to learn from data exhibiting a strong bias, it near-perfectly recovers the classification performance observed when training with corresponding unbiased data.


title: More than energy cost: Multiple benefits of the long Achilles tendon in human walking and running

abstract: Elastic strain energy is stored and released from long, distal tendons such as the Achilles during locomotion, reducing locomotor energy cost by minimising muscle shortening distance and speed, and thus activation. However, numerous additional, often unrecognised, advantages of long tendons may speculatively be of greater evolutionary advantage, including the reduced limb inertia afforded by shorter and lighter muscles (reducing proximal muscle force requirement); reduced energy dissipation during the foot-ground collision; capacity to store and reuse the muscle work done to dampen the vibrations triggered by foot-ground collisions; and attenuation of work-induced muscle damage. Cumulatively, these effects should reduce both neuromotor fatigue and sense of locomotor effort, allowing humans to choose to move at faster speeds for longer. As these benefits are greater at faster locomotor speeds, they are consistent with the hypothesis that running gaits used by our ancestors exerted substantial evolutionary pressure on Achilles tendon length.


title: Federated Split BERT for Heterogeneous Text Classification

abstract: Pre-trained BERT models have achieved impressive performance in many natural language processing (NLP) tasks. However, in many real-world situations, textual data are usually decentralized over many clients and unable to be uploaded to a central server due to privacy protection and regulations. Federated learning (FL) enables multiple clients collaboratively to train a global model while keeping the local data privacy. A few researches have investigated BERT in federated learning setting, but the problem of performance loss caused by heterogeneous (e.g., non-IID) data over clients remain under-explored. To address this issue, we propose a framework, FedSplitBERT, which handles heterogeneous data and decreases the communication cost by splitting the BERT encoder layers into local part and global part. The local part parameters are trained by the local client only while the global part parameters are trained by aggregating gradients of multiple clients. Due to the sheer size of BERT, we explore a quantization method to further reduce the communication cost with minimal performance loss. Our framework is ready-to-use and compatible to many existing federated learning algorithms, including FedAvg, FedProx and FedAdam. Our experiments verify the effectiveness of the proposed framework, which outperforms baseline methods by a significant margin, while FedSplitBERT with quantization can reduce the communication cost by $11.9\times$.


title: Federated Non-negative Matrix Factorization for Short Texts Topic Modeling with Mutual Information

abstract: Non-negative matrix factorization (NMF) based topic modeling is widely used in natural language processing (NLP) to uncover hidden topics of short text documents. Usually, training a high-quality topic model requires large amount of textual data. In many real-world scenarios, customer textual data should be private and sensitive, precluding uploading to data centers. This paper proposes a Federated NMF (FedNMF) framework, which allows multiple clients to collaboratively train a high-quality NMF based topic model with locally stored data. However, standard federated learning will significantly undermine the performance of topic models in downstream tasks (e.g., text classification) when the data distribution over clients is heterogeneous. To alleviate this issue, we further propose FedNMF+MI, which simultaneously maximizes the mutual information (MI) between the count features of local texts and their topic weight vectors to mitigate the performance degradation. Experimental results show that our FedNMF+MI methods outperform Federated Latent Dirichlet Allocation (FedLDA) and the FedNMF without MI methods for short texts by a significant margin on both coherence score and classification F1 score.


title: A DPG method for Reissner-Mindlin plates

abstract: We present a discontinuous Petrov-Galerkin (DPG) method with optimal test functions for the Reissner-Mindlin plate bending model. Our method is based on a variational formulation that utilizes a Helmholtz decomposition of the shear force. It produces approximations of the primitive variables and the bending moments. For any canonical selection of boundary conditions the method converges quasi-optimally. In the case of hard-clamped convex plates, we prove that the lowest-order scheme is locking free. Several numerical experiments confirm our results.


title: Open quantum system approach for heavy quark thermalization

abstract: We treat heavy quark as an open quantum system in the hot medium and rederive the Stochastic Schr\"odinger Equation (SSE) from the full Schr\"odinger equation for both heavy quarks and the medium. We apply the SSE to the dynamical evolutions of heavy quarks (as a system) in the static hot medium (as an environment). Heavy quarks interact with the medium via random scatterings, which exchange the momentum and phase factor randomly between two wave functions of the system and the environment. The exchange of momentum and phase factor results in the transition between different eigenstates of the system. These are included via an external stochastic potential in the Hamiltonian of SSE. Stochastic wave functions of heavy quarks are evolved with the stochastic external potential. The mean wave functions and the corresponding momentum distributions of heavy quarks are obtained after the ensemble average over a large set of stochastic wave functions. We present the thermalization of heavy quarks in the static medium with different coupling strength.


title: Gaussian Universality of Perceptrons with Random Labels

abstract: While classical in many theoretical settings - and in particular in statistical physics-inspired works - the assumption of Gaussian i.i.d. input data is often perceived as a strong limitation in the context of statistics and machine learning. In this study, we redeem this line of work in the case of generalized linear classification, a.k.a. the perceptron model, with random labels. We argue that there is a large universality class of high-dimensional input data for which we obtain the same minimum training loss as for Gaussian data with corresponding data covariance. In the limit of vanishing regularization, we further demonstrate that the training loss is independent of the data covariance. On the theoretical side, we prove this universality for an arbitrary mixture of homogeneous Gaussian clouds. Empirically, we show that the universality holds also for a broad range of real datasets.

categories: stat.ML cond-mat.dis-nn cs.LG math.PR math.ST stat.TH


title: From a feedback-controlled demon to an information ratchet in a double quantum dot

abstract: We present a simple strategy for constructing an information ratchet or memory-tape model of Maxwell's demon, from a feedback-controlled model. We illustrate our approach by converting the Annby-Andersson feedback-controlled double quantum dot model [Phys. Rev. B 101, 165404 (2020)] to a memory-tape model. We use the underlying network structure of the original model to design a set of bit interaction rules for the information ratchet. The new model is solved analytically in the limit of long interaction times. For finite-time interactions, semi-analytical phase diagrams of operational modes are obtained. Stochastic simulations are used to verify theoretical results.


title: Real algebraic overtwisted contact structures on 3-spheres

abstract: A real algebraic link in the 3-sphere is defined as the zero locus in the 3-sphere of a real algebraic function from $\mathbb{R}^4$ to $\mathbb{R}^2$. A real algebraic open book decomposition on the 3-sphere is by definition the Milnor fibration of such a real algebraic function, in case it exists. We prove that every overtwisted contact structure on the 3-sphere with positive three dimensonal invariant $d_3$ (apart from possibly 9 exceptions) are real algebraic. Our construction shows in particular that the pages of the associated open books are planar.


title: Canonical stratification of definable Lie groupoids

abstract: Our aim is to precisely present a tame topology counterpart to canonical stratification of a Lie groupoid. We consider a definable Lie groupoid in semialgebraic, subanalytic, o-minimal over $\mathbb{R}$, or more generally, Shiota's $\mathfrak{X}$-category. We show that there exists a canonical Whitney stratification of the Lie groupoid into definable strata which are invariant under the groupoid action. This is a generalization and refinement of results on real algebraic group action which J. N. Mather and V. A. Vassiliev independently stated with sketchy proofs. A crucial change to their proofs is to use Shiota's isotopy lemma and approximation theorem in the context of tame topology.


title: From $p$-Wasserstein Bounds to Moderate Deviations

abstract: We use a new method via $p$-Wasserstein bounds to prove Cram\'er-type moderate deviations in (multivariate) normal approximations. In the classical setting that $W$ is a standardized sum of $n$ independent and identically distributed (i.i.d.) random variables with sub-exponential tails, our method recovers the optimal range of $0\leq x=o(n^{1/6})$ and the near optimal error rate $O(1)(1+x)(\log n+x^2)/\sqrt{n}$ for $P(W>x)/(1-\Phi(x))\to 1$, where $\Phi$ is the standard normal distribution function. Our method also works for dependent random variables (vectors) and we give applications to the combinatorial central limit theorem, Wiener chaos, homogeneous sums and local dependence. The key step of our method is to show that the $p$-Wasserstein distance between the distribution of the random variable (vector) of interest and a normal distribution grows like $O(p^\alpha \Delta)$, $1\leq p\leq p_0$, for some constants $\alpha, \Delta$ and $p_0$. In the above i.i.d. setting, $\alpha=1, \Delta=1/\sqrt{n}, p_0=n^{1/3}$. For this purpose, we obtain general $p$-Wasserstein bounds in (multivariate) normal approximations using Stein's method.


title: Overcoming contrast reversals in focused probe ptychography of thick materials: an optimal pipeline for efficiently determining local atomic structure in materials science

abstract: Ptychography provides highly efficient imaging in scanning transmission electron microscopy (STEM), but questions have remained over its applicability to strongly scattering samples such as those most commonly seen in materialsscience. Although contrast reversals can appear in ptychographic phase images as the projected potentials of the sample increase, we show here how these can be easily overcome by a small amount of defocus. The amount of defocus is small enough that it can exist naturally when focusing using the annular dark field (ADF) signal, but can also be adjusted post acquisition. The ptychographic images of strongly scattering materials are clearer at finite doses than other STEM techniques, and can better reveal light atomic columns within heavy lattices. In addition data for ptychography can now be collected simultaneously with the fastest of ADF scans. This combination of sensitivity and interpretability presents an ideal workflow for materials science.


title: Sizing the White Whale

abstract: We propose a computational, convex hull free framework that takes advantage of the combinatorial structure of a zonotope, as for example its symmetry group, to orbitwise generate all canonical representatives of its vertices. We illustrate the proposed framework by generating all the 1 955 230 985 997 140 vertices of the $9$-dimensional White Whale. We also compute the number of edges of this zonotope up to dimension $9$ and exhibit a family of vertices whose degree is exponential in the dimension. The White Whale is the Minkowski sum of all the $2^d-1$ non-zero $0/1$-valued $d$-dimensional vectors. The central hyperplane arrangement dual to the White Whale, made up of the hyperplanes normal to these vectors, is called the resonance arrangement and has been studied in various contexts including algebraic geometry, mathematical physics, economics, psychometrics, and representation theory.


title: The Physical Properties of Star-Forming Galaxies with Strong [O III] Lines at z=3.25

abstract: We present an analysis of physical properties of 34 [O III] emission-line galaxies (ELGs) at z=3.254$\pm$0.029 in the Extended Chandra Deep Field South (ECDFS). These ELGs are selected from deep narrow H2S(1) and broad Ks imaging of 383 arcmin$^{2}$ obtained with CFHT/WIRCam. We construct spectral energy distributions (SEDs) from U to Ks to derive the physical properties of ELGs. These [O III] ELGs are identified as starburst galaxies with strong [O III] lines of L([O III]) ~ 10$^{42.6}$ - 10$^{44.2}$ erg s$^{-1}$, and have stellar masses of M* ~ 10$^{9.0}$-10$^{10.6}$ M$_\odot$ and star formation rates of ~ 10-210 M$_\odot$ yr$^{-1}$. Our results show that 24% of our sample galaxies are dusty with Av > 1 mag and EW(OIII)$_{rest}$ ~ 70-500 $\AA$, which are often missed in optically selected [O III] ELG samples. Their rest-frame UV and optical morphologies from HST/ACS and HST/WFC3 deep imaging reveal that these [O III] ELGs are mostly multiple-component systems (likely mergers) or compact. And 20% of them are nearly invisible in the rest-frame UV owing to heavy dust attenuation. Interestingly, we find that our samples reside in an overdensity consisting of two components: one southeast (SE) with an overdensity factor of $\delta_{gal}$ ~ 41 over a volume of 13$^{3}$ cMpc$^{3}$ and the other northwest (NW) with $\delta_{gal}$ ~ 38 over a volume of 10$^{3}$ cMpc$^{3}$. The two overdense substructures are expected to be virialized at z=0 with a total mass of ~ 1.1 x 10$^{15}$ M$_\odot$ and ~ 4.8 x 10$^{14}$ M$_\odot$, and probably merge into a Coma-like galaxy cluster.


title: SARS-CoV-2 Result Interpretation based on Image Analysis of Lateral Flow Devices

abstract: The widely used gene quantisation technique, Lateral Flow Device (LFD), is now commonly used to detect the presence of SARS-CoV-2. It is enabling the control and prevention of the spread of the virus. Depending on the viral load, LFD have different sensitivity and self-test for normal user present additional challenge to interpret the result. With the evolution of machine learning algorithms, image processing and analysis has seen unprecedented growth. In this interdisciplinary study, we employ novel image analysis methods of computer vision and machine learning field to study visual features of the control region of LFD. Here, we automatically derive results for any image containing LFD into positive, negative or inconclusive. This will reduce the burden of human involvement of health workers and perception bias.


title: Group field theory on quantum groups

abstract: We introduce the framework of Hopf algebra field theory (HAFT) which generalizes the notion of group field theory to the quantum group (Hopf algebra) case. We focus in particular on the 3d case and show how the HAFT we considered is topological. The highlight of the construction is the notion of plane-wave which leads, in the specific example of SUq (2) with q real, to a discretization of the Euclidian BF action with a negative cosmological constant. This work can be viewed as the generalization of the seminal work by Baratin and Oriti: we have a (non-commutative) formulation of simplicial 3d gravity in the presence of a non-zero cosmological constant.


title: Cross-Architecture Self-supervised Video Representation Learning

abstract: In this paper, we present a new cross-architecture contrastive learning (CACL) framework for self-supervised video representation learning. CACL consists of a 3D CNN and a video transformer which are used in parallel to generate diverse positive pairs for contrastive learning. This allows the model to learn strong representations from such diverse yet meaningful pairs. Furthermore, we introduce a temporal self-supervised learning module able to predict an Edit distance explicitly between two video sequences in the temporal order. This enables the model to learn a rich temporal representation that compensates strongly to the video-level representation learned by the CACL. We evaluate our method on the tasks of video retrieval and action recognition on UCF101 and HMDB51 datasets, where our method achieves excellent performance, surpassing the state-of-the-art methods such as VideoMoCo and MoCo+BE by a large margin. The code is made available at https://github.com/guoshengcv/CACL.


title: A geostatistical analysis of multiscale metallicity variations in galaxies [II]: Predicting the metallicities of Hii and diffuse ionised gas regions via universal kriging

abstract: The metallicity of diffuse ionised gas (DIG) cannot be determined using strong emission line diagnostics, which are calibrated to calculate the metallicity of Hii regions. Because of this, resolved metallicity maps from integral field spectroscopy (IFS) data remain largely incomplete. In this paper (the second of a series), we introduce the geostatistical technique of universal kriging, which allows the complete 2D metallicity distribution of a galaxy to be reconstructed from metallicities measured at Hii regions, accounting for spatial correlations between nearby data points. We apply this method to construct high-fidelity metallicity maps of the local spiral galaxy NGC 5236 using data from the TYPHOON/PrISM survey. We find significant correlation in the metallicity of Hii regions separated by up to 0.4-1.2 kpc. Predictions constructed using this method were tested using cross-validation in Hii regions, and we show that they outperform significantly interpolation based on metallicity gradients. Furthermore, we apply kriging to predict the metallicities in regions dominated by DIG emission, considering seven additional spiral galaxies with high resolution (<100pc) metallicity maps. We compare kriging maps to DIG metallicities computed with novel ionisation corrections, and find that such corrections introduce a systematic offset of up to $\pm0.1$ dex for any individual galaxy, with a scatter of 0.02-0.07 dex for the sample. Overall we recommend universal kriging, together with a calibrated geostatistical model, as the superior method for inferring the metallicities of DIG-dominated regions in local spiral galaxies, demonstrating further the potential of applying geostatistical methods to spatially resolved galaxy observations.


title: Arbitrary High Order WENO Finite Volume Scheme with Flux Globalization for Moving Equilibria Preservation

abstract: In the context of preserving stationary states, e.g. lake at rest and moving equilibria, a new formulation of the shallow water system, called Flux Globalization has been introduced by Cheng et al. (2019). This approach consists in including the integral of the source term in the global flux and reconstructing the new global flux rather than the conservative variables. The resulting scheme is able to preserve a large family of smooth and discontinuous steady state moving equilibria. In this work, we focus on an arbitrary high order WENO Finite Volume (FV) generalization of the global flux approach. The most delicate aspect of the algorithm is the appropriate definition of the source flux (integral of the source term) and the quadrature strategy used to match it with the WENO reconstruction of the hyperbolic flux. When this construction is correctly done, one can show that the resulting WENO FV scheme admits exact discrete steady states characterized by constant global fluxes. We also show that, by an appropriate quadrature strategy for the source, we can embed exactly some particular steady states, e.g. the lake at rest for the shallow water equations. It can be shown that an exact approximation of global fluxes leads to a scheme with better convergence properties and improved solutions. The novel method has been tested and validated on classical cases: subcritical, supercritical and transcritical flows.


title: Fair Representation Learning through Implicit Path Alignment

abstract: We consider a fair representation learning perspective, where optimal predictors, on top of the data representation, are ensured to be invariant with respect to different sub-groups. Specifically, we formulate this intuition as a bi-level optimization, where the representation is learned in the outer-loop, and invariant optimal group predictors are updated in the inner-loop. Moreover, the proposed bi-level objective is demonstrated to fulfill the sufficiency rule, which is desirable in various practical scenarios but was not commonly studied in the fair learning. Besides, to avoid the high computational and memory cost of differentiating in the inner-loop of bi-level objective, we propose an implicit path alignment algorithm, which only relies on the solution of inner optimization and the implicit differentiation rather than the exact optimization path. We further analyze the error gap of the implicit approach and empirically validate the proposed method in both classification and regression settings. Experimental results show the consistently better trade-off in prediction performance and fairness measurement.


title: Capacity Analysis of Molecular Communications with Ratio Shift Keying Modulation

abstract: Molecular Communications (MC) is a bio-inspired communication technique that uses molecules to encode and transfer information. Many efforts have been focused on developing new modulation techniques for MC by exploiting distinguishable properties of molecules. In this paper, we investigate a particular modulation scheme where the information is encoded into the concentration ratio of two different types of molecules. To evaluate the performance of this so-called Ratio Shift Keying (RSK) modulation, we carry out an information theoretical analysis and derive the capacity of the end-to-end MC channel where the receiver performs ratio estimation based on ligand-receptor binding statistics in an optimal or suboptimal manner. The numerical results, obtained for varying similarity between the ligand types employed for ratio-encoding, and number of receptors, indicate that the RSK can outperform the concentration shift keying (CSK) modulation, the most common technique considered in literature, when the transmitter is power-limited. The results also indicate the potential advantages of RSK over other modulation methods under time-varying channel conditions, when the effects of the dynamic conditions are invariant to the type of the molecules.


title: On the slope inequalities for extremal curves

abstract: The present paper concerns the question of the violation of the r-th inequality for extremal curves in the projective r-space, posed by T. Kato and G. Martens. We show that the answer is negative in many cases. The result is obtained by a detailed analysis of the geometry of extremal curves and their canonical model. As a consequence, we show that particular curves on a Hirzebruch surface do not violate the slope inequalities in a certain range.


title: Protocorks and monopole Floer homology

abstract: We introduce and study a class of compact 4-manifolds with boundary that we call protocorks. Any exotic pair of simply connected closed 4-manifolds is related by a protocork twist, moreover, any cork is supported by a protocork. We prove a theorem on the relative Seiberg-Witten invariants of a protocork before and after twisting and a splitting theorem on the Floer homology of protocork boundaries. As a corollary we improve a theorem by Morgan and Szab\'{o} regarding the variation of Seiberg-Witten invariants with an upper bound which depends only on the topology of the data. Moreover, we generalize the result that only the reduced Floer homology of a cork boundary contributes to the variation of the Seiberg-Witten invariants under a cork twist to more general cut and paste operations where the pieces involved are $1$-connected and homeomorphic relative to the boundary.


title: Towards Learning Universal Hyperparameter Optimizers with Transformers

abstract: Meta-learning hyperparameter optimization (HPO) algorithms from prior experiments is a promising approach to improve optimization efficiency over objective functions from a similar distribution. However, existing methods are restricted to learning from experiments sharing the same set of hyperparameters. In this paper, we introduce the OptFormer, the first text-based Transformer HPO framework that provides a universal end-to-end interface for jointly learning policy and function prediction when trained on vast tuning data from the wild, such as Google's Vizier database, one of the world's largest HPO datasets. Our extensive experiments demonstrate that the OptFormer can simultaneously imitate at least 7 different HPO algorithms, which can be further improved via its function uncertainty estimates. Compared to a Gaussian Process, the OptFormer also learns a robust prior distribution for hyperparameter response functions, and can thereby provide more accurate and better calibrated predictions. This work paves the path to future extensions for training a Transformer-based model as a general HPO optimizer.


title: A new self-exciting jump-diffusion process for option pricing

abstract: We propose a new jump-diffusion process, the Heston-Queue-Hawkes (HQH) model, combining the well-known Heston model and the recently introduced Queue-Hawkes (Q-Hawkes) jump process. Like the Hawkes process, the HQH model can capture the effects of self-excitation and contagion. However, since the characteristic function of the HQH process is known in closed-form, Fourier-based fast pricing algorithms, like the COS method, can be fully exploited with this model. Furthermore, we show that by using partial integrals of the characteristic function, which are also explicitly known for the HQH process, we can reduce the dimensionality of the COS method, and so its numerical complexity. Numerical results for European and Bermudan options show that the HQH model offers a wider range of volatility smiles compared to the Bates model, while its computational burden is considerably smaller than that of the Heston-Hawkes (HH) process.


title: DoS Attacks on Blockchain Ecosystem

abstract: Denial of Service (DoS) attacks are a growing threat in network services. The frequency and intensity of DoS attacks are rapidly increasing day by day. The immense financial potential of the Cryptocurrency market is a prevalent target of the DoS attack. The DoS attack events are kept on happening in cryptocurrencies and the blockchain ecosystem. To the best of our knowledge, there has not been any study on the DoS attack on the blockchain ecosystem. In this paper, we identify ten entities in the blockchain ecosystem and we scrutinize the DoS attacks on them. We also present the DoS mitigation techniques applicable to the blockchain services. Additionally, we propose a DoS mitigation technique by the use of verifiable delay function (VDF).


title: The Effect of Task Ordering in Continual Learning

abstract: We investigate the effect of task ordering on continual learning performance. We conduct an extensive series of empirical experiments on synthetic and naturalistic datasets and show that reordering tasks significantly affects the amount of catastrophic forgetting. Connecting to the field of curriculum learning, we show that the effect of task ordering can be exploited to modify continual learning performance, and present a simple approach for doing so. Our method computes the distance between all pairs of tasks, where distance is defined as the source task curvature of a gradient step toward the target task. Using statistically rigorous methods and sound experimental design, we show that task ordering is an important aspect of continual learning that can be modified for improved performance.


title: Stochastic Geometry Analysis of Spectrum Sharing Among Multiple Seller and Buyer Mobile Operators

abstract: Sharing the licensed frequency spectrum among multiple mobile network operators (MNOs) is a promising approach to improve licensed spectrum utilization. In this paper, we model and analyze a non-orthogonal spectrum sharing system consisting of multiple seller and multiple buyer MNOs where buyer MNOs lease several licensed sub-bands from different seller MNOs. All base stations (BSs) owned by a buyer MNO can also utilize various licensed sub-bands simultaneously, which are also used by other buyer MNOs. To reduce the interference that a buyer MNO imposes on one seller MNO sharing its licensed sub-band, this buyer MNO has a limitation on the maximum interference caused to the corresponding seller MNO's users. We assume each MNO owns its BSs and users whose locations are modeled as two independent homogeneous Poisson point processes. Applying stochastic geometry, we derive expressions for the downlink signal-to-interference-plus-noise ratio coverage probability and the average rate of both seller and buyer networks. The numerical results validate our analysis with simulation and illustrate the effect of the maximum interference threshold on the total sum-rate of the network.


title: Learning the spatio-temporal relationship between wind and significant wave height using deep learning

abstract: Ocean wave climate has a significant impact on near-shore and off-shore human activities, and its characterisation can help in the design of ocean structures such as wave energy converters and sea dikes. Therefore, engineers need long time series of ocean wave parameters. Numerical models are a valuable source of ocean wave data; however, they are computationally expensive. Consequently, statistical and data-driven approaches have gained increasing interest in recent decades. This work investigates the spatio-temporal relationship between North Atlantic wind and significant wave height (Hs) at an off-shore location in the Bay of Biscay, using a two-stage deep learning model. The first step uses convolutional neural networks (CNNs) to extract the spatial features that contribute to Hs. Then, long short-term memory (LSTM) is used to learn the long-term temporal dependencies between wind and waves.


title: SHREC 2022: pothole and crack detection in the road pavement using images and RGB-D data

abstract: This paper describes the methods submitted for evaluation to the SHREC 2022 track on pothole and crack detection in the road pavement. A total of 7 different runs for the semantic segmentation of the road surface are compared, 6 from the participants plus a baseline method. All methods exploit Deep Learning techniques and their performance is tested using the same environment (i.e.: a single Jupyter notebook). A training set, composed of 3836 semantic segmentation image/mask pairs and 797 RGB-D video clips collected with the latest depth cameras was made available to the participants. The methods are then evaluated on the 496 image/mask pairs in the validation set, on the 504 pairs in the test set and finally on 8 video clips. The analysis of the results is based on quantitative metrics for image segmentation and qualitative analysis of the video clips. The participation and the results show that the scenario is of great interest and that the use of RGB-D data is still challenging in this context.


title: Realization of the Single-pair-Weyl Phonons with the Maximum Charge Number in Acoustic Crystals

abstract: To observe the Weyl phonon (WP) with the maximum charge and to design a realistic material structure containing only single-pair-WPs have long been considered two challenges in the field of topology physics. Here we have successfully designed an acoustic crystal to realize the single-pair-WPs with the maximum charge for the first time. Our theoretical simulations on acoustic band dispersions demonstrate that protected by the time-reversal symmetry ($\cal T$) and the point group symmetries, a WP with the charge -4 ($\mathcal{C}=-4$) and another WP with $\mathcal{C}=+4$ are located at the high-symmetry point $\Gamma$ and R, respectively, with the absence of any other kinds of WPs. Moreover, the singe-pair-WPs obtained here are designed by the simplest two-band mode, and the related quadruple-helicoid Fermi acrs can be observed clearly in experiments, since they aren't covered by any bulk bands and hybridized by other kinds of WPs. Our theoretical results provide a reliable acoustic crystal to study the topological properties of the single-pair-WPs with the maximum charge for experimentalists in this field.


title: How Powerful are K-hop Message Passing Graph Neural Networks

abstract: The most popular design paradigm for Graph Neural Networks (GNNs) is 1-hop message passing -- aggregating information from 1-hop neighbors repeatedly. However, the expressive power of 1-hop message passing is bounded by the Weisfeiler-Lehman (1-WL) test. Recently, researchers extended 1-hop message passing to K-hop message passing by aggregating information from K-hop neighbors of nodes simultaneously. However, there is no work on analyzing the expressive power of K-hop message passing. In this work, we theoretically characterize the expressive power of K-hop message passing. Specifically, we first formally differentiate two different kernels of K-hop message passing which are often misused in previous works. We then characterize the expressive power of K-hop message passing by showing that it is more powerful than 1-WL and can distinguish almost all regular graphs. Despite the higher expressive power, we show that K-hop message passing still cannot distinguish some simple regular graphs and its expressive power is bounded by 3-WL. To further enhance its expressive power, we introduce a KP-GNN framework, which improves K-hop message passing by leveraging the peripheral subgraph information in each hop. We show that KP-GNN can distinguish many distance regular graphs which could not be distinguished by previous distance encoding or 3-WL methods. Experimental results verify the expressive power and effectiveness of KP-GNN. KP-GNN achieves competitive results across all benchmark datasets.


title: On Locally Conformally Cosymplectic Hamiltonian Dynamics and Hamilton-Jacobi Theory

abstract: Cosymplectic geometry has been proven to be a very useful geometric background to describe time-dependent Hamiltonian dynamics. In this work, we address the globalization problem of locally cosymplectic Hamiltonian dynamics that failed to be globally defined. We investigate both the geometry of locally conformally cosymplectic (abbreviated as LCC) manifolds and the Hamiltonian dynamics constructed on such LCC manifolds. Further, we provide a geometric Hamilton-Jacobi theory on this geometric framework.


title: Analysis of a Learning Based Algorithm for Budget Pacing

abstract: In this paper, we analyze a natural learning algorithm for uniform pacing of advertising budgets, equipped to adapt to varying ad sale platform conditions. On the demand side, advertisers face a fundamental technical challenge in automating bidding in a way that spreads their allotted budget across a given campaign subject to hidden, and potentially dynamic, cost functions. This automation and calculation must be done in runtime, implying a necessarily low computational cost for the high frequency auction rate. Advertisers are additionally expected to exhaust nearly all of their sub-interval (by the hour or minute) budgets to maintain budgeting quotas in the long run. To resolve this challenge, our study analyzes a simple learning algorithm that adapts to the latent cost function of the market and learns the optimal average bidding value for a period of auctions in a small fraction of the total campaign time, allowing for smooth budget pacing in real-time. We prove our algorithm is robust to changes in the auction mechanism, and exhibits a fast convergence to a stable average bidding strategy. The algorithm not only guarantees that budgets are nearly spent in their entirety, but also smoothly paces bidding to prevent early exit from the campaign and a loss of the opportunity to bid on potentially lucrative impressions later in the period. In addition to the theoretical guarantees, we validate our algorithm with experimental results from open source data on real advertising campaigns to further demonstrate the effectiveness of our proposed approach.


title: TransBoost: Improving the Best ImageNet Performance using Deep Transduction

abstract: This paper deals with deep transductive learning, and proposes TransBoost as a procedure for fine-tuning any deep neural model to improve its performance on any (unlabeled) test set provided at training time. TransBoost is inspired by a large margin principle and is efficient and simple to use. Our method significantly improves the ImageNet classification performance on a wide range of architectures, such as ResNets, MobileNetV3-L, EfficientNetB0, ViT-S, and ConvNext-T, leading to state-of-the-art transductive performance. Additionally we show that TransBoost is effective on a wide variety of image classification datasets. The implementation of TransBoost is provided at: https://github.com/omerb01/TransBoost .


title: UV graviton scattering and positivity bounds from IR dispersion relations

abstract: Scattering amplitudes mediated by graviton exchange display IR singularities in the forward limit. This obstructs standard application of positivity bounds based on twice subtracted dispersion relations. Such divergences can be cancelled only if the UV limit of the scattering amplitude behaves in a specific way, which implies a very non-trivial connection between the UV and IR behaviors of the amplitude. We show that this relation can be expressed in terms of an integral transform, obtaining analytic results when $t \log{s}\rightarrow 0$. Carefully applying this limit to dispersion relations, we find that infinite arc integrals, which are usually taken to vanish, can give a non-trivial contribution in the presence of gravity, unlike in the case of finite negative $t$. This implies that gravitational positivity bounds cannot be trusted unless the size of this contribution is estimated in some way, which implies assumptions on the UV completion of gravitational interactions. We discuss the relevance of these findings in the particular case of QED coupled to gravity.


title: SoK: Decentralized Randomness Beacon Protocols

abstract: The scientific interest in the area of Decentralized Randomness Beacon (DRB) protocols has been thriving recently. Partially that interest is due to the success of the disruptive technologies introduced by modern cryptography, such as cryptocurrencies, blockchain technologies, and decentralized finances, where there is an enormous need for a public, reliable, trusted, verifiable, and distributed source of randomness. On the other hand, recent advancements in the development of new cryptographic primitives brought a huge interest in constructing a plethora of DRB protocols differing in design and underlying primitives. To the best of our knowledge, no systematic and comprehensive work systematizes and analyzes the existing DRB protocols. Therefore, we present a Systematization of Knowledge (SoK) intending to structure the multi-faced body of research on DRB protocols. In this SoK, we delineate the DRB protocols along the following axes: their underlying primitive, properties, and security. This SoK tries to fill that gap by providing basic standard definitions and requirements for DRB protocols, such as Unpredictability, Bias-resistance, Availability (or Liveness), and Public Verifiability. We classify DRB protocols according to the nature of interactivity among protocol participants. We also highlight the most significant features of DRB protocols such as scalability, complexity, and performance along with a brief discussion on its improvement. We present future research directions along with a few interesting research problems.


title: Towards an understanding of YSO variability: A multi-wavelength analysis of bursting, dipping, and symmetrically varying light curves of disc-bearing YSOs

abstract: Using simultaneous optical and infrared light curves of disc-bearing young stars in NGC 2264, we perform the first multi-wavelength structure function study of YSOs. We find that dippers have larger variability amplitudes than bursters and symmetric variables at all timescales longer than a few hours. By analysing optical-infrared colour time-series, we also find that the variability in the bursters is systematically less chromatic at all timescales than the other variability types. We propose a model of YSO variability in which symmetric, bursting, and dipping behaviour is observed in systems viewed at low, intermediate, and high inclinations, respectively. We argue that the relatively short thermal timescale for the disc can explain the fact that the infrared light curves for bursters are more symmetric than their optical counterparts.


title: Generation of S-shaped photonic hooks from microcylinders with engineered surface patches

abstract: Photonic hooks (PHs) are non-evanescent light beams with a highly concentrated curved optical fields. Since their discovery, PHs always have one single inflection point and thus have a hook-like structure. In this work, a new type of PHs with two inflection points and S-shaped structures (S-PHs) were reported for the first time. We theoretically studied the effects of various physical parameters on the generation of S-PHs. Furthermore, we showed that decorating particles with multiple patches can significantly enhance the curvature and length of the S-PHs. The S-PHs may have potential applications in super-resolution imaging, sub-wavelength micromachining, particle and cell manipulation, etc.


title: Actions of pro-groups and pro-rings

abstract: We give an explicit description of internal actions in the semi-abelian categories of pro-groups and non-unital pro-rings in terms of actions of group objects and ring objects in $\mathrm{Pro}(\mathbf{Set})$, as well as in some related categories. Also, we show that a similar result fails for Lie algebras.


title: Anderson localization in the subwavelength regime

abstract: In this paper, we use recent breakthroughs in the study of coupled subwavelength resonator systems to reveal new insight into the mechanisms responsible for the fundamental features of Anderson localization. The occurrence strong localization in random media has proved difficult to understand, particularly in physically derived multi-dimensional models and systems with long-range interactions. We show here that the scattering of time-harmonic waves by high-contrast resonators with randomly chosen material parameters reproduces the characteristic features of Anderson localization. In particular, we show that the hybridization of subwavelength resonant modes is responsible for both the repulsion of energy levels as well as the widely observed phase transition, at which point eigenmode symmetries swap and very strong localization is possible. We derive results from first principles, using asymptotic expansions in terms of the material contrast parameter and obtain a characterization of the localized modes in terms of generalized capacitance matrices. This model captures the long-range interactions of the wave-scattering system and provides a concise framework to explain the exotic phenomena that are observed.


title: Dynamical scaling symmetry and asymptotic quantum correlations for time-dependent scalar fields

abstract: In time-independent quantum systems, entanglement entropy possesses an inherent scaling symmetry that the energy of the system does not have. The symmetry also assures that entropy divergence can be associated with the zero modes. We generalize this symmetry to time-dependent systems all the way from a coupled harmonic oscillator with a time-dependent frequency, to quantum scalar fields with time-dependent mass. We show that such systems have dynamical scaling symmetry that leaves the evolution of various measures of quantum correlations invariant -- entanglement entropy, GS fidelity, Loschmidt echo, and circuit complexity. Using this symmetry, we show that several quantum correlations are related at late-times when the system develops instabilities. We then quantify such instabilities in terms of scrambling time and Lyapunov exponents. The delayed onset of exponential decay of the Loschmidt echo is found to be determined by the largest inverted mode in the system. On the other hand, a zero-mode retains information about the system for a considerably longer time, finally resulting in a power-law decay of the Loschmidt echo. We extend the analysis to time-dependent massive scalar fields in $(1 + 1)-$dimensions and discuss the implications of zero-modes and inverted modes occurring in the system at late-times. We explicitly show the entropy scaling oscillates between the \emph{area-law} and \emph{volume-law} for a scalar field with stable modes or zero-modes. We then provide a qualitative discussion of the above effects for scalar fields in cosmological and black-hole space-times.

categories: hep-th cond-mat.stat-mech gr-qc quant-ph


title: Target-aware Abstractive Related Work Generation with Contrastive Learning

abstract: The related work section is an important component of a scientific paper, which highlights the contribution of the target paper in the context of the reference papers. Authors can save their time and effort by using the automatically generated related work section as a draft to complete the final related work. Most of the existing related work section generation methods rely on extracting off-the-shelf sentences to make a comparative discussion about the target work and the reference papers. However, such sentences need to be written in advance and are hard to obtain in practice. Hence, in this paper, we propose an abstractive target-aware related work generator (TAG), which can generate related work sections consisting of new sentences. Concretely, we first propose a target-aware graph encoder, which models the relationships between reference papers and the target paper with target-centered attention mechanisms. In the decoding process, we propose a hierarchical decoder that attends to the nodes of different levels in the graph with keyphrases as semantic indicators. Finally, to generate a more informative related work, we propose multi-level contrastive optimization objectives, which aim to maximize the mutual information between the generated related work with the references and minimize that with non-references. Extensive experiments on two public scholar datasets show that the proposed model brings substantial improvements over several strong baselines in terms of automatic and tailored human evaluations.


title: Deep Active Learning with Noise Stability

abstract: Uncertainty estimation for unlabeled data is crucial to active learning. With a deep neural network employed as the backbone model, the data selection process is highly challenging due to the potential over-confidence of the model inference. Existing methods resort to special learning fashions (e.g. adversarial) or auxiliary models to address this challenge. This tends to result in complex and inefficient pipelines, which would render the methods impractical. In this work, we propose a novel algorithm that leverages noise stability to estimate data uncertainty. The key idea is to measure the output derivation from the original observation when the model parameters are randomly perturbed by noise. We provide theoretical analyses by leveraging the small Gaussian noise theory and demonstrate that our method favors a subset with large and diverse gradients. Our method is generally applicable in various tasks, including computer vision, natural language processing, and structural data analysis. It achieves competitive performance compared against state-of-the-art active learning baselines.


title: QUIC-FL: Quick Unbiased Compression for Federated Learning

abstract: Distributed Mean Estimation (DME), in which $n$ clients communicate vectors to a parameter server that estimates their average, is a fundamental building block in communication-efficient federated learning. In this paper, we improve on previous DME techniques that achieve the optimal $O(1/n)$ Normalized Mean Squared Error (NMSE) guarantee by asymptotically improving the complexity for either encoding or decoding (or both). To achieve this, we formalize the problem in a novel way that allows us to use off-the-shelf mathematical solvers to design the quantization.


title: Leveraging Causal Inference for Explainable Automatic Program Repair

abstract: Deep learning models have made significant progress in automatic program repair. However, the black-box nature of these methods has restricted their practical applications. To address this challenge, this paper presents an interpretable approach for program repair based on sequence-to-sequence models with causal inference and our method is called CPR, short for causal program repair. Our CPR can generate explanations in the process of decision making, which consists of groups of causally related input-output tokens. Firstly, our method infers these relations by querying the model with inputs disturbed by data augmentation. Secondly, it generates a graph over tokens from the responses and solves a partitioning problem to select the most relevant components. The experiments on four programming languages (Java, C, Python, and JavaScript) show that CPR can generate causal graphs for reasonable interpretations and boost the performance of bug fixing in automatic program repair.


title: Sliding mode control with a neural network compensation scheme for electro-hydraulic systems

abstract: Electro-hydraulic servo-systems are widely employed in industrial applications such as robotic manipulators, active suspensions, precision machine tools and aerospace systems. They provide many advantages over electric motors, including high force to weight ratio, fast response time and compact size. However, precise control of electro-hydraulic systems, due to their inherent nonlinear characteristics, cannot be easily obtained with conventional linear controllers. Most flow control valves can also exhibit some hard nonlinearities such as dead-zone due to valve spool overlap. This work describes the development of a sliding mode controller with a neural network compensation scheme for electro-hydraulic systems subject to an unknown dead-zone input. The boundedness and convergence properties of the closed-loop signals are proven using Lyapunov stability theory. Numerical results are presented in order to demonstrate the control system performance.


title: A neural network based controller for underwater robotic vehicles

abstract: Due to the enormous technological improvements obtained in the last decades it is possible to use robotic vehicles for underwater exploration. This work describes the development of a dynamic positioning system for remotely operated underwater vehicles based. The adopted approach is developed using Lyapunov Stability Theory and enhanced by a neural network based algorithm for uncertainty and disturbance compensation. The performance of the proposed control scheme is evaluated by means of numerical simulations.


title: Properties of the Hebrew Calendar

abstract: We describe an ACL2 program that implements the Hebrew calendar and the formal verification of several of its properties, including the critical result that the algorithm that determines the placement of the new year ensures that the length of every year belongs to a small set of admissible values. These properties have been accepted for many centuries without the benefit of explicit proof, in spite of subtleties in the underlying arguments. For the sake of accessibility to a broad audience, the program is coded in Restricted Algorithmic C (RAC), a simple language consisting of the most basic constructs of C, for which an automatic translator to the ACL2 logic has been implemented. While RAC is primarily intended for modeling arithmetic hardware designs, this novel application provides a relatively simple illustration of the language and the translator.


title: Keywords and Instances: A Hierarchical Contrastive Learning Framework Unifying Hybrid Granularities for Text Generation

abstract: Contrastive learning has achieved impressive success in generation tasks to militate the "exposure bias" problem and discriminatively exploit the different quality of references. Existing works mostly focus on contrastive learning on the instance-level without discriminating the contribution of each word, while keywords are the gist of the text and dominant the constrained mapping relationships. Hence, in this work, we propose a hierarchical contrastive learning mechanism, which can unify hybrid granularities semantic meaning in the input text. Concretely, we first propose a keyword graph via contrastive correlations of positive-negative pairs to iteratively polish the keyword representations. Then, we construct intra-contrasts within instance-level and keyword-level, where we assume words are sampled nodes from a sentence distribution. Finally, to bridge the gap between independent contrast levels and tackle the common contrast vanishing problem, we propose an inter-contrast mechanism that measures the discrepancy between contrastive keyword nodes respectively to the instance distribution. Experiments demonstrate that our model outperforms competitive baselines on paraphrasing, dialogue generation, and storytelling tasks.


title: A Formalization of Finite Group Theory

abstract: Previous formulations of group theory in ACL2 and Nqthm, based on either "encapsulate" or "defn-sk", have been limited by their failure to provide a path to proof by induction on the order of a group, which is required for most interesting results in this domain beyond Lagrange's Theorem (asserting the divisibility of the order of a group by that of a subgroup). We describe an alternative approach to finite group theory that remedies this deficiency, based on an explicit representation of a group as an operation table. We define a "defgroup" macro for generating parametrized families of groups, which we apply to the additive and multiplicative groups of integers modulo n, the symmetric groups, arbitrary quotient groups, and cyclic subgroups. In addition to a proof of Lagrange's Theorem, we present an inductive proof of the abelian case of a theorem of Cauchy: If the order of a group G is divisible by a prime p, then G has an element of order p.


title: Interplay of quantum spin Hall effect and spontaneous time-reversal symmetry breaking in electron-hole bilayers II: Zero-field topological superconductivity

abstract: It has been proposed that band-inverted electron-hole bilayers support a phase transition from an insulating phase with spontaneously broken time-reversal symmetry to a quantum spin Hall insulator phase as a function of increasing electron and hole densities. Here, we show that in the presence of proximity-induced superconductivity it is possible to realize Majorana zero modes in the time-reversal symmetry broken phase in the absence of magnetic field. We develop an effective low-energy theory for the system in the presence of time-reversal symmetry breaking order parameter to obtain analytically the Majorana zero modes and we find a good agreement between the numerical and analytical results in the limit of weakly broken time-reversal symmetry. We show that the Majorana zero modes can be detected in superconductor/time-reversal symmetry broken insulator/superconductor Josephson junctions through the measurement of a $4\pi$ Josephson current. Finally, we demonstrate that the Majorana fusion-rule detection is feasible by utilizing the gate voltage dependence of the spontaneous time-reversal symmetry breaking order parameter.


title: Learning What and Where: Disentangling Location and Identity Tracking Without Supervision

abstract: Our brain can almost effortlessly decompose visual data streams into background and salient objects. Moreover, it can anticipate object motion and interactions, which are crucial abilities for conceptual planning and reasoning. Recent object reasoning datasets, such as CATER, have revealed fundamental shortcomings of current vision-based AI systems, particularly when targeting explicit object representations, object permanence, and object reasoning. Here we introduce a self-supervised LOCation and Identity tracking system (Loci), which excels on the CATER tracking challenge. Inspired by the dorsal and ventral pathways in the brain, Loci tackles the binding problem by processing separate, slot-wise encodings of `what' and `where'. Loci's predictive coding-like processing encourages active error minimization, such that individual slots tend to encode individual objects. Interactions between objects and object dynamics are processed in the disentangled latent space. Truncated backpropagation through time combined with forward eligibility accumulation significantly speeds up learning and improves memory efficiency. Besides exhibiting superior performance in current benchmarks, Loci effectively extracts objects from video streams and separates them into location and Gestalt components. We believe that this separation offers a representation that will facilitate effective planning and reasoning on conceptual levels.