title: ConferencingSpeech 2022 Challenge: Non-intrusive Objective Speech Quality Assessment (NISQA) Challenge for Online Conferencing Applications

abstract: With the advances in speech communication systems such as online conferencing applications, we can seamlessly work with people regardless of where they are. However, during online meetings, speech quality can be significantly affected by background noise, reverberation, packet loss, network jitter, etc. Because of its nature, speech quality is traditionally assessed in subjective tests in laboratories and lately also in crowdsourcing following the international standards from ITU-T Rec. P.800 series. However, those approaches are costly and cannot be applied to customer data. Therefore, an effective objective assessment approach is needed to evaluate or monitor the speech quality of the ongoing conversation. The ConferencingSpeech 2022 challenge targets the non-intrusive deep neural network models for the speech quality assessment task. We open-sourced a training corpus with more than 86K speech clips in different languages, with a wide range of synthesized and live degradations and their corresponding subjective quality scores through crowdsourcing. 18 teams submitted their models for evaluation in this challenge. The blind test sets included about 4300 clips from wide ranges of degradations. This paper describes the challenge, the datasets, and the evaluation methods and reports the final results.


title: Optimizing Shoulder to Shoulder: A Coordinated Sub-Band Fusion Model for Real-Time Full-Band Speech Enhancement

abstract: Due to the high computational complexity to model more frequency bands, it is still intractable to conduct real-time full-band speech enhancement based on deep neural networks. Recent studies typically utilize the compressed perceptually motivated features with relatively low frequency resolution to filter the full-band spectrum by one-stage networks, leading to limited speech quality improvements. In this paper, we propose a coordinated sub-band fusion network for full-band speech enhancement, which aims to recover the low- (0-8 kHz), middle- (8-16 kHz), and high-band (16-24 kHz) in a step-wise manner. Specifically, a dual-stream network is first pretrained to recover the low-band complex spectrum, and another two sub-networks are designed as the middle- and high-band noise suppressors in the magnitude-only domain. To fully capitalize on the information intercommunication, we employ a sub-band interaction module to provide external knowledge guidance across different frequency bands. Extensive experiments show that the proposed method yields consistent performance advantages over state-of-the-art full-band baselines.


title: Monitored Distillation for Positive Congruent Depth Completion

abstract: We propose a method to infer a dense depth map from a single image, its calibration, and the associated sparse point cloud. In order to leverage existing models (teachers) that produce putative depth maps, we propose an adaptive knowledge distillation approach that yields a positive congruent training process, wherein a student model avoids learning the error modes of the teachers. In the absence of ground truth for model selection and training, our method, termed Monitored Distillation, allows a student to exploit a blind ensemble of teachers by selectively learning from predictions that best minimize the reconstruction error for a given image. Monitored Distillation yields a distilled depth map and a confidence map, or ``monitor'', for how well a prediction from a particular teacher fits the observed image. The monitor adaptively weights the distilled depth where if all of the teachers exhibit high residuals, the standard unsupervised image reconstruction loss takes over as the supervisory signal. On indoor scenes (VOID), we outperform blind ensembling baselines by 17.53% and unsupervised methods by 24.25%; we boast a 79% model size reduction while maintaining comparable performance to the best supervised method. For outdoors (KITTI), we tie for 5th overall on the benchmark despite not using ground truth. Code available at: https://github.com/alexklwong/mondi-python.


title: Constraint energy minimizing generalized multiscale finite element method for convection diffusion equation

abstract: In this paper we present and analyze a constraint energy minimizing generalized multiscale finite element method for convection diffusion equation. To define the multiscale basis functions, we first build an auxiliary multiscale space by solving local spectral problems motivated by analysis. Then constraint energy minimization performed in oversampling domains is exploited to construct the multiscale space. The resulting multiscale basis functions have a good decay property even for high contrast diffusion and convection coefficients. Furthermore, if the number of oversampling layer is chosen properly, we can prove that the convergence rate is proportional to the coarse mesh size. Our analysis also indicates that the size of the oversampling domain weakly depends on the contrast of the heterogeneous coefficients. Several numerical experiments are presented illustrating the performances of our method.


title: A posteriori error estimates for an optimal control problem with a bilinear state equation

abstract: We propose and analyze a posteriori error estimators for an optimal control problem that involves an elliptic partial differential equation as state equation and a control variable that enters the state equation as a coefficient; pointwise constraints on the control variable are considered as well. We consider two different strategies to approximate optimal variables: a fully discrete scheme in which the admissible control set is discretized with piecewise constant functions and a semi-discrete scheme where the admissible control set is not discretized; the latter scheme being based on the so-called variational discretization approach. We design, for each solution technique, an a posteriori error estimator and show, in two and three dimensional Lipschitz polygonal/polyhedral domains (not necessarily convex), that the proposed error estimator is reliable and efficient. We design, based on the devised estimators, adaptive strategies that deliver optimal experimental rates of convergence for the performed numerical examples.


title: Enhancing Zero-Shot Many to Many Voice Conversion with Self-Attention VAE

abstract: Variational auto-encoder (VAE) is an effective neural network architecture to disentangle a speech utterance into speaker identity and linguistic content latent embeddings, then generate an utterance for a target speaker from that of a source speaker. This is possible by concatenating the identity embedding of the target speaker and the content embedding of the source speaker uttering a desired sentence. In this work, we propose to improve VAE models with self-attention and structural regularization (RGSM). Specifically, we found a suitable location of VAE's decoder to add a self-attention layer for incorporating non-local information in generating a converted utterance and hiding the source speaker's identity. We applied relaxed group-wise splitting method (RGSM) to regularize network weights and remarkably enhance generalization performance. In experiments of zero-shot many-to-many voice conversion task on VCTK data set, with the self-attention layer and relaxed group-wise splitting method, our model achieves a gain of speaker classification accuracy on unseen speakers by 28.3\% while slightly improved conversion voice quality in terms of MOSNet scores. Our encouraging findings point to future research on integrating more variety of attention structures in VAE framework while controlling model size and overfitting for advancing zero-shot many-to-many voice conversions.


title: Semi-Supervised Learning of Semantic Correspondence with Pseudo-Labels

abstract: Establishing dense correspondences across semantically similar images remains a challenging task due to the significant intra-class variations and background clutters. Traditionally, a supervised learning was used for training the models, which required tremendous manually-labeled data, while some methods suggested a self-supervised or weakly-supervised learning to mitigate the reliance on the labeled data, but with limited performance. In this paper, we present a simple, but effective solution for semantic correspondence that learns the networks in a semi-supervised manner by supplementing few ground-truth correspondences via utilization of a large amount of confident correspondences as pseudo-labels, called SemiMatch. Specifically, our framework generates the pseudo-labels using the model's prediction itself between source and weakly-augmented target, and uses pseudo-labels to learn the model again between source and strongly-augmented target, which improves the robustness of the model. We also present a novel confidence measure for pseudo-labels and data augmentation tailored for semantic correspondence. In experiments, SemiMatch achieves state-of-the-art performance on various benchmarks, especially on PF-Willow by a large margin.


title: Asymptotic behavior of class groups and cyclotomic Iwasawa theory of elliptic curves

abstract: In this article, we study a relation between certain quotients of ideal class groups and the cyclotomic Iwasawa module $X_\infty$ of the Pontrjagin dual of the fine Selmer group of an elliptic curve $E$ defined over $\mathbb{Q}$. We consider the Galois extension field $K^E_n$ of $\mathbb{Q}$ generated by coordinates of all $p^n$-torsion points of $E$, and introduce a quotient $A^E_n$ of the $p$-sylow subgroup of the ideal class group of $K^E_n$ cut out by the modulo $p^n$ Galois representation $E[p^n]$. We describe the asymptotic behavior of $A^E_n$ by using the Iwasawa module $X_\infty$. In particular, under certain conditions, we obtain an asymptotic formula as Iwasawa's class number formula on the order of $A^E_n$ by using Iwasawa's invariants of $X_\infty$.


title: Disentangling the Impacts of Language and Channel Variability on Speech Separation Networks

abstract: Because the performance of speech separation is excellent for speech in which two speakers completely overlap, research attention has been shifted to dealing with more realistic scenarios. However, domain mismatch between training/test situations due to factors, such as speaker, content, channel, and environment, remains a severe problem for speech separation. Speaker and environment mismatches have been studied in the existing literature. Nevertheless, there are few studies on speech content and channel mismatches. Moreover, the impacts of language and channel in these studies are mostly tangled. In this study, we create several datasets for various experiments. The results show that the impacts of different languages are small enough to be ignored compared to the impacts of different channels. In our experiments, training on data recorded by Android phones leads to the best generalizability. Moreover, we provide a new solution for channel mismatch by evaluating projection, where the channel similarity can be measured and used to effectively select additional training data to improve the performance of in-the-wild test data.


title: An Iterative Co-Training Transductive Framework for Zero Shot Learning

abstract: In zero-shot learning (ZSL) community, it is generally recognized that transductive learning performs better than inductive one as the unseen-class samples are also used in its training stage. How to generate pseudo labels for unseen-class samples and how to use such usually noisy pseudo labels are two critical issues in transductive learning. In this work, we introduce an iterative co-training framework which contains two different base ZSL models and an exchanging module. At each iteration, the two different ZSL models are co-trained to separately predict pseudo labels for the unseen-class samples, and the exchanging module exchanges the predicted pseudo labels, then the exchanged pseudo-labeled samples are added into the training sets for the next iteration. By such, our framework can gradually boost the ZSL performance by fully exploiting the potential complementarity of the two models' classification capabilities. In addition, our co-training framework is also applied to the generalized ZSL (GZSL), in which a semantic-guided OOD detector is proposed to pick out the most likely unseen-class samples before class-level classification to alleviate the bias problem in GZSL. Extensive experiments on three benchmarks show that our proposed methods could significantly outperform about $31$ state-of-the-art ones.


title: Remote Co-teaching in Rural Classroom: Current Practices, Impacts, and Challenges

abstract: The shortage of high-quality teachers is one of the biggest educational problems faced by underdeveloped areas. With the development of information and communication technologies (ICTs), China has begun a remote co-teaching intervention program using ICTs for rural classes, forming a unique co-teaching classroom. We conducted semi-structured interviews with nine remote urban teachers and twelve local rural teachers. We identified the remote co-teaching classes standard practices and co-teachers collaborative work process. We also found that remote teachers high-quality class directly impacted local teachers and students. Furthermore, interestingly, local teachers were also actively involved in making indirect impacts on their students by deeply coordinating with remote teachers and adapting the resources offered by the remote teachers. We conclude by summarizing and discussing the challenges faced by teachers, lessons learned from the current program, and related design implications to achieve a more adaptive and sustainable ICT4D program design.


title: Integration of Radar Sensing into Communications with Asynchronous Transceivers

abstract: Clock asynchronism is a critical issue in integrating radar sensing into communication networks. It can cause ranging ambiguity and prevent coherent processing of dis-continuous measurements in integration with asynchronous transceivers. Should it be resolved, sensing can be efficiently realized in communication networks, requiring little network infrastructure and hardware changes. This article provides a systematic overview of existing and potential new techniques for tackling this fundamental problem. We first review existing solutions, including using a fine-tuned global reference clock, and single-node-based and network-based techniques. We then examine open problems and research opportunities, offering insights into what may be better realized in each of the three solution areas.


title: mpiQulacs: A Distributed Quantum Computer Simulator for A64FX-based Cluster Systems

abstract: Quantum computer simulators running on classical computers are essential for developing real quantum computers and emerging quantum applications. In particular, state vector simulators, which store a full state vector in memory and update it in every quantum operation, are available to simulate an arbitrary form of quantum circuits, debug quantum applications, and validate future quantum computers. However, the time and space complexity grows exponentially with the number of qubits and easily exceeds the capability of a single machine. Therefore, we develop a distributed state vector simulator, $mpiQulacs$, that is optimized for large-scale simulation on A64FX-based cluster systems. A64FX is an ARM-based CPU that is also equipped in the world's top Fugaku supercomputer. We evaluate weak and strong scaling of mpiQulacs with up to 36 qubits on a new 64-node A64FX-based cluster system named $Todoroki$. By comparing mpiQulacs with existing distributed state vector simulators, we show that mpiQulacs achieves the highest performance for large-scale simulation on tens of nodes while sustaining a nearly ideal scalability. Besides, we define a new metric, $quantum B/F ratio$, and use it to demonstrate that mpiQulacs running on Todoroki fits the requirements of distributed state vector simulation rather than the existing simulators running on general purpose CPU-based or GPU-based cluster systems.


title: Threshold Matters in WSSS: Manipulating the Activation for the Robust and Accurate Segmentation Model Against Thresholds

abstract: Weakly-supervised semantic segmentation (WSSS) has recently gained much attention for its promise to train segmentation models only with image-level labels. Existing WSSS methods commonly argue that the sparse coverage of CAM incurs the performance bottleneck of WSSS. This paper provides analytical and empirical evidence that the actual bottleneck may not be sparse coverage but a global thresholding scheme applied after CAM. Then, we show that this issue can be mitigated by satisfying two conditions; 1) reducing the imbalance in the foreground activation and 2) increasing the gap between the foreground and the background activation. Based on these findings, we propose a novel activation manipulation network with a per-pixel classification loss and a label conditioning module. Per-pixel classification naturally induces two-level activation in activation maps, which can penalize the most discriminative parts, promote the less discriminative parts, and deactivate the background regions. Label conditioning imposes that the output label of pseudo-masks should be any of true image-level labels; it penalizes the wrong activation assigned to non-target classes. Based on extensive analysis and evaluations, we demonstrate that each component helps produce accurate pseudo-masks, achieving the robustness against the choice of the global threshold. Finally, our model achieves state-of-the-art records on both PASCAL VOC 2012 and MS COCO 2014 datasets.


title: Infrared-Shielding of Plasmonic Random Metasurface Constructed by Cesium-Doped Tungsten Bronze

abstract: The heat-shielding properties of random metasurface, composed of spherical or spheroidal nanoparticles with random displacements and/or random deformation, were theoretically investigated using the finite difference time domain method. The effective coverage was defined using the total area of nanoparticles in the metasurface, and the robustness of the near-infrared light reflection against randomness was investigated. When the effective coverage was high, the near-infrared light reflection was reduced by at least 20% in both nanoparticle arrangement and shape randomness compared to the hexagonal close-packed perfect metasurface. In contrast, when effective coverage was low, the randomness of the nanoparticle arrangement had almost no effect on the near-infrared light reflection. Furthermore, the near-infrared light reflection performance was improved by the randomness of the nanoparticle shape.


title: $q$-Rational Reduction and $q$-Analogues of Series for $\pi$

abstract: In this paper, we present a $q$-analogue of the polynomial reduction which was originally developed for hypergeometric terms. Using the $q$-Gosper representation, we describe the structure of rational functions that are summable when multiplied with a given $q$-hypergeometric term. The structure theorem enables us to generalize the $q$-polynomial reduction to the rational case, which can be used in the automatic proof and discovery of $q$-identities. As applications, several $q$-analogues of series for $\pi$ are presented.


title: Nonequilibrium Statistical Mechanics and Optimal Prediction of Partially-Observed Complex Systems

abstract: Only a subset of degrees of freedom are typically accessible or measurable in real-world systems. As a consequence, the proper setting for empirical modeling is that of partially-observed systems. Notably, data-driven models consistently outperform physics-based models for systems with few observable degrees of freedom; e.g., hydrological systems. Here, we provide an operator-theoretic explanation for this empirical success. To predict a partially-observed system's future behavior with physics-based models, the missing degrees of freedom must be explicitly accounted for using data assimilation and model parametrization. Data-driven models, in contrast, employ delay-coordinate embeddings and their evolution under the Koopman operator to implicitly model the effects of the missing degrees of freedom. We describe in detail the statistical physics of partial observations underlying data-driven models using novel Maximum Entropy and Maximum Caliber measures. The resulting nonequilibrium Wiener projections applied to the Mori-Zwanzig formalism reveal how data-driven models may converge to the true dynamics of the observable degrees of freedom. Additionally, this framework shows how data-driven models infer the effects of unobserved degrees of freedom implicitly, in much the same way that physics models infer the effects explicitly. This provides a unified implicit-explicit modeling framework for predicting partially-observed systems, with hybrid physics-informed machine learning methods combining implicit and explicit aspects.


title: Compact hyperbolic Coxeter five-dimensional polytopes with nine facets

abstract: In this paper, we obtain a complete classification of compact hyperbolic Coxeter five-dimensional polytopes with nine facets.


title: The restriction problem on the ellipsoid

abstract: Following a restriction argument in the Euclidean space, we derive a geometric invariant formula for a possible viscosity operator for an incompressible fluid flow on an ellipsoid embedded in $\mathbb R^3$. We also give an asymptotic expansion of the formula in terms of the eccentricity associated with the ellipsoid.


title: Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion Prediction

abstract: This paper presents a high-quality human motion prediction method that accurately predicts future human poses given observed ones. Our method is based on the observation that a good initial guess of the future poses is very helpful in improving the forecasting accuracy. This motivates us to propose a novel two-stage prediction framework, including an init-prediction network that just computes the good guess and then a formal-prediction network that predicts the target future poses based on the guess. More importantly, we extend this idea further and design a multi-stage prediction framework where each stage predicts initial guess for the next stage, which brings more performance gain. To fulfill the prediction task at each stage, we propose a network comprising Spatial Dense Graph Convolutional Networks (S-DGCN) and Temporal Dense Graph Convolutional Networks (T-DGCN). Alternatively executing the two networks helps extract spatiotemporal features over the global receptive field of the whole pose sequence. All the above design choices cooperating together make our method outperform previous approaches by large margins: 6%-7% on Human3.6M, 5%-10% on CMU-MoCap, and 13%-16% on 3DPW.


title: Review of Twisted Poincare Symmetry

abstract: This article reviews the construction and some applications of twisted Poincare-covariant quantum fields on the Moyal plane. The Drinfeld twist, which plays a key mathematical role in this construction, is then applied to the case of discrete groups, with a view to applications to geons in quantum gravity. The Poincare-twisted fields can also be applied to study the CMB anisotropies, and corrections to the power spectrum are used to put constraints on spacetime noncommutativity. The article also addresses the issue of the difference between Moyal and Voros quantum fields. Finally, it is pointed out that the Euclidean functional integrals of QFTs on the Moyal plane do not, in general, obey reflection positivity.


title: Matrix Multiplication with Less Arithmetic Complexity and IO Complexity

abstract: After Strassen presented the first sub-cubic matrix multiplication algorithm, many Strassen-like algorithms are presented. Most of them with low asymptotic cost have large hidden leading coefficient which are thus impractical. To reduce the leading coefficient, Cenk and Hasan give a general approach reducing the leading coefficient of $<2,2,2;7>$-algorithm to $5$ but increasing IO complexity. In 2017, Karstadt and Schwartz also reduce the leading coefficient of $<2,2,2;7>$-algorithm to $5$ by the Alternative Basis Matrix Multiplication method. Meanwhile, their method reduces the IO complexity and low-order monomials in arithmetic complexity. In 2019, Beniamini and Schwartz generalize Alternative Basis Matrix Multiplication method reducing leading coefficient in arithmetic complexity but increasing IO complexity. In this paper, we propose a new matrix multiplication algorithm which reduces leading coefficient both in arithmetic complexity and IO complexity. We apply our method to Strassen-like algorithms improving arithmetic complexity and IO complexity (the comparison with previous results are shown in Tables 1 and 2). Surprisingly, our IO complexity of $<3,3,3;23>$-algorithm is $14n^{\log_323}M^{-\frac{1}{2}} + o(n^{\log_323})$ which breaks Ballard's IO complexity low bound ($\Omega(n^{\log_323}M^{1-\frac{\log_323}{2}})$) for recursive Strassen-like algorithms.


title: Coarse-to-Fine Recursive Speech Separation for Unknown Number of Speakers

abstract: The vast majority of speech separation methods assume that the number of speakers is known in advance, hence they are specific to the number of speakers. By contrast, a more realistic and challenging task is to separate a mixture in which the number of speakers is unknown. This paper formulates the speech separation with the unknown number of speakers as a multi-pass source extraction problem and proposes a coarse-to-fine recursive speech separation method. This method comprises two stages, namely, recursive cue extraction and target speaker extraction. The recursive cue extraction stage determines how many computational iterations need to be performed and outputs a coarse cue speech by monitoring statistics in the mixture. As the number of recursive iterations increases, the accumulation of distortion eventually comes into the extracted speech and reminder. Therefore, in the second stage, we use a target speaker extraction network to extract a fine speech based on the coarse target cue and the original distortionless mixture. Experiments show that the proposed method archived state-of-the-art performance on the WSJ0 dataset with a different number of speakers. Furthermore, it generalizes well to an unseen large number of speakers.


title: Benchmarking Structural Evolution Methods for Training of Machine Learned Interatomic Potentials

abstract: When creating training data for machine-learned interatomic potentials (MLIPs), it is common to create initial structures and evolve them using molecular dynamics to sample a larger configuration space. We benchmark two other modalities of evolving structures, contour exploration and dimer-method searches against molecular dynamics for their ability to produce diverse and robust training density functional theory data sets for MLIPs. We also discuss the generation of initial structures which are either from known structures or from random structures in detail to further formalize the structure-sourcing processes in the future. The polymorph-rich zirconium-oxygen composition space is used as a rigorous benchmark system for comparing the performance of MLIPs trained on structures generated from these structural evolution methods. Using Behler-Parrinello neural networks as our machine-learned interatomic potential models, we find that contour exploration and the dimer-method searches are generally superior to molecular dynamics in terms of spatial descriptor diversity and statistical accuracy.


title: Automatic Facial Skin Feature Detection for Everyone

abstract: Automatic assessment and understanding of facial skin condition have several applications, including the early detection of underlying health problems, lifestyle and dietary treatment, skin-care product recommendation, etc. Selfies in the wild serve as an excellent data resource to democratize skin quality assessment, but suffer from several data collection challenges.The key to guaranteeing an accurate assessment is accurate detection of different skin features. We present an automatic facial skin feature detection method that works across a variety of skin tones and age groups for selfies in the wild. To be specific, we annotate the locations of acne, pigmentation, and wrinkle for selfie images with different skin tone colors, severity levels, and lighting conditions. The annotation is conducted in a two-phase scheme with the help of a dermatologist to train volunteers for annotation. We employ Unet++ as the network architecture for feature detection. This work shows that the two-phase annotation scheme can robustly detect the accurate locations of acne, pigmentation, and wrinkle for selfie images with different ethnicities, skin tone colors, severity levels, age groups, and lighting conditions.


title: Self-supervised 360$^{\circ}$ Room Layout Estimation

abstract: We present the first self-supervised method to train panoramic room layout estimation models without any labeled data. Unlike per-pixel dense depth that provides abundant correspondence constraints, layout representation is sparse and topological, hindering the use of self-supervised reprojection consistency on images. To address this issue, we propose Differentiable Layout View Rendering, which can warp a source image to the target camera pose given the estimated layout from the target image. As each rendered pixel is differentiable with respect to the estimated layout, we can now train the layout estimation model by minimizing reprojection loss. Besides, we introduce regularization losses to encourage Manhattan alignment, ceiling-floor alignment, cycle consistency, and layout stretch consistency, which further improve our predictions. Finally, we present the first self-supervised results on ZilloIndoor and MatterportLayout datasets. Our approach also shows promising solutions in data-scarce scenarios and active learning, which would have an immediate value in the real estate virtual tour software. Code is available at https://github.com/joshua049/Stereo-360-Layout.


title: Measuring Miner Decentralization in Proof-of-Work Blockchains

abstract: Proof of work cryptocurrencies began with the promise of a more egalitarian future with a decentralized monetary system with no powerful entities in charge. While this vision is far from realized, these cryptocurrencies are still touted to be much more decentralized than traditional centralized systems. While it is well understood that cryptocurrencies are centralized, it is still unclear what the underlying causes are. This work aims to address this gap and examines some of the forces behind mining centralization. The internals of cryptocurrency mining is very opaque and difficult to study since it traditionally requires forming relationships with miners, who are typically reticent to share internal information about their competitive advantages. This work takes a different approach by combining large-scale statistical techniques with publicly available blockchain data in order to answer previously intractable questions. The crux of our analysis technique is based on the simple observation that some miners can utilize their hashpower more efficiently due to their position in the network. By teasing out that effect, we de-bias the mining power distribution to get a more accurate estimate. Using that de-biased mining power distribution, we can answer questions about the network position of miners in each cryptocurrency network. Finally, during the course of this study, we observed some unusual mining behaviors which we highlight.


title: Axial U(1) symmetry at high temperatures in $N_f=2+1$ lattice QCD with chiral fermions

abstract: We study the $U(1)_A$ anomaly in the high-temperature phase of $N_f=2+1$ lattice QCD with chiral fermions. Gauge ensembles are generated with M\"obius domain-wall (MDW) fermions, and in the measurements the determinant is reweighted to that of overlap fermions. We report the results for the overlap Dirac spectrum, $U(1)_A$ susceptibility, and topological susceptibility at $T=204$ and $175$ MeV.


title: Understanding Graph Convolutional Networks for Text Classification

abstract: Graph Convolutional Networks (GCN) have been effective at tasks that have rich relational structure and can preserve global structure information of a dataset in graph embeddings. Recently, many researchers focused on examining whether GCNs could handle different Natural Language Processing tasks, especially text classification. While applying GCNs to text classification is well-studied, its graph construction techniques, such as node/edge selection and their feature representation, and the optimal GCN learning mechanism in text classification is rather neglected. In this paper, we conduct a comprehensive analysis of the role of node and edge embeddings in a graph and its GCN learning techniques in text classification. Our analysis is the first of its kind and provides useful insights into the importance of each graph node/edge construction mechanism when applied at the GCN training/testing in different text classification benchmarks, as well as under its semi-supervised environment.


title: Origin of Perpendicular Magnetic Anisotropy in Co$_x$Fe$_{3-x}$O$_{4+\delta}$ Thin Films Studied by X-ray Magnetic Circular and Linear Dichroisms

abstract: We investigate the element-specific spin and orbital states and their roles on magnetic anisotropy in the Co-ferrite (Co$_x$Fe$_{3-x}$O$_{4+\delta}$ (001)) thin films which exhibit perpendicular magnetic anisotropy (PMA). The origin of PMA in the low $x$ region ($x$ $<$ 1) can be mainly explained by the large perpendicular orbital magnetic moments in the Co$^{2+}$ (3$d^7$) states detected by X-ray magnetic circular and linear dichroisms (XMCD/XMLD). The XMLD for a PMA film ($x=0.2$) with square hysteresis curve shows the oblate charge distribution in the Co$^{2+}$ site, which is consistent with the change in local nearest neighbor distance in Co detected by extended X-ray absorption fine structure analysis. Our finding reveals that the microscopic origin of PMA in Co-ferrite comes from the enhanced orbital magnetic moments along out-of-plane [001] direction through in-plane charge distribution by tensile strain, which adds the material functionalities in spinel ferrite thin films from the viewpoint of strain and orbital magnetic moments.


title: AxIoU: An Axiomatically Justified Measure for Video Moment Retrieval

abstract: Evaluation measures have a crucial impact on the direction of research. Therefore, it is of utmost importance to develop appropriate and reliable evaluation measures for new applications where conventional measures are not well suited. Video Moment Retrieval (VMR) is one such application, and the current practice is to use R@$K,\theta$ for evaluating VMR systems. However, this measure has two disadvantages. First, it is rank-insensitive: It ignores the rank positions of successfully localised moments in the top-$K$ ranked list by treating the list as a set. Second, it binarizes the Intersection over Union (IoU) of each retrieved video moment using the threshold $\theta$ and thereby ignoring fine-grained localisation quality of ranked moments. We propose an alternative measure for evaluating VMR, called Average Max IoU (AxIoU), which is free from the above two problems. We show that AxIoU satisfies two important axioms for VMR evaluation, namely, \textbf{Invariance against Redundant Moments} and \textbf{Monotonicity with respect to the Best Moment}, and also that R@$K,\theta$ satisfies the first axiom only. We also empirically examine how AxIoU agrees with R@$K,\theta$, as well as its stability with respect to change in the test data and human-annotated temporal boundaries.


title: Pay Attention to Hidden States for Video Deblurring: Ping-Pong Recurrent Neural Networks and Selective Non-Local Attention

abstract: Video deblurring models exploit information in the neighboring frames to remove blur caused by the motion of the camera and the objects. Recurrent Neural Networks~(RNNs) are often adopted to model the temporal dependency between frames via hidden states. When motion blur is strong, however, hidden states are hard to deliver proper information due to the displacement between different frames. While there have been attempts to update the hidden states, it is difficult to handle misaligned features beyond the receptive field of simple modules. Thus, we propose 2 modules to supplement the RNN architecture for video deblurring. First, we design Ping-Pong RNN~(PPRNN) that acts on updating the hidden states by referring to the features from the current and the previous time steps alternately. PPRNN gathers relevant information from the both features in an iterative and balanced manner by utilizing its recurrent architecture. Second, we use a Selective Non-Local Attention~(SNLA) module to additionally refine the hidden state by aligning it with the positional information from the input frame feature. The attention score is scaled by the relevance to the input feature to focus on the necessary information. By paying attention to hidden states with both modules, which have strong synergy, our PAHS framework improves the representation powers of RNN structures and achieves state-of-the-art deblurring performance on standard benchmarks and real-world videos.


title: Probabilistic Parameter Estimation Using a Gaussian Mixture Density Network: Application to X-ray Reflectivity Data Curve Fitting

abstract: X-ray reflectivity (XRR) is widely used for thin-film structure analysis, and XRR data analysis involves minimizing the difference between an XRR curve calculated from model parameters describing the thin-film structure. This analysis takes a certain amount of time because it involves many unavoidable iterations. However, the recently introduced artificial neural network (ANN) method can dramatically reduce the analysis time in the case of repeated analyses of similar samples. Here, we demonstrate the analysis of XRR data using a mixture density network (MDN), which enables probabilistic prediction while maintaining the advantages of an ANN. First, under the assumption of a unimodal probability distribution of the output parameter, the trained MDN can estimate the best-fit parameter and, at the same time, estimate the confidence interval (CI) corresponding to the error bar of the best-fit parameter. The CI obtained in this manner is similar to that obtained using the Neumann process, a well-known statistical method. Next, the MDN method provides several possible solutions for each parameter in the case of a multimodal distribution of the output parameters. An unsupervised machine learning method is used to cluster possible parameter sets in order of high probability. Determining the true value by examining the candidates of the parameter sets obtained in this manner can help solve the inherent inverse problem associated with scattering data.


title: Shock Hugoniot of diamond from 3 to 80 TPa

abstract: The principal Hugoniot of carbon, initially diamond, was measured from 3 to 80 TPa (30 to 800 million atmospheres), the highest pressure ever achieved, using radiography of spherically-converging shocks. The shocks were generated by ablation of a plastic coating by soft x-rays in a laser-heated hohlraum at the National Ignition Facility (NIF). Experiments were performed with low and high drive powers, spanning different but overlapping pressure ranges. The radius-time history of the shock, and the profile of mass density behind, were determined by profile-matching from a time-resolved x-ray radiograph across the diameter of the sphere. Above ~50 TPa, the heating induced by the shock was great enough to ionize a significant fraction of K-shell electrons, reducing the opacity to the 10.2 keV probe x-rays. The opacity and mass density were deduced simultaneously using the constraint that the total mass of the sample was constant. The Hugoniot and opacity were consistent with density functional theory calculations of the electronic states and equation of state (EOS), and varied significantly from theoretical Hugoniots based on Thomas-Fermi theory. Theoretical models used to predict the compressibility of diamond ablator experiments at the NIF, producing the highest neutron yields so far from inertial confinement fusion experiments, are qualitatively consistent with our EOS measurements but appear to overpredict the compressibility slightly. These measurements help to evaluate theoretical techniques and constrain wide-range EOS models applicable to white dwarf stars, which are the ultimate evolutionary form of at least 97% of stars in the galaxy.


title: First-passage time of run-and-tumble particles with non-instantaneous resetting

abstract: We study the statistics of the first-passage time of a single run and tumble particle (RTP) in one spatial dimension, with or without resetting, to a fixed target located at $L>0$. First, we compute the first-passage time distribution of a free RTP, without resetting nor in a confining potential, but averaged over the initial position drawn from an arbitrary distribution $p(x)$. Recent experiments used a non-instantaneous resetting protocol that motivated us to study in particular the case where $p(x)$ corresponds to the stationary non-Boltzmann distribution of an RTP in the presence of a harmonic trap. This distribution $p(x)$ is characterized by a parameter $\nu>0$, which depends on the microscopic parameters of the RTP dynamics. We show that the first-passage time distribution of the free RTP, drawn from this initial distribution, develops interesting singular behaviours, depending on the parameter $\nu$. We then switch on resetting, mimicked by thermal relaxation of the RTP in the presence of a harmonic trap. Resetting leads to a finite mean first-passage time (MFPT) and we study this as a function of the resetting rate for different values of the parameters $\nu$ and $b = L/c$ where $c$ is the right edge of the initial distribution $p(x)$. In the diffusive limit of the RTP dynamics, we find a rich phase diagram in the $(b,\nu)$ plane, with an interesting re-entrance phase transition. Away from the diffusive limit, qualitatively similar rich behaviours emerge for the full RTP dynamics.


title: Decision-Focused Learning without Differentiable Optimization: Learning Locally Optimized Decision Losses

abstract: Decision-Focused Learning (DFL) is a paradigm for tailoring a predictive model to a downstream optimization task that uses its predictions in order to perform better on that specific task. The main technical challenge associated with DFL is that it requires being able to differentiate through the optimization problem, which is difficult due to discontinuous solutions and other challenges. Past work has largely gotten around this issue by handcrafting task-specific surrogates to the original optimization problem that provide informative gradients when differentiated through. However, the need to handcraft surrogates for each new task limits the usability of DFL. In addition, there are often no guarantees about the convexity of the resulting surrogates and, as a result, training a predictive model using them can lead to inferior local optima. In this paper, we do away with surrogates altogether and instead learn loss functions that capture task-specific information. To the best of our knowledge, ours is the first approach that entirely replaces the optimization component of decision-focused learning with a loss that is automatically learned. Our approach (a) only requires access to a black-box oracle that can solve the optimization problem and is thus generalizable, and (b) can be convex by construction and so can be easily optimized over. We evaluate our approach on three resource allocation problems from the literature and find that our approach outperforms learning without taking into account task structure in all three domains, and even hand-crafted surrogates from the literature.


title: Euler-symmetric complete intersection in projective space

abstract: Euler-symmetric projective varieties, introduced by Baohua Fu and Jun-Muk Hwang in 2020, are nondegenerate projective varieties admitting many $\mathbb{C}^{\times}$-actions of Euler type. They are quasi-homogeneous and uniquely determined by their fundamental forms at a general point. In this paper, we study complete intersections in projective spaces which are Euler-symmetric. It is proven that such varieties are complete intersections of hyperquadrics and the base locus of the second fundamental form at a general point is again a complete intersection.


title: A unified analysis framework for iterative parallel-in-time algorithms

abstract: Parallel-in-time integration has been the focus of intensive research efforts over the past two decades due to the advent of massively parallel computer architectures and the scaling limits of purely spatial parallelization. Various iterative parallel-in-time (PinT) algorithms have been proposed, like Parareal, PFASST, MGRIT, and Space-Time Multi-Grid (STMG). These methods have been described using different notations, and the convergence estimates that are available are difficult to compare. We describe Parareal, PFASST, MGRIT and STMG for the Dahlquist model problem using a common notation and give precise convergence estimates using generating functions. This allows us, for the first time, to directly compare their convergence. We prove that all four methods eventually converge super-linearly, and also compare them numerically. The generating function framework provides further opportunities to explore and analyze existing and new methods.


title: An Improved Greedy Algorithm for Subset Selection in Linear Estimation

abstract: In this paper, we consider a subset selection problem in a spatial field where we seek to find a set of k locations whose observations provide the best estimate of the field value at a finite set of prediction locations. The measurements can be taken at any location in the continuous field, and the covariance between the field values at different points is given by the widely used squared exponential covariance function. One approach for observation selection is to perform a grid discretization of the space and obtain an approximate solution using the greedy algorithm. The solution quality improves with a finer grid resolution but at the cost of increased computation. We propose a method to reduce the computational complexity, or conversely to increase solution quality, of the greedy algorithm by considering a search space consisting only of prediction locations and centroids of cliques formed by the prediction locations. We demonstrate the effectiveness of our proposed approach in simulation, both in terms of solution quality and runtime.


title: Learning Program Representations for Food Images and Cooking Recipes

abstract: In this paper, we are interested in modeling a how-to instructional procedure, such as a cooking recipe, with a meaningful and rich high-level representation. Specifically, we propose to represent cooking recipes and food images as cooking programs. Programs provide a structured representation of the task, capturing cooking semantics and sequential relationships of actions in the form of a graph. This allows them to be easily manipulated by users and executed by agents. To this end, we build a model that is trained to learn a joint embedding between recipes and food images via self-supervision and jointly generate a program from this embedding as a sequence. To validate our idea, we crowdsource programs for cooking recipes and show that: (a) projecting the image-recipe embeddings into programs leads to better cross-modal retrieval results; (b) generating programs from images leads to better recognition results compared to predicting raw cooking instructions; and (c) we can generate food images by manipulating programs via optimizing the latent code of a GAN. Code, data, and models are available online.


title: Depth estimation of tumor invasion in early gastric cancer using scattering of circularly polarized light: Monte Carlo Simulation study

abstract: Quantitative depth estimation of tumor invasion in early gastric cancer by scattering of circularly polarized light is computationally investigated using the Monte Carlo method. Using the optical parameters of the human stomach wall and its carcinoma, the intensity and circular polarization of light scattered from pseudo-healthy and cancerous tissues were calculated over a wide spectral range. Large differences in the circular polarization with opposite signs, together with the large intensity, are obtained at wavelengths 600 nm and 950 nm. At these two wavelengths, the sampling depth of the biological tissues can be modulated by tuning the detection angle. In bi-layered pseudo-tissues with a cancerous layer on a healthy layer and vice versa, the degree of circular polarization of scattered light shows systematic changes depending on the thickness and depth of the cancerous layer, which indicates the feasibility of in vivo quantitative estimation of cancer progression in early gastric cancer.


title: Explainability in Process Outcome Prediction: Guidelines to Obtain Interpretable and Faithful Models

abstract: Although a recent shift has been made in the field of predictive process monitoring to use models from the explainable artificial intelligence field, the evaluation still occurs mainly through performance-based metrics, thus not accounting for the actionability and implications of the explanations. In this paper, we define explainability through the interpretability of the explanations and the faithfulness of the explainability model in the field of process outcome prediction. The introduced properties are analysed along the event, case, and control flow perspective which are typical for a process-based analysis. This allows comparing inherently created explanations with post-hoc explanations. We benchmark seven classifiers on thirteen real-life events logs, and these cover a range of transparent and non-transparent machine learning and deep learning models, further complemented with explainability techniques. Next, this paper contributes a set of guidelines named X-MOP which allows selecting the appropriate model based on the event log specifications, by providing insight into how the varying preprocessing, model complexity and explainability techniques typical in process outcome prediction influence the explainability of the model.


title: An Efficient Anchor-free Universal Lesion Detection in CT-scans

abstract: Existing universal lesion detection (ULD) methods utilize compute-intensive anchor-based architectures which rely on predefined anchor boxes, resulting in unsatisfactory detection performance, especially in small and mid-sized lesions. Further, these default fixed anchor-sizes and ratios do not generalize well to different datasets. Therefore, we propose a robust one-stage anchor-free lesion detection network that can perform well across varying lesions sizes by exploiting the fact that the box predictions can be sorted for relevance based on their center rather than their overlap with the object. Furthermore, we demonstrate that the ULD can be improved by explicitly providing it the domain-specific information in the form of multi-intensity images generated using multiple HU windows, followed by self-attention based feature-fusion and backbone initialization using weights learned via self-supervision over CT-scans. We obtain comparable results to the state-of-the-art methods, achieving an overall sensitivity of 86.05% on the DeepLesion dataset, which comprises of approximately 32K CT-scans with lesions annotated across various body organs.


title: Event-triggered Observability: A Set-membership Perspective

abstract: This work attempts to discuss the observability of linear time-invariant systems with event-triggered measurements. A new notion of observability, namely, $\epsilon$-observability is defined with parameter $\epsilon$, which relates to the worst-case performance of inferring the initial state based on not only the received measurement but also the implicit information in the event-triggering conditions at no-event instants. A criterion is developed to test the proposed $\epsilon$-observability of discrete-time linear systems, based on which an iterative event-triggered set-membership observer is designed to evaluate a set containing all possible values of the state. The proposed set-membership observer is designed as the outer approximation of the ellipsoids predicted based on previous state estimates and the ellipsoids inferred by fusing the received measurement and communication conditions, which is optimal in the sense of trace at each step and is proved to be asymptotically bounded. The efficiency of the proposed event-triggered set-membership state observer is verified by numerical experiments.


title: A bound on the cosmic opacity of unparticles from the CMB temperature

abstract: Unparticle cosmology gives an unconventional outlook on the dark sector of cosmology, increasingly challenging $\Lambda\mbox{CDM}$ by $H_0$-tension. This model derives from a finite temperature broken conformal symmetry of radiation, described by a non-radiative correction with unknown sign in energy density. This symmetry breaking has a sign ambiguity, in which corrections about the IR fixed point are normal or tachyonic. While the first has been ruled out in a recent study, the latter possesses a late-time temperature $T_c\simeq 4\,T_{CMB}$ associated with $\Omega_{\cal U}\simeq 1$ ($\Omega_{\cal U} \simeq 10^4 \Omega_{CMB}$), where $T_{CMB}$ denotes the temperature of the Cosmic Microwave Background (CMB). Thus exposed to the enormous heat bath of unparticles, $T_{CMB}$ is constrained by the astronomical age of the Universe $T_{u,0}$. The relative temperature shift $\Delta T/T$ in any heat exchange to the CMB is hereby limited to the uncertainty of a few percent in $T_{u,0}$. This bounds the effective cross-section of unparticles interactions with CMB photons to $\sigma _{\gamma \mathcal{U}} \lesssim 10^{-40}\ \mbox{m}^2=10^{-3}\ \mbox{nb}$. Assuming a standard cross-section across the broadband mass and energy spectrum of unparticles, a more stringent bound $\sigma _{\gamma \mathcal{U}} \lesssim 10^{-3}\,\mbox{pb}$ derives from COBE-FIRAS constraints on spectral distortions. The first is midway of photon-neutrino $\sigma_{\gamma\nu}$ and photon-photon cross sections $\sigma_{\gamma\gamma}$, the second is on par with $\sigma_{\gamma\nu}$. These constraints put late-time unparticle cosmology, if present, at the edge of the standard model.


title: Novel topological phases of a semi-Dirac Chern insulator in presence of extended range hopping

abstract: We study topological properties and the topological phase transitions therein for a semi-Dirac Haldane model on a honeycomb lattice in presence of an extended range (third neighbour) hopping. While in the absence of a third neighbour hopping, $t_3$, the system exhibits gapless electronic spectrum, its presence creates an energy gap in the dispersion. However, the nature of the spectral gap, that is, whether it is trivial or topological needs to be ascertained. We find that the answer depends on the value of $t_3$, and its interplay with the value of the onsite potential that breaks the sublattice symmetry, namely, Semenoff mass ($\Delta$). To elucidate our findings on the topological phases, we demonstrate two kinds of phase diagrams using the available parameter space, one in which the phases are shown in the $\Delta$-$t_3$ plane, and the other one in a more familiar $\Delta$-$\phi$ plane ($\phi$ being the Haldane flux). The phase diagrams depict the presence of Chern insulating lobes comprising of Chern numbers $\pm2$ and $\pm1$ for certain values of $t_3$, along with trivial insulating regions (zero Chern number). Thus there are phase transitions from one topological regime to another which are characterized by abrupt changes in the values of the Chern number. To support the existence of the topological phases, we compute the counter-propagating chiral edge modes in a ribbon geometry. Finally, the anomalous Hall conductivity shows plateaus either at $e^2/h$ or $2e^2/h$ corresponding to these topological phases.


title: Tensor denoising of high-dimensional MRI data

abstract: The signal to noise ratio (SNR) fundamentally limits the information accessible by magnetic resonance imaging (MRI). This limitation has been addressed by a host of denoising techniques, recently including so-called MPPCA: Principal component analysis (PCA) of the signal followed by automated rank estimation, exploiting the Marchenko-Pastur (MP) distribution of noise singular values. Operating on matrices comprised by data-patches, this popular approach objectively identifies noise components and, ideally, allows noise to be removed without introducing artifacts such as image blurring or non-local averaging. The MPPCA rank estimation, however, relies on a large number of noise singular values relative to the number of signal components to avoid such ill effects. This condition is unlikely to be met when data-patches and therefore matrices are small, for example due to spatially varying noise. Here, we introduce tensor MPPCA (tMPPCA) for the purpose of denoising multidimensional data, for example from multi-contrast acquisitions. Rather than combining dimensions in matrices, tMPPCA utilizes each dimension of the multidimensional data's inherent tensor-structure to better characterize noise, and to recursively estimate signal components. Relative to matrix-based MPPCA, tMPPCA requires no additional assumptions, and comparing the two in a numerical phantom and a multi-TE diffusion MRI dataset, tMPPCA dramatically improves denoising performance. This is particularly true for small data-patches, which we believe will improve denoising in cases of spatially varying noise.


title: Volkov-Pankratov states in a 2d material: excited states of a structural soliton

abstract: We show that partial dislocations, defects that naturally arise in bilayer graphene, host an analogue of the mass inversion Volkov-Pankratov (VP) states, the spectrum of excited states at a topologically non-trivial interface. In contrast to the dislocation states arising from the change in valley Chern index, such states (i) exist both with and without an interlayer bias, i.e. for metallic as well as insulating bulk and (ii) have distinct electron and hole bound states, whose number is proportional to the dislocation width. Recently discovered at heterojunctions of 3d topological insulators, their existence at the partial dislocations of a 2d material opens a rich structural playground for their investigation, and we demonstrate that the dislocation type, i.e. screw or edge, as well as the dislocation width, both play a decisive role in the creation of a topological spectrum of exited states.


title: Asymmetric Proxy Loss for Multi-View Acoustic Word Embeddings

abstract: Acoustic word embeddings (AWEs) are discriminative representations of speech segments, and learned embedding space reflects the phonetic similarity between words. With multi-view learning, where text labels are considered as supplementary input, AWEs are jointly trained with acoustically grounded word embeddings (AGWEs). In this paper, we expand the multi-view approach into a proxy-based framework for deep metric learning by equating AGWEs with proxies. A simple modification in computing the similarity matrix allows the general pair weighting to formulate the data-to-proxy relationship. Under the systematized framework, we propose an asymmetric-proxy loss that combines different parts of loss functions asymmetrically while keeping their merits. It follows the assumptions that the optimal function for anchor-positive pairs may differ from one for anchor-negative pairs, and a proxy may have a different impact when it substitutes for different positions in the triplet. We present comparative experiments with various proxy-based losses including our asymmetric-proxy loss, and evaluate AWEs and AGWEs for word discrimination tasks on WSJ corpus. The results demonstrate the effectiveness of the proposed method.


title: On eigenfunctions and maximal cliques of generalised Paley graphs of square order

abstract: Let GP$(q^2,m)$ be the $m$-Paley graph defined on the finite field with order $q^2$. We study eigenfunctions and maximal cliques in generalised Paley graphs GP$(q^2,m)$, where $m \mid (q+1)$. In particular, we explicitly construct maximal cliques of size $\frac{q+1}{m}$ or $\frac{q+1}{m}+1$ in GP$(q^2,m)$, and show the weight-distribution bound on the cardinality of the support of an eigenfunction is tight for the smallest eigenvalue $-\frac{q+1}{m}$ of GP$(q^2,m)$. These new results extend the work of Baker et. al and Goryainov et al. on Paley graphs of square order. We also study the stability of the Erd\H{o}s-Ko-Rado theorem for GP$(q^2,m)$ (first proved by Sziklai).


title: Using Adapters to Overcome Catastrophic Forgetting in End-to-End Automatic Speech Recognition

abstract: Learning a set of tasks in sequence remains a challenge for artificial neural networks, which, in such scenarios, tend to suffer from Catastrophic Forgetting (CF). The same applies to End-to-End (E2E) Automatic Speech Recognition (ASR) models, even for monolingual tasks. In this paper, we aim to overcome CF for E2E ASR by inserting adapters, small architectures of few parameters which allow a general model to be fine-tuned to a specific task, into our model. We make these adapters task-specific, while regularizing the parameters of the model shared by all tasks, thus stimulating the model to fully exploit the adapters while keeping the shared parameters to work well for all tasks. Our method outperforms all baselines on two monolingual experiments while being more storage efficient and without requiring the storage of data from previous tasks.


title: Self-interaction in a cosmic dark fluid: The four-kernel rheological extension of the equations of state

abstract: We establish a new self-consistent model of coupling between the cosmic dark energy and dark matter in the framework of the rheological approach, which is based on the representation of the equations of state in terms of integral operators of the Volterra-type. We elaborate the so-called four-kernel model, in the framework of which both the dark energy and dark matter pressures are presented by two integrals containing the energy densities of the dark energy and dark matter. For the Volterra operators, the kernels of which are associated with the effects of fading memory, the corresponding isotropic homogeneous cosmological model is shown to be exactly integrable. We consider the classification of the model exact solutions, based on the analysis of roots of the characteristic polynomial associated with the key equation of the presented model. The scalars of the pressure and energy-density of the dark energy and dark matter, the Hubble function and acceleration parameter are presented explicitly as the functions of the dimensionless scale factor. The scale factor as the function of the cosmological time is found in quadratures and is described analytically, qualitatively and numerically. Asymptotic analysis allowed us to classify the models with respect to behavior typical for the Big Rip, Little Rip and Pseudo Rip (de Sitter type). Two intriguing exact cosmological solutions are discussed, which describe the super-exponential expansion and the symmetric bounce. New solutions are presented, which correspond to the quasi-periodic behavior of the state functions of the dark fluid and of the geometric characteristics of the Universe.


title: STRPM: A Spatiotemporal Residual Predictive Model for High-Resolution Video Prediction

abstract: Although many video prediction methods have obtained good performance in low-resolution (64$\sim$128) videos, predictive models for high-resolution (512$\sim$4K) videos have not been fully explored yet, which are more meaningful due to the increasing demand for high-quality videos. Compared with low-resolution videos, high-resolution videos contain richer appearance (spatial) information and more complex motion (temporal) information. In this paper, we propose a Spatiotemporal Residual Predictive Model (STRPM) for high-resolution video prediction. On the one hand, we propose a Spatiotemporal Encoding-Decoding Scheme to preserve more spatiotemporal information for high-resolution videos. In this way, the appearance details for each frame can be greatly preserved. On the other hand, we design a Residual Predictive Memory (RPM) which focuses on modeling the spatiotemporal residual features (STRF) between previous and future frames instead of the whole frame, which can greatly help capture the complex motion information in high-resolution videos. In addition, the proposed RPM can supervise the spatial encoder and temporal encoder to extract different features in the spatial domain and the temporal domain, respectively. Moreover, the proposed model is trained using generative adversarial networks (GANs) with a learned perceptual loss (LP-loss) to improve the perceptual quality of the predictions. Experimental results show that STRPM can generate more satisfactory results compared with various existing methods.


title: Combination of Time-domain, Frequency-domain, and Cepstral-domain Acoustic Features for Speech Commands Classification

abstract: In speech-related classification tasks, frequency-domain acoustic features such as logarithmic Mel-filter bank coefficients (FBANK) and cepstral-domain acoustic features such as Mel-frequency cepstral coefficients (MFCC) are often used. However, time-domain features perform more effectively in some sound classification tasks which contain non-vocal or weakly speech-related sounds. We previously proposed a feature called bit sequence representation (BSR), which is a time-domain binary acoustic feature based on the raw waveform. Compared with MFCC, BSR performed better in environmental sound detection and showed comparable accuracy performance in limited-vocabulary speech recognition tasks. In this paper, we propose a novel improvement BSR feature called BSR-float16 to represent floating-point values more precisely. We experimentally demonstrated the complementarity among time-domain, frequency-domain, and cepstral-domain features using a dataset called Speech Commands proposed by Google. Therefore, we used a simple back-end score fusion method to improve the final classification accuracy. The fusion results also showed better noise robustness.


title: A note on the large values of $|\zeta^{(\ell)}(1+{\rm i}t)|$

abstract: We investigate the large values of the derivatives of the Riemann zeta function $\zeta(s)$ on the 1-line. We give a larger lower bound for $\max_{t\in[T,2T]}|\zeta^{(\ell)}(1+{\rm i} t)|$, which improves the previous result established by Yang.


title: Polarized deep diffractive neural network for classification, generation, multiplexing and de-multiplexing of orbital angular momentum modes

abstract: The multiplexing and de-multiplexing of orbital angular momentum (OAM) beams are critical issues in optical communication. Optical diffractive neural networks have been introduced to perform classification, generation, multiplexing and de-multiplexing of OAM beams. However, conventional diffractive neural networks cannot handle OAM modes with a varying spatial distribution of polarization directions. Herein, we propose a polarized optical deep diffractive neural network that is designed based on the concept of rectangular micro-structure meta-material. Our proposed polarized optical diffractive neural network is trained to classify, generate, multiplex and de-multiplex polarized OAM beams.The simulation results show that our network framework can successfully classify 14 kinds of orthogonally polarized vortex beams and de-multiplex the hybrid OAM beams into Gauss beams at two, three and four spatial positions respectively. 6 polarized OAM beams with identical total intensity and 8 cylinder vector beams with different topology charges also have been classified effectively. Additionally, results reveal that the network can generate hybrid OAM beams with high quality and multiplex two polarized linear beams into 8 kinds of cylinder vector beams.


title: Kleene Star of the Primes is not Regular in Any Base

abstract: Let $P_b$ denote the primes expressed in base-$b$. In this note, we prove that $P_b^*$ is not regular. This strengthens a classical result that $P_b$ is not regular, due to Minsky and Papert in 1966.


title: Omni-DETR: Omni-Supervised Object Detection with Transformers

abstract: We consider the problem of omni-supervised object detection, which can use unlabeled, fully labeled and weakly labeled annotations, such as image tags, counts, points, etc., for object detection. This is enabled by a unified architecture, Omni-DETR, based on the recent progress on student-teacher framework and end-to-end transformer based object detection. Under this unified architecture, different types of weak labels can be leveraged to generate accurate pseudo labels, by a bipartite matching based filtering mechanism, for the model to learn. In the experiments, Omni-DETR has achieved state-of-the-art results on multiple datasets and settings. And we have found that weak annotations can help to improve detection performance and a mixture of them can achieve a better trade-off between annotation cost and accuracy than the standard complete annotation. These findings could encourage larger object detection datasets with mixture annotations. The code is available at https://github.com/amazon-research/omni-detr.


title: A simple suboptimal moving horizon estimation scheme with guaranteed robust stability

abstract: We propose a suboptimal moving horizon estimation (MHE) scheme for a general class of nonlinear systems. To this end, we consider an MHE formulation that optimizes over the trajectory of a robustly stable observer. Assuming that the observer admits a Lyapunov function, we show that this function is an M-step Lyapunov function for suboptimal MHE. The presented sufficient conditions can be easily verified in practice. We illustrate the practicability of the proposed suboptimal MHE scheme with a standard nonlinear benchmark example. Here, performing a single iteration is sufficient to significantly improve the observer's estimation results under valid theoretical guarantees.


title: A Continuum of Physics-Based Lithium-Ion Battery Models Reviewed

abstract: Physics-based electrochemical battery models derived from porous electrode theory are a very powerful tool for understanding lithium-ion batteries, as well as for improving their design and management. Different model fidelity, and thus model complexity, is needed for different applications. For example, in battery design we can afford longer computational times and the use of powerful computers, while for real-time battery control (e.g. in electric vehicles) we need to perform very fast calculations using simple devices. For this reason, simplified models that retain most of the features at a lower computational cost are widely used. Even though in the literature we often find these simplified models posed independently, leading to inconsistencies between models, they can actually be derived from more complicated models using a unified and systematic framework. In this review, we showcase this reductive framework, starting from a high-fidelity microscale model and reducing it all the way down to the Single Particle Model (SPM), deriving in the process other common models, such as the Doyle-Fuller-Newman (DFN) model. We also provide a critical discussion on the advantages and shortcomings of each of the models, which can aid model selection for a particular application. Finally, we provide an overview of possible extensions to the models, with a special focus on thermal models. Any of these extensions could be incorporated into the microscale model and the reductive framework re-applied to lead to a new generation of simplified, multi-physics models.


title: Global Tracking via Ensemble of Local Trackers

abstract: The crux of long-term tracking lies in the difficulty of tracking the target with discontinuous moving caused by out-of-view or occlusion. Existing long-term tracking methods follow two typical strategies. The first strategy employs a local tracker to perform smooth tracking and uses another re-detector to detect the target when the target is lost. While it can exploit the temporal context like historical appearances and locations of the target, a potential limitation of such strategy is that the local tracker tends to misidentify a nearby distractor as the target instead of activating the re-detector when the real target is out of view. The other long-term tracking strategy tracks the target in the entire image globally instead of local tracking based on the previous tracking results. Unfortunately, such global tracking strategy cannot leverage the temporal context effectively. In this work, we combine the advantages of both strategies: tracking the target in a global view while exploiting the temporal context. Specifically, we perform global tracking via ensemble of local trackers spreading the full image. The smooth moving of the target can be handled steadily by one local tracker. When the local tracker accidentally loses the target due to suddenly discontinuous moving, another local tracker close to the target is then activated and can readily take over the tracking to locate the target. While the activated local tracker performs tracking locally by leveraging the temporal context, the ensemble of local trackers renders our model the global view for tracking. Extensive experiments on six datasets demonstrate that our method performs favorably against state-of-the-art algorithms.


title: Beamforming Optimization for Active Intelligent Reflecting Surface-Aided SWIPT

abstract: In this paper, we study an active IRS-aided simultaneous wireless information and power transfer (SWIPT) system. Specifically, an active IRS is deployed to assist a multi-antenna access point (AP) to convey information and energy simultaneously to multiple single-antenna information users (IUs) and energy users (EUs). Two joint transmit and reflect beamforming optimization problems are investigated with different practical objectives. The first problem maximizes the weighted sum-power harvested by the EUs subject to individual signal-to-interference-plus-noise ratio (SINR) constraints at the IUs, while the second problem maximizes the weighted sum-rate of the IUs subject to individual energy harvesting (EH) constraints at the EUs. The optimization problems are non-convex and difficult to solve optimally. To tackle these two problems, we first rigorously prove that dedicated energy beams are not required for their corresponding semidefinite relaxation (SDR) reformulations and the SDR is tight for the first problem, thus greatly simplifying the AP precoding design. Then, by capitalizing on the techniques of alternating optimization (AO), SDR, and successive convex approximation (SCA), computationally efficient algorithms are developed to obtain suboptimal solutions of the resulting optimization problems. Simulation results demonstrate that, given the same total system power budget, significant performance gains in terms of operating range of wireless power transfer (WPT), total harvested energy, as well as achievable rate can be obtained by our proposed designs over benchmark schemes (especially the one adopting a passive IRS). Moreover, it is advisable to deploy an active IRS in the proximity of the users for the effective operation of WPT/SWIPT.


title: Computing critical points for algebraic systems defined by hyperoctahedral invariant polynomials

abstract: Let $\mathbb{K}$ be a field of characteristic zero and $\mathbb{K}[x_1, \dots, x_n]$ the corresponding multivariate polynomial ring. Given a sequence of $s$ polynomials $\mathbf{f} = (f_1, \dots, f_s)$ and a polynomial $\phi$, all in $\mathbb{K}[x_1, \dots, x_n]$ with $s<n$, we consider the problem of computing the set $W(\phi, \mathbf{f})$ of points at which $\mathbf{f}$ vanishes and the Jacobian matrix of $\mathbf{f}, \phi$ with respect to $x_1, \dots, x_n$ does not have full rank. This problem plays an essential role in many application areas. In this paper we focus on a case where the polynomials are all invariant under the action of the signed symmetric group $B_n$. We introduce a notion called {\em hyperoctahedral representation} to describe $B_n$-invariant sets. We study the invariance properties of the input polynomials to split $W(\phi, \mathbf{f})$ according to the orbits of $B_n$ and then design an algorithm whose output is a {hyperoctahedral representation} of $W(\phi, \mathbf{f})$. The runtime of our algorithm is polynomial in the total number of points described by the output.


title: OLxPBench: Real-time, Semantically Consistent, and Domain-specific are Essential in Benchmarking, Designing, and Implementing HTAP Systems

abstract: As real-time analysis of the new data become increasingly compelling, more organizations deploy Hybrid Transactional/Analytical Processing (HTAP) systems to support real-time queries on data recently generated by online transaction processing. This paper argues that real-time queries, semantically consistent schema, and domain-specific workloads are essential in benchmarking, designing, and implementing HTAP systems. However, most state-of-the-art and state-of-the-practice benchmarks ignore those critical factors. Hence, they are incommensurable and, at worst, misleading in benchmarking, designing, and implementing HTAP systems. This paper presents OLxPBench, a composite HTAP benchmark suite. OLxPBench proposes: (1) the abstraction of a hybrid transaction, performing a real-time query in-between an online transaction, to model widely-observed behavior pattern -- making a quick decision while consulting real-time analysis; (2) a semantically consistent schema to express the relationships between OLTP and OLAP schema; (3) the combination of domain-specific and general benchmarks to characterize diverse application scenarios with varying resource demands. Our evaluations justify the three design decisions of OLxPBench and pinpoint the bottlenecks of two mainstream distributed HTAP DBMSs. International Open Benchmark Council (BenchCouncil) sets up the OLxPBench homepage at https://www.benchcouncil.org/olxpbench/. Its source code is available from https://github.com/BenchCouncil/olxpbench.git.


abstract: In this paper we prove Strichartz estimates for the Dirac equation on asymptotically flat manifolds. The proof combines the weak dispersive estimates proved by the first two authors with the Strichartz and smoothing estimates for the wave and Klein-Gordon flows, exploiting some recent results in the same geometrical setting.


title: Neighbor Enhanced Graph Convolutional Networks for Node Classification and Recommendation

abstract: The recently proposed Graph Convolutional Networks (GCNs) have achieved significantly superior performance on various graph-related tasks, such as node classification and recommendation. However, currently researches on GCN models usually recursively aggregate the information from all the neighbors or randomly sampled neighbor subsets, without explicitly identifying whether the aggregated neighbors provide useful information during the graph convolution. In this paper, we theoretically analyze the affection of the neighbor quality over GCN models' performance and propose the Neighbor Enhanced Graph Convolutional Network (NEGCN) framework to boost the performance of existing GCN models. Our contribution is three-fold. First, we at the first time propose the concept of neighbor quality for both node classification and recommendation tasks in a general theoretical framework. Specifically, for node classification, we propose three propositions to theoretically analyze how the neighbor quality affects the node classification performance of GCN models. Second, based on the three proposed propositions, we introduce the graph refinement process including specially designed neighbor evaluation methods to increase the neighbor quality so as to boost both the node classification and recommendation tasks. Third, we conduct extensive node classification and recommendation experiments on several benchmark datasets. The experimental results verify that our proposed NEGCN framework can significantly enhance the performance for various typical GCN models on both node classification and recommendation tasks.


title: ALDO2, a multi-function rad-hard linear regulator for SiPM-based HEP detectors

abstract: ALDO2 is a multi-function, adjustable, low dropout linear regulator designed in onsemi I3T80 0.35~$\mu$m HV CMOS technology for use in HEP detectors that adopt silicon photomultipliers (SiPMs). The chip features four independent regulators, two low voltage channels (max 3.3 V) used to filter and stabilize the power supply of front-end chips, and two HV channels (max 70 V), specifically designed to provide the bias voltage to arrays of SiPMs. Each regulator can be independently shut down and is protected for over-current and over-temperature. The HV regulators also implement a circuit to monitor the bias current of the SiPM arrays, allowing to perform I-V curves and thus to fine-tune the working point of the SiPM arrays during the detector lifetime. The chip adopts radiation hardening techniques and has been fully qualified up to a TID of 20 Mrad, a 1-MeV-equivalent neutron fluence of $10^{15}$ cm$^{-2}$, and with heavy ions up to 40 MeV cm$^2$ mg$^{-1}$ LET and $10^{10}$ cm$^{-2}$ cumulative fluence. The chip will be installed in two CMS detectors in the HL-LHC phase, the Barrel Timing Detector (BTL) and the High Granularity Calorimeter (HGCAL).


title: Energy-Efficient IRS-Aided NOMA Beamforming for 6G Wireless Communications

abstract: This manuscript presents an energy-efficient alternating optimization framework based on intelligent reflective surfaces (IRS) aided non-orthogonal multiple access beamforming (NOMA-BF) system for 6G wireless communications. Specifically, this work proposes a centralized IRS-enabled design for the NOMA-BF system to optimize the active beamforming and power allocation coefficient (PAC) of users at the transmitter in the first stage and passive beamforming at IRS in the 2nd stage to maximize the energy efficiency (EE) of the network. However, an increment in the number of supportable users with the NOMA-BF system will lead to NOMA user interference and inter-cluster interference (ICI). To mitigate the effect of ICI, first zero-forcing beamforming along with efficient user clustering algorithm is exploited and then NOMA user interference is tackled efficiently through a proposed iterative algorithm that computes PAC of NOMA user through simplified closed-form expression under the required system constraints. In the 2nd stage, the problem of passive beamforming is solved through a technique based on difference-of-convex (DC) programming and successive convex approximation (SCA). Simulation results demonstrate that the proposed alternating framework for energy-efficient IRS-assisted NOMA-BF system can achieve convergence within a few iterations and provide efficient performance in terms of EE of the system with low complexity.


title: Adaptive Private-K-Selection with Adaptive K and Application to Multi-label PATE

abstract: We provide an end-to-end Renyi DP based-framework for differentially private top-$k$ selection. Unlike previous approaches, which require a data-independent choice on $k$, we propose to privately release a data-dependent choice of $k$ such that the gap between $k$-th and the $(k+1)$st "quality" is large. This is achieved by a novel application of the Report-Noisy-Max. Not only does this eliminate one hyperparameter, the adaptive choice of $k$ also certifies the stability of the top-$k$ indices in the unordered set so we can release them using a variant of propose-test-release (PTR) without adding noise. We show that our construction improves the privacy-utility trade-offs compared to the previous top-$k$ selection algorithms theoretically and empirically. Additionally, we apply our algorithm to "Private Aggregation of Teacher Ensembles (PATE)" in multi-label classification tasks with a large number of labels and show that it leads to significant performance gains.


title: All-optical determination of one or two emitters using quantum polarization with nitrogen-vacancy centers in diamond

abstract: Qubit technologies using nitrogen-vacancy color centers in diamonds require precise knowledge of the centers, including the number of emitters within a diffraction-limited spot and their orientations. However, the number of emitters is challenging to determine when there is finite background, which affects the precision of resulting quantum protocols. Here we show the photoluminescence (PL) intensity and quantum correlation (Hanbury Brown and Twiss) measurements as a function of polarization for one- and two-emitter systems. The sample was made by implanting low concentrations of adenine (C5H5N5) into a low nitrogen chemical vapor deposition diamond. This approach yielded well-spaced regions with few nitrogen-vacancy centers. By mapping the PL intensity and quantum correlation as a function of polarization, we can distinguish two emitter systems from single emitters with background, providing a method to quantify the background signal at implanted sites, which might be different from off-site background levels. This approach also provides a valuable new all-optical mechanism for the determination of one or two emitter systems useful for quantum sensing, communication, and computation tasks.


title: Continual Normalization: Rethinking Batch Normalization for Online Continual Learning

abstract: Existing continual learning methods use Batch Normalization (BN) to facilitate training and improve generalization across tasks. However, the non-i.i.d and non-stationary nature of continual learning data, especially in the online setting, amplify the discrepancy between training and testing in BN and hinder the performance of older tasks. In this work, we study the cross-task normalization effect of BN in online continual learning where BN normalizes the testing data using moments biased towards the current task, resulting in higher catastrophic forgetting. This limitation motivates us to propose a simple yet effective method that we call Continual Normalization (CN) to facilitate training similar to BN while mitigating its negative effect. Extensive experiments on different continual learning algorithms and online scenarios show that CN is a direct replacement for BN and can provide substantial performance improvements. Our implementation is available at \url{https://github.com/phquang/Continual-Normalization}.


title: Virtually expanding dynamics

abstract: We introduce a class of discrete dynamical systems that we call \emph{virtually expanding}. This is an open subset of self-covering maps on a closed manifold which contains all expanding maps and some partially hyperbolic volume-expanding maps. We show that the Perron-Frobenius operator is quasi-compact on a Sobolev space of positive order for such class of dynamical systems.


title: Improving Distortion Robustness of Self-supervised Speech Processing Tasks with Domain Adaptation

abstract: Speech distortions are a long-standing problem that degrades the performance of supervisely trained speech processing models. It is high time that we enhance the robustness of speech processing models to obtain good performance when encountering speech distortions while not hurting the original performance on clean speech. In this work, we propose to improve the robustness of speech processing models by domain adversarial training (DAT). We conducted experiments based on the SUPERB framework on five different speech processing tasks. In case we do not always have knowledge of the distortion types for speech data, we analyzed the binary-domain and multi-domain settings, where the former treats all distorted speech as one domain, and the latter views different distortions as different domains. In contrast to supervised training methods, we obtained promising results in target domains where speech data is distorted with different distortions including new unseen distortions introduced during testing.


title: A family of triangulated 3-spheres constructed from trees

abstract: The search for universality in random triangulations of manifolds, like those featuring in (Euclidean) Dynamical Triangulations, is central to the random geometry approach to quantum gravity. In case of the 3-sphere, or any other manifold of dimension greater than two for that matter, the pursuit is held back by serious challenges, including the wide open problem of enumerating triangulations. In an attempt to bypass the toughest challenges we identify a restricted family of triangulations, of which the enumeration appears less daunting. In a nutshell, the family consists of triangulated 3-spheres decorated with a pair of trees, one spanning its tetrahedra and the other its vertices, with the requirement that after removal of both trees one is left with a tree-like 2-complex. We prove that these are in bijection with a combinatorial family of triples of plane trees, satisfying restrictions that can be succinctly formulated at the level of planar maps. An important ingredient in the bijection is a step-by-step reconstruction of the triangulations from triples of trees, that results in a natural subset of the so-called locally constructible triangulations, for which spherical topology is guaranteed, through a restriction of the allowed moves. We also provide an alternative characterization of the family in the framework of discrete Morse gradients. Finally, several exponential enumerative bounds are deduced from the triples of trees and some simulation results are presented.


title: Contribution of the Temperature of the Objects to the Problem of Thermal Imaging Focusing

abstract: When focusing an image, depth of field, aperture and distance from the camera to the object, must be taking into account, both, in visible and in infrared spectrum. Our experiments reveal that in addition, the focusing problem in thermal spectrum is also hardly dependent of the temperature of the object itself (and/or the scene).


title: Preliminary experiments on thermal emissivity adjustment for face images

abstract: In this paper we summarize several applications based on thermal imaging. We emphasize the importance of emissivity adjustment for a proper temperature measurement. A new set of face images acquired at different emissivity values with steps of 0.01 is also presented and will be distributed for free for research purposes. Among the utilities, we can mention: a) the possibility to apply corrections once an image is acquired with a wrong emissivity value and it is not possible to acquire a new one; b) privacy protection in thermal images, which can be obtained with a low emissivity factor, which is still suitable for several applications, but hides the identity of a user; c) image processing for improving temperature detection in scenes containing objects of different emissivity.


title: Optimal reinsurance design under solvency constraints

abstract: We consider the optimal risk transfer from an insurance company to a reinsurer. The problem formulation considered in this paper is closely connected to the optimal portfolio problem in finance, with some crucial distinctions. In particular, the insurance company's surplus is here (as is routinely the case) approximated by a Brownian motion, as opposed to the geometric Brownian motion used to model assets in finance. Furthermore, risk exposure is dialled "down" via reinsurance, rather than "up" via risky investments. This leads to interesting qualitative differences in the optimal designs. In this paper, using the martingale method, we derive the optimal design as a function of proportional, non-cheap reinsurance design that maximises the quadratic utility of the terminal value of the insurance surplus. We also consider several realistic constraints on the terminal value: a strict lower boundary, the probability (Value at Risk) constraint, and the expected shortfall (conditional Value at Risk) constraints under the $\mathbb{P}$ and $\mathbb{Q}$ measures, respectively. In all cases, the optimal reinsurance designs boil down to a combination of proportional protection and option-like protection (stop-loss) of the residual proportion with various deductibles. Proportions and deductibles are set such that the initial capital is fully allocated. Comparison of the optimal designs with the optimal portfolios in finance is particularly interesting. Results are illustrated.


title: Well-posedness of solutions to stochastic fluid-structure interaction

abstract: In this paper we introduce a constructive approach to study well-posedness of solutions to stochastic fluid-structure interaction with stochastic noise. We focus on a benchmark problem in stochastic fluid-structure interaction, and prove the existence of a unique weak solution in the probabilistically strong sense. The benchmark problem consists of the 2D time-dependent Stokes equations describing the flow of an incompressible, viscous fluid interacting with a linearly elastic membrane modeled by the 1D linear wave equation. The membrane is stochastically forced by the time-dependent white noise. The fluid and the structure are linearly coupled. The constructive existence proof is based on a time-discretization via an operator splitting approach. This introduces a sequence of approximate solutions, which are random variables. We show the existence of a subsequence of approximate solutions which converges, almost surely, to a weak solution in the probabilistically strong sense. The proof is based on uniform energy estimates in terms of the expectation of the energy norms, which are the backbone for a weak compactness argument giving rise to a weakly convergent subsequence of probability measures associated with the approximate solutions. Probabilistic techniques based on the Skorohod representation theorem and the Gy\"ongy-Krylov lemma are then employed to obtain almost sure convergence of a subsequence of the random approximate solutions to a weak solution in the probabilistically strong sense. The result shows that the deterministic benchmark FSI model is robust to stochastic noise, even in the presence of rough white noise in time. To the best of our knowledge, this is the first well-posedness result for fully coupled stochastic fluid-structure interaction.


title: Weakly-supervised Temporal Path Representation Learning with Contrastive Curriculum Learning -- Extended Version

abstract: In step with the digitalization of transportation, we are witnessing a growing range of path-based smart-city applications, e.g., travel-time estimation and travel path ranking. A temporal path(TP) that includes temporal information, e.g., departure time, into the path is fundamental to enable such applications. In this setting, it is essential to learn generic temporal path representations(TPRs) that consider spatial and temporal correlations simultaneously and that can be used in different applications, i.e., downstream tasks. Existing methods fail to achieve the goal since (i) supervised methods require large amounts of task-specific labels when training and thus fail to generalize the obtained TPRs to other tasks; (ii) through unsupervised methods can learn generic representations, they disregard the temporal aspect, leading to sub-optimal results. To contend with the limitations of existing solutions, we propose a Weakly-Supervised Contrastive (WSC) learning model. We first propose a temporal path encoder that encodes both the spatial and temporal information of a temporal path into a TPR. To train the encoder, we introduce weak labels that are easy and inexpensive to obtain and are relevant to different tasks, e.g., temporal labels indicating peak vs. off-peak hours from departure times. Based on the weak labels, we construct meaningful positive and negative temporal path samples by considering both spatial and temporal information, which facilities training the encoder using contrastive learning by pulling closer to the positive samples' representations while pushing away the negative samples' representations. To better guide contrastive learning, we propose a learning strategy based on Curriculum Learning such that the learning performs from easy to hard training instances. Experiments studies verify the effectiveness of the proposed method.


title: Generic Laplace eigenfunctions on metric graphs

abstract: It is known that up to certain pathologies, a compact metric graph with standard vertex conditions has a Baire-generic set of choices of edge lengths such that all Laplacian eigenvalues are simple and have eigenfunctions that do not vanish at the vertices. We provide a new notion of strong genericity, using subanalytic sets, that implies both Baire genericity and full Lebesgue measure. We show that the previous genericity results for metric graphs are strongly generic. In addition, we show that generically the derivative of an eigenfunction does not vanish at the vertices either. In fact, we show that generically an eigenfunction fails to satisfy any additional vertex condition. Finally, we show that any two different metric graphs with the same edge lengths do not share any non-zero eigenvalue, for a generic choice of lengths, except for a few explicit cases where the graphs have a common edge-reflection symmetry. The paper concludes by addressing three open conjectures for metric graphs that can benefit from the tools introduced in this paper.