title: An Information-Theoretic Analysis of The Cost of Decentralization for Learning and Inference Under Privacy Constraints

abstract: In vertical federated learning (FL), the features of a data sample are distributed across multiple agents. As such, inter-agent collaboration can be beneficial not only during the learning phase, as is the case for standard horizontal FL, but also during the inference phase. A fundamental theoretical question in this setting is how to quantify the cost, or performance loss, of decentralization for learning and/or inference. In this paper, we consider general supervised learning problems with any number of agents, and provide a novel information-theoretic quantification of the cost of decentralization in the presence of privacy constraints on inter-agent communication within a Bayesian framework. The cost of decentralization for learning and/or inference is shown to be quantified in terms of conditional mutual information terms involving features and label variables.


title: A Survey on Proactive Customer Care: Enabling Science and Steps to Realize it

abstract: In recent times, advances in artificial intelligence (AI) and IoT have enabled seamless and viable maintenance of appliances in home and building environments. Several studies have shown that AI has the potential to provide personalized customer support which could predict and avoid errors more reliably than ever before. In this paper, we have analyzed the various building blocks needed to enable a successful AI-driven predictive maintenance use-case. Unlike, existing surveys which mostly provide a deep dive into the recent AI algorithms for Predictive Maintenance (PdM), our survey provides the complete view; starting from business impact to recent technology advancements in algorithms as well as systems research and model deployment. Furthermore, we provide exemplar use-cases on predictive maintenance of appliances using publicly available data sets. Our survey can serve as a template needed to design a successful predictive maintenance use-case. Finally, we touch upon existing public data sources and provide a step-wise breakdown of an AI-driven proactive customer care (PCC) use-case, starting from generic anomaly detection to fault prediction and finally root-cause analysis. We highlight how such a step-wise approach can be advantageous for accurate model building and helpful for gaining insights into predictive maintenance of electromechanical appliances.


title: Quantum Squeezing Induced Optical Nonreciprocity

abstract: We propose an all-optical approach to achieve optical nonreciprocity on a chip by quantum squeezing one of two coupled resonator modes. By parametric pumping a nonlinear resonator unidirectionally with a classical coherent field, we squeeze the resonator mode in a selective direction due to the phase-matching condition, and induce a chiral photon interaction between two resonators. Based on this chiral interresonator coupling, we achieve an all-optical diode and a three-port quasi-circulator. By applying a second squeezed-vacuum field to the squeezed resonator mode, our nonreciprocal device also works for single-photon pulses. We obtain an isolation ratio of >40 dB for the diode and fidelity of $>98\%$ for the quasi-circulator, and insertion loss of <1 dB for both. We also show that nonreciprocal transmission of strong light can be switched on and off by a relative weak pump light. This achievement implies a nonreciprocal optical transistor. Our protocol opens up a new route to achieve integrable all-optical nonreciprocal devices permitting chip-compatible optical isolation and nonreciporcal quantum information processing.


title: On the magic square C*-algebra of size 4

abstract: In this paper, we investigate the structure of the magic square C*-algebra $A(4)$ of size 4. We show that a certain twisted crossed product of $A(4)$ is isomorphic to the homogeneous C*-algebra $M_4(C(\mathbb{R} P^3))$. Using this result, we show that $A(4)$ is isomorphic to the fixed point algebra of $M_4(C(\mathbb{R} P^3))$ by a certain action. From this concrete realization of $A(4)$, we compute the K-groups of $A(4)$ and their generators.


title: Time-varying Graph Learning Under Structured Temporal Priors

abstract: This paper endeavors to learn time-varying graphs by using structured temporal priors that assume underlying relations between arbitrary two graphs in the graph sequence. Different from many existing chain structure based methods in which the priors like temporal homogeneity can only describe the variations of two consecutive graphs, we propose a structure named \emph{temporal graph} to characterize the underlying real temporal relations. Under this framework, the chain structure is actually a special case of our temporal graph. We further proposed Alternating Direction Method of Multipliers (ADMM), a distributed algorithm, to solve the induced optimization problem. Numerical experiments demonstrate the superiorities of our method.


title: Novel triple barrier potential for axial gravitational perturbations of a family of Lorentzian wormholes

abstract: We study the behavior of a specific Lorentzian wormhole family under gravitational perturbations. In earlier work [EPJC 80, 850 (2020)], we have proved the stability of a test scalar field in the background of the wormhole family, where the effective potential was that of a double barrier. Continuing with the stability analysis, here we focus on the more physically relevant scenario, that of axial gravitational perturbations. Interestingly, we find that the effective potential is a triple barrier for lower angular momentum modes. This raises important questions on the ringdown of the corresponding wormhole geometry as well as the gravitational wave echo profile that we try to answer through our work. We study in detail how the geometry of each member wormhole affects the quasinormal modes, the time evolution of the signal as well as echoes which are, in general, very feeble in comparison to the main signal. Different `cleaning' techniques have been used to obtain the echo profile in the time evolution of the signal. Lastly, we dwell on the possibility of our wormhole family as a candidate black hole mimicker, as long as its stability is proven under all kinds of perturbations. We briefly present a comparison of the ringdown characteristics of these wormholes with that of a black hole, in support of this speculation.


title: MELONS: generating melody with long-term structure using transformers and structure graph

abstract: The creation of long melody sequences requires effective expression of coherent musical structure. However, there is no clear representation of musical structure. Recent works on music generation have suggested various approaches to deal with the structural information of music, but generating a full-song melody with clear long-term structure remains a challenge. In this paper, we propose MELONS, a melody generation framework based on a graph representation of music structure which consists of eight types of bar-level relations. MELONS adopts a multi-step generation method with transformer-based networks by factoring melody generation into two sub-problems: structure generation and structure conditional melody generation. Experimental results show that MELONS can produce structured melodies with high quality and rich contents.


title: Cross Domain Emotion Recognition using Few Shot Knowledge Transfer

abstract: Emotion recognition from text is a challenging task due to diverse emotion taxonomies, lack of reliable labeled data in different domains, and highly subjective annotation standards. Few-shot and zero-shot techniques can generalize across unseen emotions by projecting the documents and emotion labels onto a shared embedding space. In this work, we explore the task of few-shot emotion recognition by transferring the knowledge gained from supervision on the GoEmotions Reddit dataset to the SemEval tweets corpus, using different emotion representation methods. The results show that knowledge transfer using external knowledge bases and fine-tuned encoders perform comparably as supervised baselines, requiring minimal supervision from the task dataset.


title: Blockchain for Edge of Things: Applications, Opportunities, and Challenges

abstract: In recent years, blockchain networks have attracted significant attention in many research areas beyond cryptocurrency, one of them being the Edge of Things (EoT) that is enabled by the combination of edge computing and the Internet of Things (IoT). In this context, blockchain networks enabled with unique features such as decentralization, immutability, and traceability, have the potential to reshape and transform the conventional EoT systems with higher security levels. Particularly, the convergence of blockchain and EoT leads to a new paradigm, called BEoT that has been regarded as a promising enabler for future services and applications. In this paper, we present a state-of-the-art review of recent developments in BEoT technology and discover its great opportunities in many application domains. We start our survey by providing an updated introduction to blockchain and EoT along with their recent advances. Subsequently, we discuss the use of BEoT in a wide range of industrial applications, from smart transportation, smart city, smart healthcare to smart home and smart grid. Security challenges in BEoT paradigm are also discussed and analyzed, with some key services such as access authentication, data privacy preservation, attack detection, and trust management. Finally, some key research challenges and future directions are also highlighted to instigate further research in this promising area.


title: Online Graph Learning in Dynamic Environments

abstract: Inferring the underlying graph topology that characterizes structured data is pivotal to many graph-based models when pre-defined graphs are not available. This paper focuses on learning graphs in the case of sequential data in dynamic environments. For sequential data, we develop an online version of classic batch graph learning method. To better track graphs in dynamic environments, we assume graphs evolve in certain patterns such that dynamic priors might be embedded in the online graph learning framework. When the information of these hidden patterns is not available, we use history data to predict the evolution of graphs. Furthermore, dynamic regret analysis of the proposed method is performed and illustrates that our online graph learning algorithms can reach sublinear dynamic regret. Experimental results support the fact that our method is superior to the state-of-art methods.


title: Mass spectra and strong decays of charmed and charmed-strange mesons

abstract: A semi-relativistic potential model is adopted to calculate the mass spectra of charmed and charmed-strange meson states up to the $2D$ excitations.The strong decay properties are further analyzed with a chiral quark model by using the numerical wave functions obtained from the potential model. By using the strong decay amplitudes extracted from the chiral quark model, we also systematically study the coupled-channel effects on the bare masses of the $1P$-wave states, since the masses of $D^*_{s0}(2317)$ and $D_{s1}(2460)$ cannot be explained with bare $1P$-wave states within the potential model. Based on our good descriptions of the mass and decay properties for the low-lying well-established states, we give a quark model classification for the high mass resonances observed in recent years. In the $D$-meson family, $D_0(2550)$ can be classified as the radially excited state $D(2^1S_0)$; $D_3^*(2750)$ and $D_2(2740)$ can be classified as the second orbital excitations $D(1^3D_3)$ and $D(1D'_2)$, respectively; $D_J^*(3000)$ may be a candidate of $D(1^3F_4)$ or $D(2^3P_2)$; while $D_J(3000)$ may favor the high mass mixed state $D(2P'_1)$; however, there still exist puzzles for understanding the natures of $D_1^*(2600)$ and $D_1^*(2760)$, whose decay properties cannot be well explained with either pure $D(2^3S_1)$ and $D(1^3D_1)$ states or their mixing. In the $D_s$-meson family, $D_{s3}^*(2860)$ favors the $D_s(1^3D_3)$ assignment; $D_{s1}^*(2700)$ and $D_{s1}^*(2860)$ may favor the mixed states $|(SD)_1\rangle_L$ and $|(SD)_1\rangle_H$ via the $2^3S_1$-$1^3D_1$ mixing, respectively; $D_{sJ}(3040)$ may favor $D_s(2P_1)$ or $D_s(2P_1')$, or corresponds to a structure contributed by both $D_s(2P_1)$ and $D_s(2P_1')$.


title: Self-supervised Learning is More Robust to Dataset Imbalance

abstract: Self-supervised learning (SSL) is a scalable way to learn general visual representations since it learns without labels. However, large-scale unlabeled datasets in the wild often have long-tailed label distributions, where we know little about the behavior of SSL. In this work, we systematically investigate self-supervised learning under dataset imbalance. First, we find out via extensive experiments that off-the-shelf self-supervised representations are already more robust to class imbalance than supervised representations. The performance gap between balanced and imbalanced pre-training with SSL is significantly smaller than the gap with supervised learning, across sample sizes, for both in-domain and, especially, out-of-domain evaluation. Second, towards understanding the robustness of SSL, we hypothesize that SSL learns richer features from frequent data: it may learn label-irrelevant-but-transferable features that help classify the rare classes and downstream tasks. In contrast, supervised learning has no incentive to learn features irrelevant to the labels from frequent examples. We validate this hypothesis with semi-synthetic experiments and theoretical analyses on a simplified setting. Third, inspired by the theoretical insights, we devise a re-weighted regularization technique that consistently improves the SSL representation quality on imbalanced datasets with several evaluation criteria, closing the small gap between balanced and imbalanced datasets with the same number of examples.


title: Efficient broadband sound absorption exploiting rainbow labyrinthine metamaterials

abstract: In this work, we demonstrate in a proof of concept experiment the efficient noise absorption of a 3-D printed panel designed with appropriately arranged space-coiling labyrinthine acoustic elementary cells of various sizes. The labyrinthine unit cells are analytically and numerically analysed to determine their absorption characteristics and then fabricated and experimentally tested in an impedance tube to verify the dependence of absorption characteristics on cell thickness and lateral size. The resonance frequency of the unit cell is seen to scale approximately linearly with respect to both thickness and lateral size in the considered range, enabling easy tunability of the working frequency. Using these data, a flat panel is designed and fabricated by arranging cells of different dimensions in a quasi-periodic lattice, exploiting the acoustic "rainbow" effect, i.e. superimposing the frequency response of the different cells to generate a wider absorption spectrum, covering the target frequency range, chosen between 800 and 1400 Hz. The panel is thinner and more lightweight compared to traditional sound absorbing solutions and designed in modular form, so as to be applicable to different geometries. The performance of the panel is experimentally validated in a small-scale reverberation room, and an absorption close to ideal values is demonstrated at the desired frequencies of operation. Thus, this work suggests a design procedure for noise-mitigation panel solutions and provides experimental proof of the versatility and effectiveness of labyrinthine metamaterials for tunable mid- to low-frequency sound attenuation.


title: Annual modulations of the angular recoil-flux/energy distributions of WIMP-scattered target nuclei observed at an underground laboratory

abstract: In this article, we compare the target and WIMP-mass dependent "annual modulations" of the angular distributions of the recoil flux and energy of WIMP-scattered target nuclei observed at different underground laboratories. For readers' reference, simulation plots with different WIMP masses and frequently used target nuclei for all functionable underground laboratories can be found and downloaded on our online (interactive) demonstration webpage (http://www.tir.tw/phys/hep/dm/amidas-2d/).


title: The CaLiGraph Ontology as a Challenge for OWL Reasoners

abstract: CaLiGraph is a large-scale cross-domain knowledge graph generated from Wikipedia by exploiting the category system, list pages, and other list structures in Wikipedia, containing more than 15 million typed entities and around 10 million relation assertions. Other than knowledge graphs such as DBpedia and YAGO, whose ontologies are comparably simplistic, CaLiGraph also has a rich ontology, comprising more than 200,000 class restrictions. Those two properties - a large A-box and a rich ontology - make it an interesting challenge for benchmarking reasoners. In this paper, we show that a reasoning task which is particularly relevant for CaLiGraph, i.e., the materialization of owl:hasValue constraints into assertions between individuals and between individuals and literals, is insufficiently supported by available reasoning systems. We provide differently sized benchmark subsets of CaLiGraph, which can be used for performance analysis of reasoning systems.


title: Internal Feedback in Biological Control: Architectures and Examples

abstract: Feedback is ubiquitous in both biological and engineered control systems. In biology, in addition to typical feedback between plant and controller, we observe feedback pathways within control systems, which we call internal feedback pathways (IFPs), that are often very complex. IFPs are most familiar in neural systems, our primary motivation, but they appear everywhere from bacterial signal transduction to the human immune system. In this paper, we describe these very different motivating examples and introduce the concepts necessary to explain their complex IFPs, particularly the severe speed-accuracy tradeoffs that constrain the hardware in biology. We also sketch some minimal theory for extremely simplified toy models that nevertheless highlight the importance of diversity-enabled sweet spots (DESS) in mitigating the impact of hardware tradeoffs. For more realistic models, standard modern and robust control theory can give some insights into previously cryptic IFPs, and the new System Level Synthesis theory expands this substantially. These additional theories explaining IFPs will be explored in more detail in several companion papers.


title: Subaru/FOCAS IFU revealed the metallicity gradient of a local extremely metal-poor galaxy

abstract: We present the first measurement of the metallicity gradient in extremely metal-poor galaxies (EMPGs). With Subaru/Faint Object Camera And Spectrograph (FOCAS) Integral Field Unit (IFU), we have observed a nearby, low-mass EMPG, HSC J1631+4426, whose oxygen abundance and stellar mass are known to be 12+log(O/H) $=6.9$ and $\log_{10}(M_*/{\rm M}_\odot)=5.8$, respectively. The measured metallicity gradient is $-0.36 \pm 0.04$ dex kpc$^{-1}$ corresponding to $-0.049 \pm 0.006$ dex R$_\mathrm{e}^{-1}$ for the continuum effective radius of $R_\mathrm{e} = 0.14$ kpc. Our observation has successfully demonstrated that three-dimensional spectroscopy with 8m-class telescopes is powerful enough to reveal the metallicity distribution in local EMPGs, providing precious information of the baryon cycle in local analogs of primordial galaxies in the early Universe.


title: EDFace-Celeb-1M: Benchmarking Face Hallucination with a Million-scale Dataset

abstract: Recent deep face hallucination methods show stunning performance in super-resolving severely degraded facial images, even surpassing human ability. However, these algorithms are mainly evaluated on non-public synthetic datasets. It is thus unclear how these algorithms perform on public face hallucination datasets. Meanwhile, most of the existing datasets do not well consider the distribution of races, which makes face hallucination methods trained on these datasets biased toward some specific races. To address the above two problems, in this paper, we build a public Ethnically Diverse Face dataset, EDFace-Celeb-1M, and design a benchmark task for face hallucination. Our dataset includes 1.7 million photos that cover different countries, with balanced race composition. To the best of our knowledge, it is the largest and publicly available face hallucination dataset in the wild. Associated with this dataset, this paper also contributes various evaluation protocols and provides comprehensive analysis to benchmark the existing state-of-the-art methods. The benchmark evaluations demonstrate the performance and limitations of state-of-the-art algorithms.


title: Bid Optimization using Maximum Entropy Reinforcement Learning

abstract: Real-time bidding (RTB) has become a critical way of online advertising. In RTB, an advertiser can participate in bidding ad impressions to display its advertisements. The advertiser determines every impression's bidding price according to its bidding strategy. Therefore, a good bidding strategy can help advertisers improve cost efficiency. This paper focuses on optimizing a single advertiser's bidding strategy using reinforcement learning (RL) in RTB. Unfortunately, it is challenging to optimize the bidding strategy through RL at the granularity of impression due to the highly dynamic nature of the RTB environment. In this paper, we first utilize a widely accepted linear bidding function to compute every impression's base price and optimize it by a mutable adjustment factor derived from the RTB auction environment, to avoid optimizing every impression's bidding price directly. Specifically, we use the maximum entropy RL algorithm (Soft Actor-Critic) to optimize the adjustment factor generation policy at the impression-grained level. Finally, the empirical study on a public dataset demonstrates that the proposed bidding strategy has superior performance compared with the baselines.


title: Pitch Preservation In Singing Voice Synthesis

abstract: Suffering from limited singing voice corpus, existing singing voice synthesis (SVS) methods that build encoder-decoder neural networks to directly generate spectrogram could lead to out-of-tune issues during the inference phase. To attenuate these issues, this paper presents a novel acoustic model with independent pitch encoder and phoneme encoder, which disentangles the phoneme and pitch information from music score to fully utilize the corpus. Specifically, according to equal temperament theory, the pitch encoder is constrained by a pitch metric loss that maps distances between adjacent input pitches into corresponding frequency multiples between the encoder outputs. For the phoneme encoder, based on the analysis that same phonemes corresponding to varying pitches can produce similar pronunciations, this encoder is followed by an adversarially trained pitch classifier to enforce the identical phonemes with different pitches mapping into the same phoneme feature space. By these means, the sparse phonemes and pitches in original input spaces can be transformed into more compact feature spaces respectively, where the same elements cluster closely and cooperate mutually to enhance synthesis quality. Then, the outputs of the two encoders are summed together to pass through the following decoder in the acoustic model. Experimental results indicate that the proposed approaches can characterize intrinsic structure between pitch inputs to obtain better pitch synthesis accuracy and achieve superior singing synthesis performance against the advanced baseline system.


title: When is gray-box modeling advantageous for virtual flow metering?

abstract: Integration of physics and machine learning in virtual flow metering applications is known as gray-box modeling. The combination is believed to enhance multiphase flow rate predictions. However, the superiority of gray-box models is yet to be demonstrated in the literature. This article examines scenarios where a gray-box model is expected to outperform physics-based and data-driven models. The experiments are conducted with synthetic data where properties of the underlying data generating process are known and controlled. The results show that a gray-box model yields increased prediction accuracy over a physics-based model in the presence of process-model mismatch. They also show improvements over a data-driven model when the amount of available data is small. On the other hand, gray-box and data-driven models are similarly influenced by noisy measurements. Lastly, the results indicate that a gray-box approach may be advantageous in nonstationary process conditions. Unfortunately, choosing the best model prior to training is challenging, and overhead on model development is unavoidable.


title: Using Personality Detection Tools for Software Engineering Research: How Far Can We Go?

abstract: Assessing the personality of software engineers may help to match individual traits with the characteristics of development activities such as code review and testing, as well as support managers in team composition. However, self-assessment questionnaires are not a practical solution for collecting multiple observations on a large scale. Instead, automatic personality detection, while overcoming these limitations, is based on off-the-shelf solutions trained on non-technical corpora, which might not be readily applicable to technical domains like Software Engineering (SE). In this paper, we first assess the performance of general-purpose personality detection tools when applied to a technical corpus of developers' emails retrieved from the public archives of the Apache Software Foundation. We observe a general low accuracy of predictions and an overall disagreement among the tools. Second, we replicate two previous research studies in SE by replacing the personality detection tool used to infer developers' personalities from pull-request discussions and emails. We observe that the original results are not confirmed, i.e., changing the tool used in the original study leads to diverging conclusions. Our results suggest a need for personality detection tools specially targeted for the software engineering domain.


title: Multi-View Self-Attention Based Transformer for Speaker Recognition

abstract: Initially developed for natural language processing (NLP), Transformer model is now widely used for speech processing tasks such as speaker recognition, due to its powerful sequence modeling capabilities. However, conventional self-attention mechanisms are originally designed for modeling textual sequence without considering the characteristics of speech and speaker modeling. Besides, different Transformer variants for speaker recognition have not been well studied. In this work, we propose a novel multi-view self-attention mechanism and present an empirical study of different Transformer variants with or without the proposed attention mechanism for speaker recognition. Specifically, to balance the capabilities of capturing global dependencies and modeling the locality, we propose a multi-view self-attention mechanism for speaker Transformer, in which different attention heads can attend to different ranges of the receptive field. Furthermore, we introduce and compare five Transformer variants with different network architectures, embedding locations, and pooling methods to learn speaker embeddings. Experimental results on the VoxCeleb1 and VoxCeleb2 datasets show that the proposed multi-view self-attention mechanism achieves improvement in the performance of speaker recognition, and the proposed speaker Transformer network attains excellent results compared with state-of-the-art models.


title: The (Black Hole Mass)-(Spheroid Stellar Density) Relations: $M_{\rm BH}$--$\mu$ (and $M_{\rm BH}$--$\Sigma$) and $M_{\rm BH}$--$\rho$

abstract: This paper is the fourth in a series presenting (galaxy morphology, and thus galaxy formation)-dependent black hole mass, $M_{\rm BH}$, scaling relations. We have used a sample of 119 galaxies with directly-measured $M_{\rm BH}$ and host spheroid parameters obtained from multi-component decomposition of, primarily, $3.6\,\mu$m Spitzer images. Here, we investigate the correlations between $M_{\rm BH}$ and the projected luminosity density $\mu$, the projected stellar mass density $\Sigma$, and the deprojected (internal) stellar mass density $\rho$, for various spheroid radii. We discover the predicted $M_{\rm BH}$--$\mu_{\rm 0,sph}$ relation and present the first $M_{\rm BH}$--$\mu_{\rm e, sph}$ and $M_{\rm BH}$--$\rho_{\rm e,int, sph}$ diagrams displaying slightly different (possibly curved) trends for early- and late-type galaxies (ETGs and LTGs) and an offset between ETGs with (fast-rotators, ES/S0) and without (slow-rotators, E) a disk. The scatter about various $M_{\rm BH}$--$\langle\Sigma\rangle_{\rm R,sph}$ (and $\langle\rho\rangle_{\rm r,sph}$) relations is shown to systematically decrease as the enclosing aperture (and volume) increases, dropping from 0.69~dex when using the spheroid \enquote{compactness}, $\langle\Sigma\rangle_{\rm 1kpc,sph}$, to 0.59~dex when using $\langle\Sigma\rangle_{\rm 5kpc,sph}$. We also reveal that $M_{\rm BH}$ correlates with the internal density, $\rho_{\rm soi,sph}$, at the BH's sphere-of-influence radius, such that core-S\'ersic (high S\'ersic index, $n$) and (low-$n$) S\'ersic galaxies define different relations with total rms scatters 0.21~dex and 0.77~dex, respectively.(Abridged)


title: Recurrent Model-Free RL Can Be a Strong Baseline for Many POMDPs

abstract: Many problems in RL, such as meta-RL, robust RL, generalization in RL, and temporal credit assignment, can be cast as POMDPs. In theory, simply augmenting model-free RL with memory-based architectures, such as recurrent neural networks, provides a general approach to solving all types of POMDPs. However, prior work has found that such recurrent model-free RL methods tend to perform worse than more specialized algorithms that are designed for specific types of POMDPs. This paper revisits this claim. We find that careful architecture and hyperparameter decisions can often yield a recurrent model-free implementation that performs on par with (and occasionally substantially better than) more sophisticated recent techniques. We compare to 21 environments from 6 prior specialized methods and find that our implementation achieves greater sample efficiency and asymptotic performance than these methods on 18/21 environments. We also release a simple and efficient implementation of recurrent model-free RL for future work to use as a baseline for POMDPs.


title: Symmetry-Enhanced Attention Network for Acute Ischemic Infarct Segmentation with Non-Contrast CT Images

abstract: Quantitative estimation of the acute ischemic infarct is crucial to improve neurological outcomes of the patients with stroke symptoms. Since the density of lesions is subtle and can be confounded by normal physiologic changes, anatomical asymmetry provides useful information to differentiate the ischemic and healthy brain tissue. In this paper, we propose a symmetry enhanced attention network (SEAN) for acute ischemic infarct segmentation. Our proposed network automatically transforms an input CT image into the standard space where the brain tissue is bilaterally symmetric. The transformed image is further processed by a Ushape network integrated with the proposed symmetry enhanced attention for pixel-wise labelling. The symmetry enhanced attention can efficiently capture context information from the opposite side of the image by estimating long-range dependencies. Experimental results show that the proposed SEAN outperforms some symmetry-based state-of-the-art methods in terms of both dice coefficient and infarct localization.


title: Analytical Ground- and Excited-State Gradients for Molecular Electronic Structure Theory from Hybrid Quantum/Classical Methods

abstract: We develop analytical gradients of ground- and excited-state energies with respect to system parameters including the nuclear coordinates for the hybrid quantum/classical multistate contracted variational quantum eigensolver (MC-VQE) applied to fermionic systems. We show how the resulting response contributions to the gradient can be evaluated with a quantum effort similar to that of obtaining the VQE energy and independent of the total number of derivative parameters (e.g. number of nuclear coordinates) by adopting a Lagrangian formalism for the evaluation of the total derivative. We also demonstrate that large-step-size finite-difference treatment of directional derivatives in concert with the parameter shift rule can significantly mitigate the complexity of dealing with the quantum parameter Hessian when solving the quantum response equations. This enables the computation of analytical derivative properties of systems with hundreds of atoms, while solving an active space of their most strongly correlated orbitals on a quantum computer. We numerically demonstrate the exactness the analytical gradients and discuss the magnitude of the quantum response contributions.


title: Provenance in Temporal Interaction Networks

abstract: In temporal interaction networks, vertices correspond to entities, which exchange data quantities (e.g., money, bytes, messages) over time. Tracking the origin of data that have reached a given vertex at any time can help data analysts to understand the reasons behind the accumulated quantity at the vertex or behind the interactions between entities. In this paper, we study data provenance in a temporal interaction network. We investigate alternative propagation models that may apply to different application scenarios. For each such model, we propose annotation mechanisms that track the origin of propagated data in the network and the routes of data quantities. Besides analyzing the space and time complexity of these mechanisms, we propose techniques that reduce their cost in practice, by either (i) limiting provenance tracking to a subset of vertices or groups of vertices, or (ii) tracking provenance only for quantities that were generated in the near past or limiting the provenance data in each vertex by a budget constraint. Our experimental evaluation on five real datasets shows that quantity propagation models based on generation time or receipt order scale well on large graphs; on the other hand, a model that propagates quantities proportionally has high space and time requirements and can benefit from the aforementioned cost reduction techniques.


title: Multi-query multi-head attention pooling and Inter-topK penalty for speaker verification

abstract: This paper describes the multi-query multi-head attention (MQMHA) pooling and inter-topK penalty methods which were first proposed in our submitted system description for VoxCeleb speaker recognition challenge (VoxSRC) 2021. Most multi-head attention pooling mechanisms either attend to the whole feature through multiple heads or attend to several split parts of the whole feature. Our proposed MQMHA combines both these two mechanisms and gain more diversified information. The margin-based softmax loss functions are commonly adopted to obtain discriminative speaker representations. To further enhance the inter-class discriminability, we propose a method that adds an extra inter-topK penalty on some confused speakers. By adopting both the MQMHA and inter-topK penalty, we achieved state-of-the-art performance in all of the public VoxCeleb test sets.


title: Robust Safety for Move

abstract: A program that maintains key safety properties even when interacting with arbitrary untrusted code is said to enjoy \emph{robust safety}. Proving that a program written in a mainstream language is robustly safe is typically challenging because it requires static verification tools that work precisely even in the presence of language features like dynamic dispatch and shared mutability. The emerging \move programming language was designed to support strong encapsulation and static verification in the service of secure smart contract programming. However, the language design has not been analyzed using a theoretical framework like robust safety. In this paper, we define robust safety for the \move language and introduce a generic framework for static tools that wish to enforce it. Our framework consists of two abstract components: a program verifier that can prove an invariant holds in a closed-world setting (e.g., the Move Prover), and a novel \emph{encapsulator} that checks if the verifier's result generalizes to an open-world setting. We formalise an escape analysis as an instantiation of the encapsulator and prove that it attains the required security properties. Finally, we implement our encapsulator as an extension to the Move Prover and use the combination to analyze a representative benchmark set of real-world \move programs. This toolchain certifies $>$99\% of the \move modules we analyze, validating that automatic enforcement of strong security properties like robust safety is practical for \move.


title: Biometric Template Protection for Neural-Network-based Face Recognition Systems: A Survey of Methods and Evaluation Techniques

abstract: As automated face recognition applications tend towards ubiquity, there is a growing need to secure the sensitive face data used within these systems. This paper presents a survey of biometric template protection (BTP) methods proposed for securing face templates (images/features) in neural-network-based face recognition systems. The BTP methods are categorised into two types: Non-NN and NN-learned. Non-NN methods use a neural network (NN) as a feature extractor, but the BTP part is based on a non-NN algorithm, whereas NN-learned methods employ a NN to learn a protected template from the unprotected template. We present examples of Non-NN and NN-learned face BTP methods from the literature, along with a discussion of their strengths and weaknesses. We also investigate the techniques used to evaluate these methods in terms of the three most common BTP criteria: recognition accuracy, irreversibility, and renewability/unlinkability. The recognition accuracy of protected face recognition systems is generally evaluated using the same (empirical) techniques employed for evaluating standard (unprotected) biometric systems. However, most irreversibility and renewability/unlinkability evaluations are found to be based on theoretical assumptions/estimates or verbal implications, with a lack of empirical validation in a practical face recognition context. So, we recommend a greater focus on empirical evaluations to provide more concrete insights into the irreversibility and renewability/unlinkability of face BTP methods in practice. Additionally, an exploration of the reproducibility of the studied BTP works, in terms of the public availability of their implementation code and evaluation datasets/procedures, suggests that it would be difficult to faithfully replicate most of the reported findings. So, we advocate for a push towards reproducibility, in the hope of advancing face BTP research.


title: The rigidity of sharp spectral gap in nonnegatively curved spaces

abstract: We extend the celebrated rigidity of the sharp first spectral gap under $Ric\ge0$ to compact infinitesimally Hilbertian spaces with non-negative (weak, also called synthetic) Ricci curvature and bounded (synthetic) dimension i.e. to so-called compact $RCD(0,N)$ spaces; this is a category of metric measure spaces which in particular includes (Ricci) non-negatively curved Riemannian manifolds, Alexandrov spaces, Ricci limit spaces, Bakry-\'Emery manifolds along with products, certain quotients and measured Gromov-Hausdorff limits of such spaces. In precise terms, we show in such spaces, $\lambda = \frac{\pi^{2}}{\mathrm{diam}^2}$ if and only if the space is one dimensional with a constant density function. We use new techniques mixing Sobolev theory and singular $1D$-localization which might also be of independent interest. As a consequence of the rigidity in the singular setting, we also derive almost rigidity results.


title: Absolute calibration of the latent heat of transition using differential thermal analysis

abstract: We describe a simple and accurate differential thermal analysis set up to measure the latent heat of solid state materials undergoing abrupt phase transitions in the temperature range from 77 K to above room temperature. We report a numerical technique for the absolute calibration of the latent heat of the transition, without the need of a reference sample. The technique is applied to three different samples -- vanadium sesquioxide undergoing the Mott transition, bismuth barium ruthenate undergoing a magnetoelastic transition, and an intermetallic Heusler compound. In each case, the inferred latent heat value agrees with the literature value to within its error margins. To further demonstrate the importance of absolute calibration, we show that the changes in the latent heat of the Mott transition in vanadium sesquioxide (V$_2$O$_3$) stays constant to within 2% even as the depth of supersaturation changes by about 10 K, in non-equilibrium dynamic hysteresis measurements. We also apply this technique for the measurement of the temperature-dependent specific heat.


title: Super-resolution reconstruction of turbulent flow at various Reynolds numbers based on generative adversarial networks

abstract: This study presents a deep learning-based framework to reconstruct high-resolution turbulent velocity fields from extremely low-resolution data at various Reynolds numbers using the concept of generative adversarial networks (GANs). A multiscale enhanced super-resolution generative adversarial network (MS-ESRGAN) is applied as a model to reconstruct the high-resolution velocity fields, and direct numerical simulation (DNS) data of turbulent channel flow with large longitudinal ribs at various Reynolds numbers are used to evaluate the performance of the model. The model is found to have the capacity to accurately reproduce high-resolution velocity fields from data at two different low-resolution levels in terms of the quantities of velocity fields and turbulent statistics. The results further reveal that the model is able to reconstruct velocity fields at Reynolds numbers that are not used in the training process.


title: Generalized parton distributions and spin structures of light mesons from a light-front Hamiltonian approach

abstract: We present the generalized parton distributions (GPDs) for the valence quarks of the pion and the kaon in both momentum space and position space within the basis light-front quantization framework. These GPDs are obtained from the eigenvectors of a light-front effective Hamiltonian consisting of the holographic quantum chromodynamics (QCD) confinement potential, a complementary longitudinal confinement potential, and the color-singlet Nambu-Jona--Lasinio interactions for the valence quarks of mesons. We then calculate the generalized form factors of the pion and the kaon from the moments of these GPDs. Combining the tensor form factors with the electromagnetic form factors, we subsequently evaluate the impact parameter dependent probability density of transversely polarized quarks inside the pion and the kaon. The numerical results for the generalized form factors, tensor charges, as well as those for the probability densities and the transverse shift of the polarized densities are consistent with lattice QCD simulations and with chiral quark models.


title: Scaling Limit of the Fleming-Viot Multi-Colour Process

abstract: We consider the $N$-particle Fleming-Viot process associated to a normally reflected diffusion with soft catalyst killing. The Fleming-Viot multi-colour process is obtained by attaching genetic information to the particles in the Fleming-Viot process. We establish that, after rescaling time by $t\mapsto Nt$, this genetic information converges to the (very different) Fleming-Viot process from population genetics, as $N\rightarrow\infty$. An extension is provided to dynamics given by Brownian motion with hard catalyst killing at the boundary of its domain.


title: Coupling rare event algorithms with data-based learned committor functions using the analogue Markov chain

abstract: Rare events play a crucial role in many physics, chemistry, and biology phenomena, when they change the structure of the system, for instance in the case of multistability, or when they have a huge impact. Rare event algorithms have been devised to simulate them efficiently, avoiding the computation of long periods of typical fluctuations. We consider here the family of splitting or cloning algorithms, which are versatile and specifically suited for far-from-equilibrium dynamics. To be efficient, these algorithms need to use a smart score function during the selection stage. Committor functions are the optimal score functions. In this work we propose a new approach, based on the analogue Markov chain, for a data-based learning of approximate committor functions. We demonstrate that such learned committor functions are extremely efficient score functions when used with the Adaptive Multilevel Splitting algorithm. We illustrate our approach for a gradient dynamics in a three-well potential, and for the Charney-DeVore model, which is a paradigmatic toy model of multistability for atmospheric dynamics. For these two dynamics, we show that having observed a few transitions is enough to have a very efficient data-based score function for the rare event algorithm. This new approach is promising for use for complex dynamics: the rare events can be simulated with a minimal prior knowledge and the results are much more precise than those obtained with a user-designed score function.

categories: math.DS cond-mat.stat-mech physics.comp-ph physics.data-an


title: Gaussian rule for integrals involving Bessel functions

abstract: In this work we develop the Gaussian quadrature rule for weight functions involving fractional powers, exponentials and Bessel functions of the first kind. Besides the computation based on the use of the standard and the modified Chebyshev algorithm, here we present a very stable algorithm based on the preconditioning of the moment matrix. Numerical experiments are provided and a geophysical application is considered.


title: LSC-GAN: Latent Style Code Modeling for Continuous Image-to-image Translation

abstract: Image-to-image (I2I) translation is usually carried out among discrete domains. However, image domains, often corresponding to a physical value, are usually continuous. In other words, images gradually change with the value, and there exists no obvious gap between different domains. This paper intends to build the model for I2I translation among continuous varying domains. We first divide the whole domain coverage into discrete intervals, and explicitly model the latent style code for the center of each interval. To deal with continuous translation, we design the editing modules, changing the latent style code along two directions. These editing modules help to constrain the codes for domain centers during training, so that the model can better understand the relation among them. To have diverse results, the latent style code is further diversified with either the random noise or features from the reference image, giving the individual style code to the decoder for label-based or reference-based synthesis. Extensive experiments on age and viewing angle translation show that the proposed method can achieve high-quality results, and it is also flexible for users.


title: Integrating Structural Description of Data Format Information into Programming to Auto-generate File Reading Programs

abstract: File reading is the basis for data sharing and scientific computing. However, manual programming for file reading is labour-intensive and time-consuming, as data formats are heterogeneous and complex. To address such an issue, this study proposes a novel approach for the automatic generation of file reading programs based on structured and self-described data format information. This approach provides two modes composed of sequentially and randomly reading. The file data format is described by Data Format Markup Language and thus DFML documents are generated. The formation of data type sequences by parsing those DFML documents. The generation of programs for sequential or random reading data with formed data type sequences and general programing rules for specific programming languages. A tool named DFML Editor was developed for generating and editing DFML documents. Case studies on binary files, i.e., ESRI point shapefiles and plain text files, i.e., input files of Storm Water Management Model, were conducted with the software developed for automatic program generation and file reading. Experimental results show that the proposed approach is effective for automatically generating programs for reading files. The idea in this study is also helpful for automatically writing files.


title: Source Mixing and Separation Robust Audio Steganography

abstract: Audio steganography aims at concealing secret information in carrier audio with imperceptible modification on the carrier. Although previous works addressed the robustness of concealed message recovery against distortions introduced during transmission, they do not address the robustness against aggressive editing such as mixing of other audio sources and source separation. In this work, we propose for the first time a steganography method that can embed information into individual sound sources in a mixture such as instrumental tracks in music. To this end, we propose a time-domain model and curriculum learning essential to learn to decode the concealed message from the separated sources. Experimental results show that the proposed method successfully conceals the information in an imperceptible perturbation and that the information can be correctly recovered even after mixing of other sources and separation by a source separation algorithm. Furthermore, we show that the proposed method can be applied to multiple sources simultaneously without interfering with the decoder for other sources even after the sources are mixed and separated.


title: Bridging the Gap between Label- and Reference-based Synthesis in Multi-attribute Image-to-Image Translation

abstract: The image-to-image translation (I2IT) model takes a target label or a reference image as the input, and changes a source into the specified target domain. The two types of synthesis, either label- or reference-based, have substantial differences. Particularly, the label-based synthesis reflects the common characteristics of the target domain, and the reference-based shows the specific style similar to the reference. This paper intends to bridge the gap between them in the task of multi-attribute I2IT. We design the label- and reference-based encoding modules (LEM and REM) to compare the domain differences. They first transfer the source image and target label (or reference) into a common embedding space, by providing the opposite directions through the attribute difference vector. Then the two embeddings are simply fused together to form the latent code S_rand (or S_ref), reflecting the domain style differences, which is injected into each layer of the generator by SPADE. To link LEM and REM, so that two types of results benefit each other, we encourage the two latent codes to be close, and set up the cycle consistency between the forward and backward translations on them. Moreover, the interpolation between the S_rand and S_ref is also used to synthesize an extra image. Experiments show that label- and reference-based synthesis are indeed mutually promoted, so that we can have the diverse results from LEM, and high quality results with the similar style of the reference.


title: Controllable Recommenders using Deep Generative Models and Disentanglement

abstract: In this paper, we consider controllability as a means to satisfy dynamic preferences of users, enabling them to control recommendations such that their current preference is met. While deep models have shown improved performance for collaborative filtering, they are generally not amenable to fine grained control by a user, leading to the development of methods like deep language critiquing. We propose an alternate view, where instead of keyphrase based critiques, a user is provided 'knobs' in a disentangled latent space, with each knob corresponding to an item aspect. Disentanglement here refers to a latent space where generative factors (here, a preference towards an item category like genre) are captured independently in their respective dimensions, thereby enabling predictable manipulations, otherwise not possible in an entangled space. We propose using a (semi-)supervised disentanglement objective for this purpose, as well as multiple metrics to evaluate the controllability and the degree of personalization of controlled recommendations. We show that by updating the disentangled latent space based on user feedback, and by exploiting the generative nature of the recommender, controlled and personalized recommendations can be produced. Through experiments on two widely used collaborative filtering datasets, we demonstrate that a controllable recommender can be trained with a slight reduction in recommender performance, provided enough supervision is provided. The recommendations produced by these models appear to both conform to a user's current preference and remain personalized.


title: Can Stochastic Gradient Langevin Dynamics Provide Differential Privacy for Deep Learning?

abstract: Bayesian learning via Stochastic Gradient Langevin Dynamics (SGLD) has been suggested for differentially private learning. While previous research provides differential privacy bounds for SGLD at the initial steps of the algorithm or when close to convergence, the question of what differential privacy guarantees can be made in between remains unanswered. This interim region is of great importance, especially for Bayesian neural networks, as it is hard to guarantee convergence to the posterior. This paper shows that using SGLD might result in unbounded privacy loss for this interim region, even when sampling from the posterior is as differentially private as desired.


title: Observation of Exchange Bias in Antiferromagnetic Cr$_{0.79}$Se due to the Coexistence of Itinerant Weak Ferromagnetism at Low-temperatures

abstract: We report on the structural, electrical transport, and magnetic properties of antiferromagnetic transition-metal monochalcogenide Cr$_{0.79}$Se. Different from the existing off-stoichiometric compositions, Cr$_{0.79}$Se is found to be synthesised into the same NiAs-type hexagonal crystal structure of CrSe. Resistivity data suggest Cr$_{0.79}$Se to be a Fermi-liquid-type metal at low temperatures, while at intermediate temperatures the resistivity depends sublinearly on the temperature. Eventually, at the elevated temperatures the rate of change of resistivity rapidly decreases with increasing temperature. Magnetic measurements suggest a transition from paramagnetic phase to an antiferromagnetic phase at a N$\acute{e}$el temperature of 225 K. Further reduction of the sample temperature results into coexistance of weak ferromagnetism along with the antiferromagnetic phase below 100 K. As a result, below 100 K, we identify significant exchange bias due to the interaction between the ferro- and antiferromagnetic phases. In addition, from the temperature dependent X-ray diffraction measurements we observe that the NiAs-type structure is stable up to as high as 600$^o$C.


title: Amicable examples for informed source separation

abstract: This paper deals with the problem of informed source separation (ISS), where the sources are accessible during the so-called \textit{encoding} stage. Previous works computed side-information during the encoding stage and source separation models were designed to utilize the side-information to improve the separation performance. In contrast, in this work, we improve the performance of a pretrained separation model that does not use any side-information. To this end, we propose to adopt an adversarial attack for the opposite purpose, i.e., rather than computing the perturbation to degrade the separation, we compute an imperceptible perturbation called amicable noise to improve the separation. Experimental results show that the proposed approach selectively improves the performance of the targeted separation model by 2.23 dB on average and is robust to signal compression. Moreover, we propose multi-model multi-purpose learning that control the effect of the perturbation on different models individually.


title: Two-level Group Convolution

abstract: Group convolution has been widely used in order to reduce the computation time of convolution, which takes most of the training time of convolutional neural networks. However, it is well known that a large number of groups significantly reduce the performance of group convolution. In this paper, we propose a new convolution methodology called ``two-level'' group convolution that is robust with respect to the increase of the number of groups and suitable for multi-GPU parallel computation. We first observe that the group convolution can be interpreted as a one-level block Jacobi approximation of the standard convolution, which is a popular notion in the field of numerical analysis. In numerical analysis, there have been numerous studies on the two-level method that introduces an intergroup structure that resolves the performance degradation issue without disturbing parallel computation. Motivated by these, we introduce a coarse-level structure which promotes intergroup communication without being a bottleneck in the group convolution. We show that all the additional work induced by the coarse-level structure can be efficiently processed in a distributed memory system. Numerical results that verify the robustness of the proposed method with respect to the number of groups are presented. Moreover, we compare the proposed method to various approaches for group convolution in order to highlight the superiority of the proposed method in terms of execution time, memory efficiency, and performance.


title: Boosting room temperature tunnel magnetoresistance in hybrid magnetic tunnel junctions under electric bias

abstract: Spin-resolved electron symmetry filtering is a key mechanism behind giant tunneling magnetoresistance (TMR) in Fe/MgO/Fe and similar magnetic tunnel junctions (MTJs), providing room temperature functionality in modern spin electronics. However, the core process of the electron symmetry filtering breaks down under applied bias, dramatically reducing the TMR above 0.5 V. This strongly hampers the application range of MTJs. To circumvent the problem, resonant tunneling between ferromagnetic electrodes through quantum well states in thin layers has been used so far. This mechanism, however, is mainly effective at low temperatures. Here, a fundamentally different approach is demonstrated, providing a strong TMR boost under applied bias in V/MgO/Fe/MgO/Fe/Co hybrids. This pathway uses spin orbit coupling (SOC) controlled interfacial states in vanadium, which contrary to the V(001) bulk states are allowed to tunnel to Fe(001) at low biases. The experimentally observed strong increase of TMR with bias is modelled using two nonlinear resistances in series, with the low bias conductance of the first (V/MgO/Fe) element being boosted by the SOC-controlled interfacial states, while the conductance of the second (Fe/MgO/Fe) junctions controlled by the relative alignment of the two ferromagnetic layers. These results pave a way to unexplored and fundamentally different spintronic device schemes, with tunneling magnetoresistance uplifted under applied electric bias.


title: Invariant submanifolds of conformal symplectic dynamics

abstract: We study invariant manifolds of conformal symplectic dynamical systems on a symplectic manifold (M, $\omega$) of dimension $\ge$4. This class of systems is the 1-dimensional extension of symplectic dynamical systems for which the symplectic form is transformed colinearly to itself. In this context, we first examine how the $\omega$-isotropy of an invariant manifold N relates to the entropy of the dynamics it carries. Central to our study is Yomdin's inequality, and a refinement obtained using that the local entropies have no effect transversally to the characteristic foliation of N. When (M, $\omega$) is exact and N is isotropic, we also show that N must be exact for some choice of the primitive of $\omega$, under the condition that the dynamics acts trivially on the cohomology of degree 1 of N. The conclusion partially extends to the case when N has a relatively compact one-sided orbit. We eventually prove the uniqueness of invariant submanifolds N when M is a cotangent bundle, provided that the dynamics is isotopic to the identity among Hamiltonian diffeomorphisms. In the case of the cotangent bundle of the torus, a theorem of Shelukhin allows us to conclude that N is unique even among submanifolds with compact orbits.


title: Efficient Extensional Binary Tries

abstract: Lookup tables (finite maps) are a ubiquitous data structure. In pure functional languages they are best represented using trees instead of hash tables. In pure functional languages within constructive logic, without a primitive integer type, they are well represented using binary tries instead of search trees. In this work, we introduce canonical binary tries, an improved binary-trie data structure that enjoys a natural extensionality property, quite useful in proofs, and supports sparseness more efficiently. We provide full proofs of correctness in Coq. We provide microbenchmark measurements of canonical binary tries versus several other data structures for finite maps, in a variety of application contexts; as well as measurement of canonical versus original tries in two big, real systems. The application context of data structures contained in theorem statements imposes unusual requirements for which canonical tries are particularly well suited.


title: Ab-Initio Potential Energy Surfaces by Pairing GNNs with Neural Wave Functions

abstract: Solving the Schr\"odinger equation is key to many quantum mechanical properties. However, an analytical solution is only tractable for single-electron systems. Recently, neural networks succeeded at modeling wave functions of many-electron systems. Together with the variational Monte-Carlo (VMC) framework, this led to solutions on par with the best known classical methods. Still, these neural methods require tremendous amounts of computational resources as one has to train a separate model for each molecular geometry. In this work, we combine a Graph Neural Network (GNN) with a neural wave function to simultaneously solve the Schr\"odinger equation for multiple geometries via VMC. This enables us to model continuous subsets of the potential energy surface with a single training pass. Compared to existing state-of-the-art networks, our Potential Energy Surface Network PESNet speeds up training for multiple geometries by up to 40 times while matching or surpassing their accuracy. This may open the path to accurate and orders of magnitude cheaper quantum mechanical calculations.


title: Probing texture 4 zero quark mass matrices in the era of precision measurements

abstract: In pursuance of finding a viable set of mass matrices, keeping in mind recent precision measurement of quark masses and CKM parameters, we have carried out a detailed and comprehensive analysis of hermitian texture 4 zero quark mass matrices. Our analysis reveals that only Fritzsch like texture 4 zero combination provides a viable set of mass matrices for the present quark mixing data and all other texture 4 zero combinations are ruled out. A good number of these possibilities can be ruled out analytically, the other possibilities are excluded by the present quark mixing data. Interestingly, our conclusions remain valid, even if in future there are perturbations in the ranges of the light quark masses or CKM parameters.


title: Epitaxial growth of bilayer Bi(110) on two-dimensional ferromagnetic Fe3GeTe2

abstract: Heterostructures of two-dimensional (2D) layered materials with selective compositions play an important role in creating novel functionalities. Effective interface coupling between 2D ferromagnet and electronic materials would enable the generation of exotic physical phenomena caused by intrinsic symmetry breaking and proximity effect at interfaces. Here, epitaxial growth of bilayer Bi(110) on 2D ferromagnetic Fe3GeTe2 (FGT) with large magnetic anisotropy has been reported. Bilayer Bi(110) islands are found to extend along fixed lattice directions of FGT. The six preferred orientations could be divided into two groups of three-fold symmetry axes with the difference approximately to 26{\deg}. Moreover, dI/dV measurements confirm the existence of interface coupling between bilayer Bi(110) and FGT. A variation of the energy gap at the edges of bilayer Bi(110) is also observed which is modulated by the interface coupling strengths associated with its buckled atomic structure. This system provides a good platform for further study of the exotic electronic properties of epitaxial Bi(110) on 2D ferromagnetic substrate and promotes potential applications in the field of spin devices.


title: Birth-and-death Processes in Python: The BirDePy Package

abstract: Birth-and-death processes (BDPs) form a class of continuous-time Markov chains that are particularly suited to describing the changes in the size of a population over time. Population-size-dependent BDPs (PSDBDPs) allow the rate at which a population grows to depend on the current population size. The main purpose of our new Python package BirDePy is to provide easy-to-use functions that allow the parameters of discretely-observed PSDBDPs to be estimated. The package can also be used to estimate parameters of continuously-observed PSDBDPs, simulate sample paths, approximate transition probabilities, and generate forecasts. We describe in detail several methods which have been incorporated into BirDePy to achieve each of these tasks. The usage and effectiveness of the package is demonstrated through a variety of examples of PSDBDPs, as well as case studies involving annual population count data of two endangered bird species.


title: A weighted graph zeta function involved in the Szegedy walk

abstract: We define a new weighted zeta function for a finite graph and obtain its determinant expression. This result gives the characteristic polynomial of the transition matrix of the Szegedy walk on a graph.


title: Efficient Training of Audio Transformers with Patchout

abstract: The great success of transformer-based models in natural language processing (NLP) has led to various attempts at adapting these architectures to other domains such as vision and audio. Recent work has shown that transformers can outperform Convolutional Neural Networks (CNNs) on vision and audio tasks. However, one of the main shortcomings of transformer models, compared to the well-established CNNs, is the computational complexity. In transformers, the compute and memory complexity is known to grow quadratically with the input length. Therefore, there has been extensive work on optimizing transformers, but often at the cost of degrading predictive performance. In this work, we propose a novel method to optimize and regularize transformers on audio spectrograms. Our proposed models achieve a new state-of-the-art performance on Audioset and can be trained on a single consumer-grade GPU. Furthermore, we propose a transformer model that outperforms CNNs in terms of both performance and training speed. Source code: https://github.com/kkoutini/PaSST


title: FWER Goes to Zero for Correlated Normal

abstract: Familywise error rate (FWER) has been a cornerstone in simultaneous inference for decades, and the classical Bonferroni method has been one of the most prominent frequentist approaches for controlling FWER. The present article studies the limiting behavior of Bonferroni FWER in a multiple testing problem as the number of hypotheses grows to infinity. We establish that in the equicorrelated normal setup with positive equicorrelation, Bonferroni FWER tends to zero asymptotically. We extend this result for generalized familywise error rates and to arbitrarily correlated setups.


title: Document-Level Text Simplification: Dataset, Criteria and Baseline

abstract: Text simplification is a valuable technique. However, current research is limited to sentence simplification. In this paper, we define and investigate a new task of document-level text simplification, which aims to simplify a document consisting of multiple sentences. Based on Wikipedia dumps, we first construct a large-scale dataset named D-Wikipedia and perform analysis and human evaluation on it to show that the dataset is reliable. Then, we propose a new automatic evaluation metric called D-SARI that is more suitable for the document-level simplification task. Finally, we select several representative models as baseline models for this task and perform automatic evaluation and human evaluation. We analyze the results and point out the shortcomings of the baseline models.


title: $\phi$-FEM: an efficient simulation tool using simple meshes for problems in structure mechanics and heat transfer

abstract: One of the major issues in the computational mechanics is to take into account the geometrical complexity. To overcome this difficulty and to avoid the expensive mesh generation, geometrically unfitted methods, i.e. the numerical methods using the simple computational meshes that do not fit the boundary of the domain, and/or the internal interfaces, have been widely developed. In the present work, we investigate the performances of an unfitted method called $\phi$-FEM that converges optimally and uses classical finite element spaces so that it can be easily implemented using general FEM libraries. The main idea is to take into account the geometry thanks to a level set function describing the boundary or the interface. Up to now, the $\phi$-FEM approach has been proposed, tested and substantiated mathematically only in some simplest settings: Poisson equation with Dirichlet/Neumann/Robin boundary conditions. Our goal here is to demonstrate its applicability to some more sophisticated governing equations arising in the computational mechanics. We consider the linear elasticity equations accompanied by either pure Dirichlet boundary conditions or by the mixed ones (Dirichlet and Neumann boundary conditions co-existing on parts of the boundary), an interface problem (linear elasticity with material coefficients abruptly changing over an internal interface), a model of elastic structures with cracks, and finally the heat equation. In all these settings, we derive an appropriate variant of $\phi$-FEM and then illustrate it by numerical tests on manufactured solutions. We also compare the accuracy and efficiency of $\phi$-FEM with those of the standard fitted FEM on the meshes of similar size, revealing the substantial gains that can be achieved by $\phi$-FEM in both the accuracy and the computational time.


title: Measurements of neutron fields in a wide energy range using multi-foil activation analysis

abstract: An accurate characterization of the neutron fields at spallation sources is crucial for many applications based on neutron irradiations, such as radiation damage tests that need a precise dose estimate. In this work we present the neutron flux measurements performed with the multi-foil activation technique in the ROTAX and ChipIr beamlines of the ISIS spallation source, characterized by moderated and unmoderated spectra, respectively. We selected many different activation reactions to cover a wide energy range, from thermal to very fast neutrons up to about 100 MeV. By applying a Bayesian unfolding algorithm, we demonstrate the effectiveness of this technique in measuring the neutron flux intensity and energy spectrum with precision and accuracy.


title: Rethinking Person Re-Identification via Semantic-Based Pretraining

abstract: Pretraining is a dominant paradigm in computer vision. Generally, supervised ImageNet pretraining is commonly used to initialize the backbones of person re-identification (Re-ID) models. However, recent works show a surprising result that CNN-based pretraining on ImageNet has limited impacts on Re-ID system due to the large domain gap between ImageNet and person Re-ID data. To seek an alternative to traditional pretraining, here we investigate semantic-based pretraining as another method to utilize additional textual data against ImageNet pretraining. Specifically, we manually construct a diversified FineGPR-C caption dataset for the first time on person Re-ID events. Based on it, a pure semantic-based pretraining approach named VTBR is proposed to adopt dense captions to learn visual representations with fewer images. We train convolutional neural networks from scratch on the captions of FineGPR-C dataset, and then transfer them to downstream Re-ID tasks. Comprehensive experiments conducted on benchmark datasets show that our VTBR can achieve competitive performance compared with ImageNet pretraining - despite using up to 1.4x fewer images, revealing its potential in Re-ID pretraining.


title: DANIEL: A Fast and Robust Consensus Maximization Method for Point Cloud Registration with High Outlier Ratios

abstract: Correspondence-based point cloud registration is a cornerstone in geometric computer vision, robotics perception, photogrammetry and remote sensing, which seeks to estimate the best rigid transformation between two point clouds from the correspondences established over 3D keypoints. However, due to limited robustness and accuracy, current 3D keypoint matching techniques are very prone to yield outliers, probably even in very large numbers, making robust estimation for point cloud registration of great importance. Unfortunately, existing robust methods may suffer from high computational cost or insufficient robustness when encountering high (or even extreme) outlier ratios, hardly ideal enough for practical use. In this paper, we present a novel time-efficient RANSAC-type consensus maximization solver, named DANIEL (Double-layered sAmpliNg with consensus maximization based on stratIfied Element-wise compatibiLity), for robust registration. DANIEL is designed with two layers of random sampling, in order to find inlier subsets with the lowest computational cost possible. Specifically, we: (i) apply the rigidity constraint to prune raw outliers in the first layer of one-point sampling, (ii) introduce a series of stratified element-wise compatibility tests to conduct rapid compatibility checking between minimal models so as to realize more efficient consensus maximization in the second layer of two-point sampling, and (iii) probabilistic termination conditions are employed to ensure the timely return of the final inlier set. Based on a variety of experiments over multiple real datasets, we show that DANIEL is robust against over 99% outliers and also significantly faster than existing state-of-the-art robust solvers (e.g. RANSAC, FGR, GORE).


title: A Closer Look at Prototype Classifier for Few-shot Image Classification

abstract: The prototypical network is a prototype classifier based on meta-learning and is widely used for few-shot learning because it classifies unseen examples by constructing class-specific prototypes without adjusting hyper-parameters during meta-testing. Interestingly, recent research has attracted a lot of attention, showing that training a new linear classifier, which does not use a meta-learning algorithm, performs comparably with the prototypical network. However, the training of a new linear classifier requires the retraining of the classifier every time a new class appears. In this paper, we analyze how a prototype classifier works equally well without training a new linear classifier or meta-learning. We experimentally find that directly using the feature vectors, which is extracted by using standard pre-trained models to construct a prototype classifier in meta-testing, does not perform as well as the prototypical network and training new linear classifiers on the feature vectors of pre-trained models. Thus, we derive a novel generalization bound for a prototypical classifier and show that the transformation of a feature vector can improve the performance of prototype classifiers. We experimentally investigate several normalization methods for minimizing the derived bound and find that the same performance can be obtained by using the L2 normalization and minimizing the ratio of the within-class variance to the between-class variance without training a new classifier or meta-learning.


title: Compressive Sensing Based Adaptive Defence Against Adversarial Images

abstract: Herein, security of deep neural network against adversarial attack is considered. Existing compressive sensing based defence schemes assume that adversarial perturbations are usually on high frequency components, whereas recently it has been shown that low frequency perturbations are more effective. This paper proposes a novel Compressive sensing based Adaptive Defence (CAD) algorithm which combats distortion in frequency domain instead of time domain. Unlike existing literature, the proposed CAD algorithm does not use information about the type of attack such as l0, l2, l-infinity etc. CAD algorithm uses exponential weight algorithm for exploration and exploitation to identify the type of attack, compressive sampling matching pursuit (CoSaMP) to recover the coefficients in spectral domain, and modified basis pursuit using a novel constraint for l0, l-infinity norm attack. Tight performance bounds for various recovery schemes meant for various attack types are also provided. Experimental results against five state-of-the-art white box attacks on MNIST and CIFAR-10 show that the proposed CAD algorithm achieves excellent classification accuracy and generates good quality reconstructed image with much lower computation


title: State Estimation Using a Network of Distributed Observers With Unknown Inputs

abstract: State estimation for a class of linear time-invariant systems with distributed output measurements (distributed sensors) and unknown inputs is addressed in this paper. The objective is to design a network of observers such that the state vector of the entire system can be estimated, while each observer (or node) has access to only local output measurements that may not be sufficient on its own to reconstruct the entire system's state. Existing results in the literature on distributed state estimation assume either that the system does not have inputs, or that all the system's inputs are globally known to all the observers. Accordingly, we address this gap by proposing a distributed observer capable of estimating the overall system's state in the presence of inputs, while each node only has limited local information on inputs and outputs. We provide a design method that guarantees convergence of the estimation errors under some mild joint detectability conditions. This design suits undirected communication graphs that may have switching topologies and also applies to strongly connected directed graphs. We also give existence conditions that harmonize with existing results on unknown input observers. Finally, simulation results verify the effectiveness of the proposed estimation scheme for various scenarios.


title: An optimal multiplier theorem for Grushin operators in the plane, II

abstract: In a previous work we proved a spectral multiplier theorem of Mihlin--H\"ormander type for two-dimensional Grushin operators $-\partial_x^2 - V(x) \partial_y^2$, where $V$ is a doubling single-well potential, yielding the surprising result that the optimal smoothness requirement on the multiplier is independent of $V$. Here we refine this result, by replacing the $L^\infty$ Sobolev condition on the multiplier with a sharper $L^2$ condition. As a consequence, we obtain the sharp range of $L^1$ boundedness for the associated Bochner--Riesz means. The key new ingredient of the proof is a precise pointwise estimate in the transition region for eigenfunctions of one-dimensional Schr\"odinger operators with doubling single-well potentials.


title: Whistler waves observed by Solar Orbiter / RPW between 0.5 AU and 1 AU

abstract: The goal of our study is to detect and characterize the electromagnetic waves that can modify the electron distribution functions, with a special attention to whistler waves. We analyse in details the electric and magnetic field fluctuations observed by the Solar Orbiter spacecraft during its first orbit around the Sun between 0.5 and 1 AU. Using data of the Search Coil Magnetometer and electric antenna, both parts of the Radio and Plasma Waves (RPW) instrumental suite, we detect the electromagnetic waves with frequencies above 3 Hz and determine the statistical distribution of their amplitudes, frequencies, polarization and k-vector as a function of distance. We also discuss relevant instrumental issues regarding the phase between the electric and magnetic measurements and the effective length of the electric antenna. An overwhelming majority of the observed waves are right hand circularly polarized in the solar wind frame and identified as outward propagating and quasi parallel whistler waves. Their occurrence rate increases by a least a factor two from 1 AU to 0.5 AU. These results are consistent with the regulation of the heat flux by the whistler heat flux instability. Near 0.5 AU, whistler waves are found to be more field-aligned and to have smaller normalized frequency ($f/f_{ce}$), larger amplitude, and larger bandwidth than at 1 AU.


title: Precision measurements of jet production at the ATLAS experiment

abstract: Measurements of jet production are sensitive to the strong coupling constant, high order perturbative calculations and parton distribution functions. In this talk we present the most recent ATLAS measurements in this area at a centre-of-mass energy of $\sqrt{s}$ = 13 TeV. We present measurements of variables probing the properties of the multijet energy flow and of the Lund Plane using charged particles. We will also present new measurements sensitive to the strong coupling constant. For jet fragmentation, we present a measurement of the fragmentation properties of $b$-quark initiated jets, studied using charged B mesons. This analysis provides key measurements with which to better understand the fragmentation functions of heavy quarks. All results are corrected for detector effects and compared to several Monte Carlo predictions with different parton shower and hadronisation models.


title: Computational aspects of finding a solution asymptotics for a singularly perturbed system of differential equations

abstract: We analyze the spatial structure of asymptotics of a solution to a singularly perturbed system of mass transfer equations. The leading term of the asymptotics is described by a parabolic equation with possibly degenerate spatial part. We prove a theorem that establishes a relationship between the degree of degeneracy and the numbers of equations in the system and spatial variables in some particular cases. The work hardly depends on the calculation of the eigenvalues of matrices that determine the spatial structure of the asymptotics by the means of computer algebra system Wolfram Mathematica. We put forward a hypothesis on the existence of the found connection for an arbitrary number of equations and spatial variables.


title: Holographic beam shaping of partially coherent light

abstract: We present an algorithm for holographic shaping of partially coherent light, bridging the gap between traditional coherent and geometric optical approaches. The description of partially coherent light relies on a mode expansion formalism, with possibly thousands of individual modes, and the inverse-design optimization algorithm is based on gradient descent with the help of algorithmic differentiation. We demonstrate numerically and experimentally that an optical system consisting of two phase patterns can potentially achieve any intensity profile transformation with good accuracy.


title: Dark photon bursts from compact binary systems and constraints

abstract: In this work, we consider the burst signal of the dark photon, the hypothetical vector boson of the $U(1)_B$ or $U(1)_{B-L}$ gauge group, generated by a compact binary star system. The absence of the signal in the laser interferometer puts bounds on the coupling constant $\epsilon$ to the ordinary matter. It turns out that if the dark photon is massless, $\epsilon^2$ is on the order of $10^{-37}-10^{-33}$ at most; in the massive case, the upper bound of $\epsilon^2$ is about $10^{-38}-10^{-31}$ in the mass range from $10^{-19}$ eV to $10^{-11}$ eV. These are the first bounds derived from the interferometer observations independent of the assumption of dark photons being dark matter.


title: Efficiently and Globally Solving Joint Beamforming and Compression Problem in the Cooperative Cellular Network via Lagrangian Duality

abstract: Consider the joint beamforming and quantization problem in the cooperative cellular network, where multiple relay-like base stations (BSs) connected to the central processor (CP) via rate-limited fronthaul links cooperatively serve the users. This problem can be formulated as the minimization of the total transmit power, subject to all users' signal-to-interference-plus-noise-ratio (SINR) constraints and all relay-like BSs' fronthaul rate constraints. In this paper, we first show that there is no duality gap between the considered problem and its Lagrangian dual by showing the tightness of the semidefinite relaxation (SDR) of the considered problem. Then we propose an efficient algorithm based on Lagrangian duality for solving the considered problem. The proposed algorithm judiciously exploits the special structure of the Karush-Kuhn-Tucker (KKT) conditions of the considered problem and finds the solution that satisfies the KKT conditions via two fixed-point iterations. The proposed algorithm is highly efficient (as evaluating the functions in both fixed-point iterations are computationally cheap) and is guaranteed to find the global solution of the problem. Simulation results show the efficiency and the correctness of the proposed algorithm.


title: Deep Video Anomaly Detection: Opportunities and Challenges

abstract: Anomaly detection is a popular and vital task in various research contexts, which has been studied for several decades. To ensure the safety of people's lives and assets, video surveillance has been widely deployed in various public spaces, such as crossroads, elevators, hospitals, banks, and even in private homes. Deep learning has shown its capacity in a number of domains, ranging from acoustics, images, to natural language processing. However, it is non-trivial to devise intelligent video anomaly detection systems cause anomalies significantly differ from each other in different application scenarios. There are numerous advantages if such intelligent systems could be realised in our daily lives, such as saving human resources in a large degree, reducing financial burden on the government, and identifying the anomalous behaviours timely and accurately. Recently, many studies on extending deep learning models for solving anomaly detection problems have emerged, resulting in beneficial advances in deep video anomaly detection techniques. In this paper, we present a comprehensive review of deep learning-based methods to detect the video anomalies from a new perspective. Specifically, we summarise the opportunities and challenges of deep learning models on video anomaly detection tasks, respectively. We put forth several potential future research directions of intelligent video anomaly detection system in various application domains. Moreover, we summarise the characteristics and technical problems in current deep learning methods for video anomaly detection.


title: A Multi-Resolution Front-End for End-to-End Speech Anti-Spoofing

abstract: The choice of an optimal time-frequency resolution is usually a difficult but important step in tasks involving speech signal classification, e.g., speech anti-spoofing. The variations of the performance with different choices of timefrequency resolutions can be as large as those with different model architectures, which makes it difficult to judge what the improvement actually comes from when a new network architecture is invented and introduced as the classifier. In this paper, we propose a multi-resolution front-end for feature extraction in an end-to-end classification framework. Optimal weighted combinations of multiple time-frequency resolutions will be learned automatically given the objective of a classification task. Features extracted with different time-frequency resolutions are weighted and concatenated as inputs to the successive networks, where the weights are predicted by a learnable neural network inspired by the weighting block in squeeze-and-excitation networks (SENet). Furthermore, the refinement of the chosen timefrequency resolutions is investigated by pruning the ones with relatively low importance, which reduces the complexity and size of the model. The proposed method is evaluated on the tasks of speech anti-spoofing in ASVSpoof 2019 and its superiority has been justified by comparing with similar baselines.


title: Privacy-Preserving Feature Selection with Fully Homomorphic Encryption

abstract: For the feature selection problem, we propose an efficient privacy-preserving algorithm. Let $D$, $F$, and $C$ be data, feature, and class sets, respectively, where the feature value $x(F_i)$ and the class label $x(C)$ are given for each $x\in D$ and $F_i \in F$. For a triple $(D,F,C)$, the feature selection problem is to find a consistent and minimal subset $F' \subseteq F$, where `consistent' means that, for any $x,y\in D$, $x(C)=y(C)$ if $x(F_i)=y(F_i)$ for $F_i\in F'$, and `minimal' means that any proper subset of $F'$ is no longer consistent. On distributed datasets, we consider feature selection as a privacy-preserving problem: Assume that semi-honest parties $\textsf A$ and $\textsf B$ have their own personal $D_{\textsf A}$ and $D_{\textsf B}$. The goal is to solve the feature selection problem for $D_{\textsf A}\cup D_{\textsf B}$ without revealing their privacy. In this paper, we propose a secure and efficient algorithm based on fully homomorphic encryption, and we implement our algorithm to show its effectiveness for various practical data. The proposed algorithm is the first one that can directly simulate the CWC (Combination of Weakest Components) algorithm on ciphertext, which is one of the best performers for the feature selection problem on the plaintext.


title: Feature Selection for Recommender Systems with Quantum Computing

abstract: The promise of quantum computing to open new unexplored possibilities in several scientific fields has been long discussed, but until recently the lack of a functional quantum computer has confined this discussion mostly to theoretical algorithmic papers. It was only in the last few years that small but functional quantum computers have become available to the broader research community. One paradigm in particular, quantum annealing, can be used to sample optimal solutions for a number of NP-hard optimization problems represented with classical operations research tools, providing an easy access to the potential of this emerging technology. One of the tasks that most naturally fits in this mathematical formulation is feature selection. In this paper, we investigate how to design a hybrid feature selection algorithm for recommender systems that leverages the domain knowledge and behavior hidden in the user interactions data. We represent the feature selection as an optimization problem and solve it on a real quantum computer, provided by D-Wave. The results indicate that the proposed approach is effective in selecting a limited set of important features and that quantum computers are becoming powerful enough to enter the wider realm of applied science.


title: Causal versus local $GW$+EDMFT scheme and application to the triangular-lattice extended Hubbard model

abstract: Using the triangular-lattice extended Hubbard model as a test system, we compare $GW$+EDMFT results for the recently proposed self-consistency scheme with causal auxiliary fields to those obtained from the standard implementation which identifies the impurity Green's functions with the corresponding local lattice Green's functions. Both for short-ranged and long-ranged interactions we find similar results, but the causal scheme yields slightly stronger correlation effects at half-filling. We use the two implementations of $GW$+EDMFT to compute spectral functions and dynamically screened interactions in the parameter regime relevant for 1$T$-TaS$_2$. We address the question whether or not the sample used in a recent photoemission study [Phys. Rev. Lett. 120, 166401 (2018)] was half-filled or hole-doped.


title: Realization of second-order photonic square-root topological insulators

abstract: Square-root higher-order topological insulators (HOTIs) are recently discovered new topological phases, with intriguing topological properties inherited from a parent lattice Hamiltonian. Different from conventional HOTIs, the square-root HOTIs typically manifest two paired non-zero energy corner states. In this work, we experimentally demonstrate the second-order square-root HOTIs in photonics for the first time to our knowledge, thereby unveiling such distinct corner states. The specific platform is a laser-written decorated honeycomb lattice (HCL), for which the squared Hamiltonian represents a direct sum of the underlying HCL and breathing Kagome lattice. The localized corner states residing in different bandgaps are observed with characteristic phase structures, in sharp contrast to discrete diffraction in a topologically trivial structure. Our work illustrates a scheme to study fundamental topological phenomena in systems with coexistence of spin-1/2 and spin-1 Dirac-Weyl fermions, and may bring about new possibilities in topology-driven photonic devices.


title: Adaptive Multi-view and Temporal Fusing Transformer for 3D Human Pose Estimation

abstract: This paper proposes a unified framework dubbed Multi-view and Temporal Fusing Transformer (MTF-Transformer) to adaptively handle varying view numbers and video length without camera calibration in 3D Human Pose Estimation (HPE). It consists of Feature Extractor, Multi-view Fusing Transformer (MFT), and Temporal Fusing Transformer (TFT). Feature Extractor estimates 2D pose from each image and fuses the prediction according to the confidence. It provides pose-focused feature embedding and makes subsequent modules computationally lightweight. MFT fuses the features of a varying number of views with a novel Relative-Attention block. It adaptively measures the implicit relative relationship between each pair of views and reconstructs more informative features. TFT aggregates the features of the whole sequence and predicts 3D pose via a transformer. It adaptively deals with the video of arbitrary length and fully unitizes the temporal information. The migration of transformers enables our model to learn spatial geometry better and preserve robustness for varying application scenarios. We report quantitative and qualitative results on the Human3.6M, TotalCapture, and KTH Multiview Football II. Compared with state-of-the-art methods with camera parameters, MTF-Transformer obtains competitive results and generalizes well to dynamic capture with an arbitrary number of unseen views.


title: Consistency of the Full and Reduced Order Models for Evolve-Filter-Relax Regularization of Convection-Dominated, Marginally-Resolved Flows

abstract: Numerical stabilization is often used to eliminate (alleviate) the spurious oscillations generally produced by full order models (FOMs) in under-resolved or marginally-resolved simulations of convection-dominated flows. In this paper we investigate the role of numerical stabilization in reduced order models (ROMs) of convection-dominated, marginally-resolved flows. Specifically, we investigate the FOM-ROM consistency, i.e., whether the numerical stabilization is beneficial both at the FOM and the ROM level. As a numerical stabilization strategy, we focus on the evolve-filter-relax (EFR) regularization algorithm, which centers around spatial filtering. To investigate the FOM-ROM consistency, we consider two ROM strategies: (i) the EFR-ROM, in which the EFR stabilization is used at the FOM level, but not at the ROM level; and (ii) the EFR-EFRROM, in which the EFR stabilization is used both at the FOM and at the ROM level. We compare the EFR-ROM with the EFR-EFRROM in the numerical simulation of a 2D flow past a circular cylinder in the convection-dominated, marginally-resolved regime. We also perform model reduction with respect to both time and Reynolds number. Our numerical investigation shows that the EFR-EFRROM is more accurate than the EFR-ROM, which suggests that FOM-ROM consistency is beneficial in convection-dominated, marginally-resolved flows.


title: An intuitive scheme for the restoration of entanglement for polarization-entangled photons emitted from quantum dots with non-vanishing fine structure splitting

abstract: Generation of polarization-entangled photons from quantum dots via the biexciton-exciton recombination cascade is complicated by the presence of an energy spitting between the intermediate excitonic levels, which severely degrades the quality of the entangled photon source. In this paper we present a novel, conceptually simple and straightforward proposal for restoring the entanglement of said source by applying a cascade of time-dependent operations on the emitted photons. This is in striking contrast with the techniques usually employed, that act on the quantum emitter itself in order to remove the fine structure splitting at its root. The feasibility of the implementation with current technology is discussed, and the robustness of the proposed compensation scheme with respect to imperfections of the experimental apparatus is evaluated via a series of Monte Carlo simulations.