title: Deep Learning for Estimation and Pilot Signal Design in Few-Bit Massive MIMO Systems

abstract: Estimation in few-bit MIMO systems is challenging, since the received signals are nonlinearly distorted by the low-resolution ADCs. In this paper, we propose a deep learning framework for channel estimation, data detection, and pilot signal design to address the nonlinearity in such systems. The proposed channel estimation and data detection networks are model-driven and have special structures that take advantage of the domain knowledge in the few-bit quantization process. While the first data detection network, namely B-DetNet, is based on a linearized model obtained from the Bussgang decomposition, the channel estimation network and the second data detection network, namely FBM-CENet and FBM-DetNet respectively, rely on the original quantized system model. To develop FBM-CENet and FBM-DetNet, the maximum-likelihood channel estimation and data detection problems are reformulated to overcome the vanishing gradient issue. An important feature of the proposed FBM-CENet structure is that the pilot matrix is integrated into its weight matrices of the channel estimator. Thus, training the proposed FBM-CENet enables a joint optimization of both the channel estimator at the base station and the pilot signal transmitted from the users. Simulation results show significant performance gain in estimation accuracy by the proposed deep learning framework.


title: Phonon-Enhanced Nonlinearities in Hexagonal Boron Nitride

abstract: We investigate optical nonlinearities that are induced and enhanced due to the strong phonon resonance in hexagonal boron nitride. We predict and observe large sub-picosecond duration signals due to four-wave mixing (FWM) during resonant excitation. The resulting FWM signal allows for time-resolved observation of the crystal motion. In addition, we observe enhancements of third-harmonic generation with resonant pumping at the hBN transverse optical phonon. Phonon-induced nonlinear enhancements are also predicted to yield large increases in high-harmonic efficiencies.


title: Temporal Alignment Prediction for Few-Shot Video Classification

abstract: The goal of few-shot video classification is to learn a classification model with good generalization ability when trained with only a few labeled videos. However, it is difficult to learn discriminative feature representations for videos in such a setting. In this paper, we propose Temporal Alignment Prediction (TAP) based on sequence similarity learning for few-shot video classification. In order to obtain the similarity of a pair of videos, we predict the alignment scores between all pairs of temporal positions in the two videos with the temporal alignment prediction function. Besides, the inputs to this function are also equipped with the context information in the temporal domain. We evaluate TAP on two video classification benchmarks including Kinetics and Something-Something V2. The experimental results verify the effectiveness of TAP and show its superiority over state-of-the-art methods.


title: 4D effective action from non-Abelian DBI action with magnetic flux background

abstract: We study a systematic derivation of four dimensional $\mathcal{N}=1$ supersymmetric effective theory from ten dimensional non-Abelian Dirac-Born-Infeld action compactified on a six dimensional torus with magnetic fluxes on the D-branes. We find a new type of matter K\"{a}hler metric while gauge kinetic function and superpotential are consistent with previous studies. For the ten dimensional action, we use a symmetrized trace prescription and focus on the bosonic part up to $\mathcal{O}(F^4)$. In the presence of the supersymmetry, four dimensional chiral fermions can be obtained via index theorem. The new matter K\"{a}hler metric is independent of flavor but depends on the fluxes, 4D dilaton, K\"{a}hler moduli and complex structure moduli, and will be always positive definite if an induced Ramond-Ramond charge of the D-branes on which matters are living are positive. We read the superpotential from an F-term scalar quartic interaction derived from the ten dimensional action and the contribution of the new matter K\"{a}hler metric to the scalar potential which we derive turns out to be consistent with the supergravity formulation.


title: No hyperbolic sets in J_\infty for infinitely renormalizable quadratic polynomials

abstract: Let f be an infinitely-renormalizable quadratic polynomial and J_\infty be the intersection of forward orbits of "small" Julia sets of simple renormalizations of f. We prove that J_\infty contains no hyperbolic sets.


title: Can we infer player behavior tendencies from a player's decision-making data? Integrating Theory of Mind to Player Modeling

abstract: Game AI systems need the theory of mind, which is the humanistic ability to infer others' mental models, preferences, and intent. Such systems would enable inferring players' behavior tendencies that contribute to the variations in their decision-making behaviors. To that end, in this paper, we propose the use of inverse Bayesian inference to infer behavior tendencies given a descriptive cognitive model of a player's decision making. The model embeds behavior tendencies as weight parameters in a player's decision-making. Inferences on such parameters provide intuitive interpretations about a player's cognition while making in-game decisions. We illustrate the use of inverse Bayesian inference with synthetically generated data in a game called \textit{BoomTown} developed by Gallup. We use the proposed model to infer a player's behavior tendencies for moving decisions on a game map. Our results indicate that our model is able to infer these parameters towards uncovering not only a player's decision making but also their behavior tendencies for making such decisions.


title: Superconducting Quantum Amplifier-Integrator in Ultra-High Speed Continuous-time Delta-Sigma Converter

abstract: Present semiconductor research is increasingly focusing on either higher speeds or higher linearity or both. Applications range from consumer, industrial, healthcare and military. Typically such circuits are fabricated in today's low-voltage CMOS processes using silicon and in few cases BJT-CMOS combined like Gallium-Arsenide or Indium-Phosphide. These technology nodes face a plethora of problems like reduction of dynamic range of the circuit due to mismatch, distortion, noise, thermal and electromigration issues due to excessive currents, etc. Compounding these problems is the issue with lower achievable gain from an amplifier which often gets limited due to lower supply voltages in such technology nodes. Slowly circuit techniques like chopping, cascoding, cascading and calibration are nearing their limits. In this paper we present a radically different approach to our regular analog design building blocks using macroscopic quantum effects which have hitherto not found favour with the design community. We will solely focus on the effect of superconductivity and adopting its macroscopic phenomena to amplifiers, integrators and comparators. Using staggered superconductors we can achieve a gain which depends only on physical quantum constants and remains invariant under process, temperature, supply, interference, etc. This robustness of gain in an amplifier goes a long way in attaining higher linearity. The comparator can resolve a minimum of 2.07fT magnetic flux but when embedded inside a Delta-Sigma loop can typically attain 100 times smaller resolution pushing the boundaries of sensing.


title: Playtesting: What is Beyond Personas

abstract: Playtesting is an essential step in the game design process. Game designers use the feedback from playtests to refine their designs. Game designers may employ procedural personas to automate the playtesting process. In this paper, we present two approaches to improve automated playtesting. First, we propose developing persona, which allows a persona to progress to different goals. In contrast, the procedural persona is fixed to a single goal. Second, a human playtester knows which paths she has tested before, and during the consequent tests, she may test different paths. However, Reinforcement Learning (RL) agents disregard these previous paths. We propose a novel methodology that we refer to as Alternative Path Finder (APF). We train APF with previous paths and employ APF during the training of an RL agent. APF modulates the reward structure of the environment while preserving the agent's goal. When evaluated, the agent generates a different trajectory that achieves the same goal. We use the General Video Game Artificial Intelligence (GVG-AI) and VizDoom frameworks to test our proposed methodologies. We use Proximal Policy Optimization (PPO) RL agent during experiments. First, we compare the playtest data generated by developing and procedural persona. Our experiments show that developing persona provides better insight into the game and how different players would play. Second, we present the alternative paths found using APF and argue why traditional RL agents cannot learn those paths.


title: When SRv6 meets 5G Core: Implementation and Deployment of a Network Service Chaining Function in SmartNICs

abstract: Currently, we have witnessed a myriad of solutions that benefit from programmable hardware. The 5G Core (5GC) can and should also benefit from such paradigm to offload certain functions to the dataplane. In this work, we designed and implemented a P4-based solution for traffic identification and chaining using the Netronome Agilo SmartNIC. The solution here presented is deployed in-between the RAN and UPF (User Plane Function) so that traffic coming from the RAN is identified and chained using SRv6 based on different rules defined by the control plane. The traffic identification and the construction of the SRv6 list of segments are done entirely in the SmartNIC. A minimalist Proof-of-Concept (PoC) was deployed and evaluated to show that this function is perfectly capable to build service function chainings in a transparent and efficient way.


title: COMPARE: Accelerating Groupwise Comparison in Relational Databases for Data Analytics

abstract: Data analysis often involves comparing subsets of data across many dimensions for finding unusual trends and patterns. While the comparison between subsets of data can be expressed using SQL, they tend to be complex to write, and suffer from poor performance over large and high-dimensional datasets. In this paper, we propose a new logical operator COMPARE for relational databases that concisely captures the enumeration and comparison between subsets of data and greatly simplifies the expressing of a large class of comparative queries. We extend the database engine with optimization techniques that exploit the semantics of COMPARE to significantly improve the performance of such queries. We have implemented these extensions inside Microsoft SQL Server, a commercial DBMS engine. Our extensive evaluation on synthetic and real-world datasets shows that COMPARE results in a significant speedup over existing approaches, including physical plans generated by today's database systems, user-defined function (UDF), as well as middleware solutions that compare subsets outside the databases.


title: Inplace Gated Convolutional Recurrent Neural Network For Dual-channel Speech Enhancement

abstract: For dual-channel speech enhancement, it is a promising idea to design an end-to-end model based on the traditional array signal processing guideline and the manifold space of multi-channel signals. We found that the idea above can be effectively implemented by the classical convolutional recurrent neural networks (CRN) architecture. We propose a very compact in place gated convolutional recurrent neural network (inplace GCRN) for end-to-end multi-channel speech enhancement, which utilizes inplace-convolution for frequency pattern extraction and reconstruction. The inplace characteristics efficiently preserve spatial cues in each frequency bin for channel-wise long short-term memory neural networks (LSTM) tracing the spatial source. In addition, we come up with a new spectrum recovery method by predict amplitude mask, mapping, and phase, which effectively improves the speech quality.


title: A note on Clebsch-Gordan integral, Fourier-Legendre expansions and closed form for hypergeometric series

abstract: In this paper we show that a closed form formula for the generalized Clebsch-Gordan integral and the Fourier-Legendre expansion theory allow to evaluate hypergeometric series involving powers of the normalized central binomial coefficient ${\displaystyle \frac{1}{4^{n}}\dbinom{2n}{n}}$.


title: Boosting Entity-aware Image Captioning with Multi-modal Knowledge Graph

abstract: Entity-aware image captioning aims to describe named entities and events related to the image by utilizing the background knowledge in the associated article. This task remains challenging as it is difficult to learn the association between named entities and visual cues due to the long-tail distribution of named entities. Furthermore, the complexity of the article brings difficulty in extracting fine-grained relationships between entities to generate informative event descriptions about the image. To tackle these challenges, we propose a novel approach that constructs a multi-modal knowledge graph to associate the visual objects with named entities and capture the relationship between entities simultaneously with the help of external knowledge collected from the web. Specifically, we build a text sub-graph by extracting named entities and their relationships from the article, and build an image sub-graph by detecting the objects in the image. To connect these two sub-graphs, we propose a cross-modal entity matching module trained using a knowledge base that contains Wikipedia entries and the corresponding images. Finally, the multi-modal knowledge graph is integrated into the captioning model via a graph attention mechanism. Extensive experiments on both GoodNews and NYTimes800k datasets demonstrate the effectiveness of our method.


title: A Real Time Monitoring Approach for Bivariate Event Data

abstract: Early detection of changes in the frequency of events is an important task, in, for example, disease surveillance, monitoring of high-quality processes, reliability monitoring and public health. In this article, we focus on detecting changes in multivariate event data, by monitoring the time-between-events (TBE). Existing multivariate TBE charts are limited in the sense that, they only signal after an event occurred for each of the individual processes. This results in delays (i.e., long time to signal), especially if it is of interest to detect a change in one or a few of the processes. We propose a bivariate TBE (BTBE) chart which is able to signal in real time. We derive analytical expressions for the control limits and average time-to-signal performance, conduct a performance evaluation and compare our chart to an existing method. The findings showed that our method is a realistic approach to monitor bivariate time-between-event data, and has better detection ability than existing methods. A large benefit of our method is that it signals in real-time and that due to the analytical expressions no simulation is needed. The proposed method is implemented on a real-life dataset related to AIDS.


title: Trade When Opportunity Comes: Price Movement Forecasting via Locality-Aware Attention and Iterative Refinement Labeling

abstract: Price movement forecasting aims at predicting the future trends of financial assets based on the current market conditions and other relevant information. Recently, machine learning (ML) methods have become increasingly popular and achieved promising results for price movement forecasting in both academia and industry. Most existing ML solutions formulate the forecasting problem as a classification (to predict the direction) or a regression (to predict the return) problem over the entire set of training data. However, due to the extremely low signal-to-noise ratio and stochastic nature of financial data, good trading opportunities are extremely scarce. As a result, without careful selection of potentially profitable samples, such ML methods are prone to capture the patterns of noises instead of real signals. To address this issue, we propose a novel price movement forecasting framework named LARA consisting of two main components: Locality-Aware Attention (LA-Attention) and Iterative Refinement Labeling (RA-Labeling). (1) LA-Attention automatically extracts the potentially profitable samples by attending to label information. Moreover, equipped with metric learning techniques, LA-Attention enjoys task-specific distance metrics and effectively distributes attention to potentially profitable samples. (2) RA-Labeling further iteratively refines the noisy labels of potentially profitable samples, and combines the learned predictors robust to the unseen and noisy samples. In a set of experiments on three real-world financial markets: stocks, cryptocurrencies, and ETFs, LARA significantly outperforms several machine learning based methods on the Qlib quantitative investment platform. Extensive ablation studies and experiments also demonstrate that LARA indeed captures more reliable trading opportunities.


title: Pseudo-magnetic field-induced ultra-slow carrier dynamics in periodically strained graphene

abstract: The creation of pseudo-magnetic fields in strained graphene has emerged as a promising route to allow observing intriguing physical phenomena that would be unattainable with laboratory superconducting magnets. Scanning tunneling spectroscopy experiments have successfully measured the pseudo-Landau levels and proved the existence of pseudo-magnetic fields in various strained graphene systems. These giant pseudo-magnetic fields observed in highly deformed graphene can substantially alter the optical properties of graphene beyond a level that can be feasible with an external magnetic field, but the experimental signatures of the influence of such pseudo-magnetic fields have yet to be unveiled. Here, using time-resolved infrared pump-probe spectroscopy, we provide unambiguous evidence for ultra-slow carrier dynamics enabled by pseudo-magnetic fields in periodically strained graphene. Strong pseudo-magnetic fields of ~100 T created by non-uniform strain in graphene nanopillars are found to significantly decelerate the relaxation processes of hot carriers by more than an order of magnitude. Our finding presents unforeseen opportunities for harnessing the new physics of graphene enabled by pseudo-magnetic fields for optoelectronics and condensed matter physics.


title: For which functions are $f(X_t)-\mathbb{E} f(X_t)$ and $g(X_t)/\mathbb{E} g(X_t)$ martingales?

abstract: Let $X=(X_t)_{t\geq 0}$ be a one-dimensional L\'evy process such that each $X_t$ has a $C^1_b$-density w.r.t. Lebesgue measure and certain polynomial or exponential moments. We characterize all polynomially bounded functions $f:\mathbb{R}\to\mathbb{R}$, and exponentially bounded functions $g:\mathbb{R}\to (0,\infty)$, such that $f(X_t)-\mathbb{E} f(X_t)$, resp. $g(X_t)/\mathbb{E} g(X_t)$, are martingales.


title: A Transductive Maximum Margin Classifier for Few-Shot Learning

abstract: Few-shot learning aims to train a classifier that can generalize well when just a small number of labeled examples per class are given. We introduce a transductive maximum margin classifier for few-shot learning (FS-TMMC). The basic idea of the classical maximum margin classifier is to solve an optimal prediction function so that the training data can be correctly classified by the resulting classifer with the largest geometric margin. In few-shot learning, it is challenging to find such classifiers with good generalization ability due to the insufficiency of training data in the support set. FS-TMMC leverages the unlabeled query examples to adjust the separating hyperplane of the maximum margin classifier such that the prediction function is optimal on both the support and query sets. Furthermore, we use an efficient and effective quasi-Newton algorithm, the L-BFGS method for optimization. Experimental results on three standard few-shot learning benchmarks including miniImagenet, tieredImagenet and CUB show that our method achieves state-of-the-art performance.


title: One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrieval

abstract: We present Cross-lingual Open-Retrieval Answer Generation (CORA), the first unified many-to-many question answering (QA) model that can answer questions across many languages, even for ones without language-specific annotated data or knowledge sources. We introduce a new dense passage retrieval algorithm that is trained to retrieve documents across languages for a question. Combined with a multilingual autoregressive generation model, CORA answers directly in the target language without any translation or in-language retrieval modules as used in prior work. We propose an iterative training method that automatically extends annotated data available only in high-resource languages to low-resource ones. Our results show that CORA substantially outperforms the previous state of the art on multilingual open QA benchmarks across 26 languages, 9 of which are unseen during training. Our analyses show the significance of cross-lingual retrieval and generation in many languages, particularly under low-resource settings.


title: Strategyproof Facility Location in Perturbation Stable Instances

abstract: We consider $k$-Facility Location games, where $n$ strategic agents report their locations on the real line, and a mechanism maps them to $k\ge 2$ facilities. Each agent seeks to minimize her distance to the nearest facility. We are interested in (deterministic or randomized) strategyproof mechanisms without payments that achieve a reasonable approximation ratio to the optimal social cost of the agents. To circumvent the inapproximability of $k$-Facility Location by deterministic strategyproof mechanisms, we restrict our attention to perturbation stable instances. An instance of $k$-Facility Location on the line is $\gamma$-perturbation stable (or simply, $\gamma$-stable), for some $\gamma\ge 1$, if the optimal agent clustering is not affected by moving any subset of consecutive agent locations closer to each other by a factor at most $\gamma$. We show that the optimal solution is strategyproof in $(2+\sqrt{3})$-stable instances whose optimal solution does not include any singleton clusters, and that allocating the facility to the agent next to the rightmost one in each optimal cluster (or to the unique agent, for singleton clusters) is strategyproof and $(n-2)/2$-approximate for $5$-stable instances (even if their optimal solution includes singleton clusters). On the negative side, we show that for any $k\ge 3$ and any $\delta > 0$, there is no deterministic anonymous mechanism that achieves a bounded approximation ratio and is strategyproof in $(\sqrt{2}-\delta)$-stable instances. We also prove that allocating the facility to a random agent of each optimal cluster is strategyproof and $2$-approximate in $5$-stable instances. To the best of our knowledge, this is the first time that the existence of deterministic (resp. randomized) strategyproof mechanisms with a bounded (resp. constant) approximation ratio is shown for a large and natural class of $k$-Facility Location instances.


title: Meta-FDMixup: Cross-Domain Few-Shot Learning Guided by Labeled Target Data

abstract: A recent study finds that existing few-shot learning methods, trained on the source domain, fail to generalize to the novel target domain when a domain gap is observed. This motivates the task of Cross-Domain Few-Shot Learning (CD-FSL). In this paper, we realize that the labeled target data in CD-FSL has not been leveraged in any way to help the learning process. Thus, we advocate utilizing few labeled target data to guide the model learning. Technically, a novel meta-FDMixup network is proposed. We tackle this problem mainly from two aspects. Firstly, to utilize the source and the newly introduced target data of two different class sets, a mixup module is re-proposed and integrated into the meta-learning mechanism. Secondly, a novel disentangle module together with a domain classifier is proposed to extract the disentangled domain-irrelevant and domain-specific features. These two modules together enable our model to narrow the domain gap thus generalizing well to the target datasets. Additionally, a detailed feasibility and pilot study is conducted to reflect the intuitive understanding of CD-FSL under our new setting. Experimental results show the effectiveness of our new setting and the proposed method. Codes and models are available at https://github.com/lovelyqian/Meta-FDMixup.


title: HYPER-SNN: Towards Energy-efficient Quantized Deep Spiking Neural Networks for Hyperspectral Image Classification

abstract: Hyper spectral images (HSI) provide rich spectral and spatial information across a series of contiguous spectral bands. However, the accurate processing of the spectral and spatial correlation between the bands requires the use of energy-expensive 3-D Convolutional Neural Networks (CNNs). To address this challenge, we propose the use of Spiking Neural Networks (SNNs) that are generated from iso-architecture CNNs and trained with quantization-aware gradient descent to optimize their weights, membrane leak, and firing thresholds. During both training and inference, the analog pixel values of a HSI are directly applied to the input layer of the SNN without the need to convert to a spike-train. The reduced latency of our training technique combined with high activation sparsity yields significant improvements in computational efficiency. We evaluate our proposal using three HSI datasets on a 3-D and a 3-D/2-D hybrid convolutional architecture. We achieve overall accuracy, average accuracy, and kappa coefficient of 98.68%, 98.34%, and 98.20% respectively with 5 time steps (inference latency) and 6-bit weight quantization on the Indian Pines dataset. In particular, our models achieved accuracies similar to state-of-the-art (SOTA) with 560.6 and 44.8 times less compute energy on average over three HSI datasets than an iso-architecture full-precision and 6-bit quantized CNN, respectively.


title: Influence of sample momentum space features on scanning tunnelling microscope measurements

abstract: Theoretical understanding of scanning tunnelling microscope (STM) measurements involve electronic structure details of the STM tip and the sample being measured. Conventionally, the focus has been on the accuracy of the electronic state simulations of the sample, whereas the STM tip electronic state is typically approximated as a simple spherically symmetric $ s $ orbital. This widely used $ s $ orbital approximation has failed in recent STM studies where the measured STM images of subsurface impurity wave functions in silicon required a detailed description of the STM tip electronic state. In this work, we show that the failure of the $ s $ orbital approximation is due to the indirect band-gap of the sample material silicon (Si), which gives rise to complex valley interferences in the momentum space of impurity wave functions. Based on direct comparison of STM images computed from multi-million-atom electronic structure calculations of impurity wave functions in direct (GaAs) and indirect (Si) band-gap materials, our results establish that whilst the selection of STM tip orbital only plays a minor qualitative role for the direct band gap GaAs material, the STM measurements are dramatically modified by the momentum space features of the indirect band gap Si material, thereby requiring a quantitative representation of the STM tip orbital configuration. Our work provides new insights to understand future STM studies of semiconductor materials based on their momentum space features, which will be important for the design and implementation of emerging technologies in the areas of quantum computing, photonics, spintronics and valleytronics.

categories: cond-mat.mtrl-sci cond-mat.mes-hall physics.app-ph physics.comp-ph quant-ph


title: An exchange-based surface-code quantum computer architecture in silicon

abstract: Phosphorus donor spins in silicon offer a number of promising characteristics for the implementation of robust qubits. Amongst various concepts for scale-up, the shared-control concept takes advantage of 3D scanning tunnelling microscope (STM) fabrication techniques to minimise the number of control lines, allowing the donors to be placed at the pitch limit of $\geq$30 nm, enabling dipole interactions. A fundamental challenge is to exploit the faster exchange interaction, however, the donor spacings required are typically 15 nm or less, and the exchange interaction is notoriously sensitive to lattice site variations in donor placement. This work presents a proposal for a fast exchange-based surface-code quantum computer architecture which explicitly addresses both donor placement imprecision commensurate with the atomic-precision fabrication techniques and the stringent qubit pitch requirements. The effective pitch is extended by incorporation of an intermediate donor acting as an exchange-interaction switch. We consider both global control schemes and a scheduled series of operations by designing GRAPE pulses for individual CNOTs based on coupling scenarios predicted by atomistic tight-binding simulations. The architecture is compatible with the existing fabrication capabilities and may serve as a blueprint for the experimental implementation of a full-scale fault-tolerant quantum computer based on donor impurities in silicon.


title: Scalable Solvent-Based Fabrication of Thermo-Responsive Polymer Nanocomposites for Battery Safety Regulation

abstract: Improving lithium-ion batteries (LIBs) safety remains in a challenging task when compared with the tremendous progress made in their performance in recent years. Embedding thermo-responsive polymer switching materials (TRPS) into LIB cells has been proved to be a promising strategy to provide consistent thermal abuse protections at coin-cell level. However, it is unrealistic to achieve large-scale applications without further demonstration in high-capacity pouch cells. Here, we employed tungsten carbide (WC) as a novel conductive filler, and successfully overcame the intrinsic processing difficulty of polyethylene (PE) matrix in a scalable solvent-based method to obtain ultra-thin, uniform, highly conductive TRPS. Moreover, by integrating TRPS directly into LIB electrodes, no extra fabrication facilities or processes are required for making the cells. As a result, multi-layer pouch cells with consistent electrochemical performance and thermal abuse protection function were fabricated using industry relevant manufacturing techniques, which brings TRPS one step further to the real application scenarios.


title: ThunderRW: An In-Memory Graph Random Walk Engine (Complete Version)

abstract: As random walk is a powerful tool in many graph processing, mining and learning applications, this paper proposes an efficient in-memory random walk engine named ThunderRW. Compared with existing parallel systems on improving the performance of a single graph operation, ThunderRW supports massive parallel random walks. The core design of ThunderRW is motivated by our profiling results: common RW algorithms have as high as 73.1% CPU pipeline slots stalled due to irregular memory access, which suffers significantly more memory stalls than the conventional graph workloads such as BFS and SSSP. To improve the memory efficiency, we first design a generic step-centric programming model named Gather-Move-Update to abstract different RW algorithms. Based on the programming model, we develop the step interleaving technique to hide memory access latency by switching the executions of different random walk queries. In our experiments, we use four representative RW algorithms including PPR, DeepWalk, Node2Vec and MetaPath to demonstrate the efficiency and programming flexibility of ThunderRW. Experimental results show that ThunderRW outperforms state-of-the-art approaches by an order of magnitude, and the step interleaving technique significantly reduces the CPU pipeline stall from 73.1% to 15.0%.


title: The effect of the morphological quenching mechanism on star formation activity at 0.5 < z < 1.5 in 3D-HST/CANDELS

abstract: Several mechanisms for the transformation of blue star-forming to red quiescent galaxies have been proposed, and the green valley (GV) galaxies amid them are widely accepted in a transitional phase. Thus, comparing the morphological and environmental differences of the GV galaxies with early-type disks (ETDs; bulge dominated and having a disk) and late-type disks (LTDs; disk dominated) is suitable for distinguishing the corresponding quenching mechanisms. A large population of massive ($M_* \geqslant 10^{10}M_\odot$) GV galaxies at $0.5 \leqslant z \leqslant 1.5$ in 3D-HST/CANDELS is selected using extinction-corrected $(U-V)_{\rm rest}$ color. After eliminating any possible active galactic nucleus candidates and considering the "mass-matching", we finally construct two comparable samples of GV galaxies with either 319 ETD or 319 LTD galaxies. Compared to the LTD galaxies, it is found that the ETD galaxies possess higher concentration index and lower specific star formation rate, whereas the environments surrounding them are not different. This may suggest that the morphological quenching may dominate the star formation activity of massive GV galaxies rather than the environmental quenching. To quantify the correlation between the galaxy morphology and the star formation activity, we define a dimensionless morphology quenching efficiency $Q_{\rm mor}$ and find that $Q_{\rm mor}$ is not sensitive to the stellar mass and redshift. When the difference between the average star formation rate of ETD and LTD galaxies is about 0.7 $M_\odot \rm \;yr^{-1}$, the probability of $Q_{\rm mor}\gtrsim 0.2$ is higher than 90\%, which implies that the degree of morphological quenching in GV galaxies might be described by $Q_{\rm mor}\gtrsim 0.2$.


title: Autonomous Coordinated Control of the Light Guide for Positioning in Vitreoretinal Surgery

abstract: Vitreoretinal surgery is challenging even for expert surgeons owing to the delicate target tissues and the diminutive workspace in the retina. In addition to improved dexterity and accuracy, robot assistance allows for (partial) task automation. In this work, we propose a strategy to automate the motion of the light guide with respect to the surgical instrument. This automation allows the instrument's shadow to always be inside the microscopic view, which is an important cue for the accurate positioning of the instrument in the retina. We show simulations and experiments demonstrating that the proposed strategy is effective in a 700-point grid in the retina of a surgical phantom. Furthermore, we integrated the proposed strategy with image processing and succeeded in positioning the surgical instrument's tip in the retina, relying on only the robot's geometric information and microscopic images.


title: Benign Adversarial Attack: Tricking Models for Goodness

abstract: In spite of the successful application in many fields, machine learning models today suffer from notorious problems like vulnerability to adversarial examples. Beyond falling into the cat-and-mouse game between adversarial attack and defense, this paper provides alternative perspective to consider adversarial example and explore whether we can exploit it in benign applications. We first attribute adversarial example to the human-model disparity on employing non-semantic features. While largely ignored in classical machine learning mechanisms, non-semantic feature enjoys three interesting characteristics as (1) exclusive to model, (2) critical to affect inference, and (3) utilizable as features. Inspired by this, we present brave new idea of benign adversarial attack to exploit adversarial examples for goodness in three directions: (1) adversarial Turing test, (2) rejecting malicious model application, and (3) adversarial data augmentation. Each direction is positioned with motivation elaboration, justification analysis and prototype applications to showcase its potential.


title: Laser-equipped gas reaction chamber for probing environmentally sensitive materials at near atomic scale

abstract: Numerous metallurgical and materials science applications depend on quantitative atomic-scale characterizations of environmentally-sensitive materials and their transient states. Studying the effect upon materials subjected to thermochemical treatments in specific gaseous atmospheres is of central importance for specifically studying a material's resistance to certain oxidative or hydrogen environments. It is also important for investigating catalytic materials, direct reduction of an oxide, particular surface science reactions or nanoparticle fabrication routes. This manuscript realizes such experiments upon a thermochemical reaction chamber called the Reacthub and allows for transferring treated materials under cryogenic & ultrahigh vacuum workflow conditions for characterisation by either atom probe or scanning Xe+/electron microscopies. Two examples are discussed in the present study. One protocol was in the deuterium gas charging (25 kPa D2 at 200 {\deg}C) of a high-manganese twinning-induced-plasticity steel and characterization of the ingress and trapping of hydrogen at various features (grain boundaries in particular) in efforts to relate this to the steel's hydrogen embrittlement susceptibility. Deuterium was successfully detected after gas charging but most contrast originated from the complex ion FeOD+ signal and the feature may be an artefact. The second example considered the direct deuterium reduction (5 kPa D2 at 700 {\deg}C) of a single crystal wuestite sample, demonstrating that under a standard thermochemical treatment causes rapid reduction upon the nanoscale. Further studies are required for complete confidence about these phenomena, but these experiments successfully demonstrate that how an ex-situ thermochemical treatment can be realised that captures environmentally-sensitive transient states that can be analysed by atomic-scale by atom probe microscope.


title: Clustering and enhanced classification using a hybrid quantum autoencoder

abstract: Quantum machine learning (QML) is a rapidly growing area of research at the intersection of classical machine learning and quantum information theory. One area of considerable interest is the use of QML to learn information contained within quantum states themselves. In this work, we propose a novel approach in which the extraction of information from quantum states is undertaken in a classical representational-space, obtained through the training of a hybrid quantum autoencoder (HQA). Hence, given a set of pure states, this variational QML algorithm learns to identify, and classically represent, their essential distinguishing characteristics, subsequently giving rise to a new paradigm for clustering and semi-supervised classification. The analysis and employment of the HQA model are presented in the context of amplitude encoded states - which in principle can be extended to arbitrary states for the analysis of structure in non-trivial quantum data sets.


title: Intrinsic suppression of topological thermal Hall effect in an exactly solvable quantum magnet

abstract: In contrast to electron (fermion) systems, topological phases of charge neutral bosons have been poorly understood despite recent extensive research on insulating magnets. The most important unresolved issue is how the inevitable inter-bosonic interactions influence the topological properties. It has been proposed that the quantum magnet SrCu$_2$(BO$_3$)$_2$ with an exact ground state serves as an ideal platform for this investigation, as the system is expected to be a magnetic analogue of a Chern insulator with electrons replaced by bosonic magnetic excitations (triplons). Here, in order to examine topologically protected triplon chiral edge modes in SrCu$_2$(BO$_3$)$_2$, we measured and calculated the thermal Hall conductivity $\kappa_{xy}$. Our calculations show that the sign of $\kappa_{xy}$ is negative, which is opposite to the previous calculations, and its magnitude is 2$\pi$ times smaller. No discernible $\kappa_{xy}$ was observed, which is at most 20-30% of our calculations if present. This implies that even relatively weak inter-particle interactions seriously influence the topological transport properties at finite temperatures. These demonstrate that, in contrast to fermionic cases, the picture of non-interacting topological quasi-particles cannot be naively applied to bosonic systems, calling special attention to the interpretation of the topological bosonic excitations reported for various insulating magnets.


title: Augmentation Pathways Network for Visual Recognition

abstract: Data augmentation is practically helpful for visual recognition, especially at the time of data scarcity. However, such success is only limited to quite a few light augmentations (e.g., random crop, flip). Heavy augmentations are either unstable or show adverse effects during training, owing to the big gap between the original and augmented images. This paper introduces a novel network design, noted as Augmentation Pathways (AP), to systematically stabilize training on a much wider range of augmentation policies. Notably, AP tames various heavy data augmentations and stably boosts performance without a careful selection among augmentation policies. Unlike traditional single pathway, augmented images are processed in different neural paths. The main pathway handles the light augmentations, while other pathways focus on the heavier augmentations. By interacting with multiple paths in a dependent manner, the backbone network robustly learns from shared visual patterns among augmentations, and suppresses the side effect of heavy augmentations at the same time. Furthermore, we extend AP to high-order versions for high-order scenarios, demonstrating its robustness and flexibility in practical usage. Experimental results on ImageNet demonstrate the compatibility and effectiveness on a much wider range of augmentations, while consuming fewer parameters and lower computational costs at inference time.


title: What Remains of Visual Semantic Embeddings

abstract: Zero shot learning (ZSL) has seen a surge in interest over the decade for its tight links with the mechanism making young children recognize novel objects. Although different paradigms of visual semantic embedding models are designed to align visual features and distributed word representations, it is unclear to what extent current ZSL models encode semantic information from distributed word representations. In this work, we introduce the split of tiered-ImageNet to the ZSL task, in order to avoid the structural flaws in the standard ImageNet benchmark. We build a unified framework for ZSL with contrastive learning as pre-training, which guarantees no semantic information leakage and encourages linearly separable visual features. Our work makes it fair for evaluating visual semantic embedding models on a ZSL setting in which semantic inference is decisive. With this framework, we show that current ZSL models struggle with encoding semantic relationships from word analogy and word hierarchy. Our analyses provide motivation for exploring the role of context language representations in ZSL tasks.


title: HRegNet: A Hierarchical Network for Large-scale Outdoor LiDAR Point Cloud Registration

abstract: Point cloud registration is a fundamental problem in 3D computer vision. Outdoor LiDAR point clouds are typically large-scale and complexly distributed, which makes the registration challenging. In this paper, we propose an efficient hierarchical network named HRegNet for large-scale outdoor LiDAR point cloud registration. Instead of using all points in the point clouds, HRegNet performs registration on hierarchically extracted keypoints and descriptors. The overall framework combines the reliable features in deeper layer and the precise position information in shallower layers to achieve robust and precise registration. We present a correspondence network to generate correct and accurate keypoints correspondences. Moreover, bilateral consensus and neighborhood consensus are introduced for keypoints matching and novel similarity features are designed to incorporate them into the correspondence network, which significantly improves the registration performance. Besides, the whole network is also highly efficient since only a small number of keypoints are used for registration. Extensive experiments are conducted on two large-scale outdoor LiDAR point cloud datasets to demonstrate the high accuracy and efficiency of the proposed HRegNet. The project website is https://ispc-group.github.io/hregnet.


title: Ion Pair Free Energy Surface as a Probe of Ionic Liquid Structure

abstract: The numerous combinations of cations and anions turn out possible to produce ionic liquids with fine-tuned properties once the correlation with the molecular structure is known. In this sense, computer simulations are useful tools to explain and even to predict properties of ionic liquids. However, quantum mechanical methods are usually restricted to either small clusters or short timescales, so that the use of parametrized force fields is needed for studying the bulk liquids. A method is proposed in this work to enable a comparison between quantum mechanical and both polarizable and non-polarizable force fields by means of the calculation of free energy surfaces for the translational motion of the anion around the cation in gas phase. This method was tested for imidazolium-based cations with 3 different anions, [BF4]-, [N(CN)2]-, and [NTf2]-. It was found better agreement with the DFT calculations when polarizability is introduced in the forcefield. In addition, the ion pair free energy surfaces reproduced the main structural patterns observed in the first coordination shell in molecular dynamics simulations of the bulk liquid, proving to be useful probes for the liquid phase structure that can be computed with higher level methods and the comparison with forcefields can indicate further improvements in their parametrization.


title: Complex optical/UV and X-ray variability in Seyfert 1 galaxy Mrk 509

abstract: We performed a detailed spectral and timing analysis of a Seyfert 1 galaxy Mrk 509 using data from the Neil Gehrels Swift observatory that spanned over ~13 years between 2006 and 2019. To study the variability properties from the optical/UV to X-ray emission, we used a total of 275 pointed observations in this work. The average spectrum over the entire duration exhibits a strong soft X-ray excess above the power-law continuum. The soft X-ray excess is well described by two thermal components with temperatures of kT_BB1 ~120 eV and kT_BB2 ~460 eV. The warm thermal component is likely due to the presence of an optically thick and warm Comptonizing plasma in the inner accretion disk. The fractional variability amplitude is found to be decreasing with increasing wavelength, i.e. from the soft X-ray to UV/optical emission. However, the hard X-ray (2-8 keV) emission shows very low variability. The strength of the correlation within the UV and the optical bands (0.95-0.99) is found to be stronger than the correlation between the UV/Optical and X-ray bands (0.40-0.53). These results clearly suggest that the emitting regions of the X-ray and UV/optical emission are likely distinct or partly interacting. Having removed the slow variations in the light curves, we find that the lag spectrum is well described by the 4/3 rule for the standard Shakura-Sunyaev accretion disk when we omit X-ray lags. All these results suggest that the real disk is complex, and the UV emission is likely reprocessed in the accretion disk to give X-ray and optical emission.


title: A scaling relationship for non-thermal radio emission from ordered magnetospheres: from the top of the Main Sequence to planets

abstract: In this paper, we present the analysis of incoherent non-thermal radio emission from a sample of hot magnetic stars, ranging from early-B to early-A spectral type. Spanning a wide range of stellar parameters and wind properties, these stars display a commonality in their radio emission which presents new challenges to the wind scenario as originally conceived. It was thought that relativistic electrons, responsible for the radio emission, originate in current sheets formed where the wind opens the magnetic field lines. However, the true mass-loss rates from the cooler stars are too small to explain the observed non-thermal broadband radio spectra. Instead, we suggest the existence of a radiation belt located inside the inner-magnetosphere, similar to that of Jupiter. Such a structure explains the overall indifference of the broadband radio emissions on wind mass-loss rates. Further, correlating the radio luminosities from a larger sample of magnetic stars with their stellar parameters, the combined roles of rotation and magnetic properties have been empirically determined. Finally, our sample of early-type magnetic stars suggests a scaling relationship between the non-thermal radio luminosity and the electric voltage induced by the magnetosphere's co-rotation, which appears to hold for a broader range of stellar types with dipole-dominated magnetospheres (like the cases of the planet Jupiter and the ultra-cool dwarf stars and brown dwarfs). We conclude that well-ordered and stable rotating magnetospheres share a common physical mechanism for supporting the generation of non-thermal electrons.


title: A Brewster route to Cherenkov detectors

abstract: The Cherenkov effect enables a valuable tool, known as the Cherenkov detector, to identify high-energy particles via the measurement of the Cherenkov cone. However, the sensitivity and momentum coverage of such detectors are intrinsically limited by the refractive index of the host material. Especially, identifying particles with energy above multiple gigaelectronvolts requires host materials with a near-unity refractive index, which are often limited to large and bulky gas chambers. Overcoming this fundamental material limit is important for future particle detectors yet remains a long-standing scientific challenge. Here, we propose a different paradigm for Cherenkov detectors that utilizes the broadband angular filter made from stacks of variable one-dimensional photonic crystals. Owing to the Brewster effect, the angular filter is transparent only to Cherenkov photons from a precise incident angle, and particle identification is achieved by mapping each Cherenkov angle to the peak-intensity position of transmitted photons in the detection plane. This unique property of the angular filter is exceptionally beneficial to Cherenkov detection as it enables the realization of a non-dispersive pseudo refractive index over the entire visible spectrum. Moreover, such a pseudo refractive index can be flexibly tuned to arbitrary values, including those close to unity. Our angular-selective Brewster paradigm offers a feasible solution to implement compact and highly sensitive Cherenkov detectors especially in beam lines and it can cover a wide momentum range using readily available dielectric materials.


title: On the Unified View of Extragalactic Sources based on their Broadband Emission Properties

abstract: Our understanding of the unification of jetted AGNs has advanced greatly as the size of extragalactic sources increased. In the present paper, based on the large sample of radio sources, we compiled 680 blazars (279 FSRQs and 401 BL Lacs) from the 3FGL sample and 64 Seyfert galaxies (3 Narrow-line, 34 and 27 regular Seyfert 1 and Seyfert 2 respectively) from the INTEGRAL survey to statistically test the relationship between Seyfert galaxies and the blazar samples of FSRQs and BL Lacs. We compute the synchrotron (SS), Compton (CS) and inverse Compton (IC) continuous spectra from the low energy components of radio to X-ray, radio to gamma-ray and the high energy component of X-ray to gamma-ray bands, respectively. Results show from the distributions of the continuous spectra that Seyfert galaxies form the tail of the distributions, suggestive of similar underlying history and evolution. A two-sample Kolmogorov-Smirnov test (K.S test) of the continuous spectra showed that Seyfert galaxies differ from BL Lacs and FSRQs in the low energy components of the spectra, while there is no clear difference between them in the high energy component, which implies that high energy emissions in Seyfert galaxies, BL Lacs and FSRQs may be as a result of the same emission mechanism. There is a regular sequence of the distributions on SS/CS and IC/CS planes in each individual subsample. Linear regression analyses of our sample yield significant positive correlations (r greater than 0.60) between SS/CS and IC/CS data. This upturns into an anti-correlation (r greater than -0.60) in IC/SS data. These results are not only consistent with unified scheme for blazars but also show that Seyfert galaxies can be unified with the classical radio-loud AGNs counterparts.


title: A Novel Bivariate Generalized Weibull Distribution with Properties and Applications

abstract: Univariate Weibull distribution is a well-known lifetime distribution and has been widely used in reliability and survival analysis. In this paper, we introduce a new family of bivariate generalized Weibull (BGW) distributions, whose univariate marginals are exponentiated Weibull distribution. Different statistical quantiles like marginals, conditional distribution, conditional expectation, product moments, correlation and a measure component reliability are derived. Various measures of dependence and statistical properties along with ageing properties are examined. Further, the copula associated with BGW distribution and its various important properties are also considered. The methods of maximum likelihood and Bayesian estimation are employed to estimate unknown parameters of the model. A Monte Carlo simulation and real data study are carried out to demonstrate the performance of the estimators and results have proven the effectiveness of the distribution in real-life situations


title: Stable Dynamic Mode Decomposition Algorithm for Noisy Pressure-Sensitive Paint Measurement Data

abstract: In this study, we investigated the stability of dynamic mode decomposition (DMD) algorithms to noisy data. To achieve a stable DMD algorithm, we applied the truncated total least squares (T-TLS) regression and optimal truncation level selection to the TLS DMD algorithm. By adding truncation regularization to the TLS DMD algorithm, T-TLS DMD improves the stability of the computation while maintaining the accuracy of TLS DMD. The effectiveness of the T-TLS DMD was evaluated by the analysis of the wake behind a cylinder and practical pressure-sensitive paint (PSP) data for the buffet cell phenomenon. The results showed the importance of regularization in the DMD algorithm. With respect to the eigenvalues, T-TLS DMD was less affected by noise, and accurate eigenvalues could be obtained stably, whereas the eigenvalues of TLS and subspace DMD varied greatly due to noise. It was also observed that the eigenvalues of the standard and exact DMD had the problem of shifting to the damping side, as reported in previous studies. With respect to eigenvectors, T-TLS and exact DMD captured the characteristic flow patterns clearly even in the presence of noise, whereas TLS and subspace DMD were not able to capture them clearly due to noise.


title: Probing the in-medium $P_T$-broadening by $\gamma$+HF angular de-correlations

abstract: Angular correlations between vector boson and heavy flavors~(HF) are potentially new effective tools to gain insight into the partonic interactions in the quark-gluon plasma (QGP). In this paper, we present the theoretical study of the azimuthal angular de-correlations of $\gamma+$HF in nucleus-nucleus collisions as a new probe of the in-medium $P_T$-broadening effect. The initial production of $\gamma+$HF in p+p is generated by SHERPA which matches the next-to-leading hard processes with parton shower. The in-medium heavy quark evolution is implemented by a Monte Carlo Langevin simulation, which takes into account the collisional and radiative energy loss. We observe considerable suppression at $\Delta\phi_{\gamma D}\sim\pi$ and enhancement at $\Delta\phi_{\gamma D}<2.8$ in $\gamma+$D azimuthal angular distribution in $0-10\%$ Pb+Pb collisions at $\sqrt{s_{NN}}=$5.02 TeV compared to the p+p baseline, which indicates evident in-medium $P_T$-broadening of charm quarks. We also find that the overall modification patterns of $\gamma+$D angular distribution are sensitive to the selection cut of D meson $p_T$. Furthermore, by constructing the 2D ($x_{J}^{\gamma D}, \Delta\phi_{\gamma D}$) correlation diagram, it's possible to display the respective impacts of the two aspects of jet quenching, energy loss and $P_T$-broadening, on the final-state $\gamma+$D observable simultaneously. Additionally, we find weaker angular de-correlations of $\gamma+$B compared to $\gamma+$D which may be helpful to understand the mass hierarchy in heavy-ion collisions. Finally, the nuclear modification of $\Delta \phi_{\gamma D}$ distributions in central $0-10\%$ Au+Au collisions at RHIC energy is provided for completeness.


title: Correlation analysis for isotropic stochastic gravitational wave backgrounds with maximally allowed polarization degrees

abstract: We study correlation analysis for monopole components of stochastic gravitational wave backgrounds, including the maximally allowed polarization degrees. We show that, for typical detector networks, the correlation analysis can probe virtually five spectra: three for the intensities of the tensor, vector, and scalar modes and two for the chiral asymmetries of the tensor and vector modes. The chiral asymmetric signal for the vector modes has been left untouched so far. In this paper, we derive the overlap reduction function for this signal and thus complete the basic ingredients required for widely dealing with polarization degrees. We comprehensively analyze the geometrical properties of all the five overlap reduction functions. In particular, we point out the importance of reflection transformations for configuring preferable networks in the future.


title: Super-fast Rotation in the OMC 2/FIR 6b Jet

abstract: We present ALMA CO ($J$=2--1) and 1.3 mm continuum observations of the high-velocity jet associated with the FIR 6b protostar located in the Orion Molecular Cloud-2. We detect a velocity gradient along the short axis of the jet in both the red- and blue-shifted components. The position-velocity diagrams along the short axis of the red-shifted jet show a typical characteristic of a rotating cylinder. We attribute the velocity gradient in the red-shifted component to rotation of the jet. The rotation velocity ($>20\,\ \rm{km s^{-1}}$) and specific angular momentum ($>10^{22}\, \rm{cm^{2}\, s^{-1}}$) of the jet around FIR 6b are the largest among all jets in which rotation has been observed. By combining disk wind theory with our observations, the jet launching radius is estimated to be in the range of $2.18-2.96$\,au. The rapid rotation, large specific angular momentum, and a launching radius far from the central protostar can be explained by a magnetohydrodynamic disk wind that contributes to the angular momentum transfer in the late stages of protostellar accretion.


title: Facetron: A Multi-speaker Face-to-Speech Model based on Cross-modal Latent Representations

abstract: In this paper, we propose a multi-speaker face-to-speech waveform generation model that also works for unseen speaker conditions. Using a generative adversarial network (GAN) with linguistic and speaker characteristic features as auxiliary conditions, our method directly converts face images into speech waveforms under an end-to-end training framework. The linguistic features are extracted from lip movements using a lip-reading model, and the speaker characteristic features are predicted from face images using cross-modal learning with a pre-trained acoustic model. Since these two features are uncorrelated and controlled independently, we can flexibly synthesize speech waveforms whose speaker characteristics vary depending on the input face images. We show the superiority of our proposed model over conventional methods in terms of objective and subjective evaluation results. Specifically, we evaluate the performances of linguistic features by measuring their accuracy on an automatic speech recognition task. In addition, we estimate speaker and gender similarity for multi-speaker and unseen conditions, respectively. We also evaluate the aturalness of the synthesized speech waveforms using a mean opinion score (MOS) test and non-intrusive objective speech quality assessment (NISQA).The demo samples of the proposed and other models are available at https://sam-0927.github.io/


title: Loops of Infinite Order and Toric Foliations

abstract: In 2005 Dullin et al. proved that the non-zero vector of Maslov indices is an eigenvector with eigenvalue 1 of the monodromy matrices of an integrable Hamiltonian system. We take a close look at the geometry behind this result and extend it to a more general context. We construct a bundle morphism defined on the lattice bundle of an (general) integrable system, which can be seen as a generalization of the vector of Maslov indices. The non-triviality of this bundle morphism implies the existence of common eigenvectors with eigenvalue 1 of the monodromy matrices, and gives rise to a corank 1 toric foliation refining the original one induced by the integrable system. Furthermore, we show that in the case where the system has 2 degrees of freedom, this implies the global existence of a free S^{1} action.


title: On the composition of integral operators acting in tempered Colombeau algebras

abstract: We show that the generalised composition of generalised integral operators is well defined on the space Colombeau algebras of tempered generalised functions.


title: Thermodynamics and SARS-CoV-2: neurological effects in post-Covid 19 syndrome

abstract: There is increasing evidence that infection with SARS-CoV-2 can cause a spectrum of neurological symptoms. In this paper, we develop a theoretical concept underlying such neurological COVID-19 consequences by employing a non-equilibrium thermodynamic approach that allows linking the neuronal electric potential with a virus-induced pH variation. Our theoretical findings support further experimental work on therapeutically correcting electrolyte imbalances, such as Na$^+$ and K$^+$, to attenuate the neurological effects of SARS-CoV-2.


title: Endless Fun in high dimensions -- A Quantum Card Game

abstract: Quantum technologies, i.e., technologies benefiting from the features of quantum physics such as objective randomness, superposition, and entanglement, have enabled an entirely different way of distributing and processing information. The enormous progress over the last decades has also led to an urgent need for young professionals and new educational programs. Here, we present a strategic card game in which the building blocks of a quantum computer can be experienced. While playing, participants start with the lowest quantum state, play cards to "program" a quantum computer, and aim to achieve the highest possible quantum state. Thereby they experience quantum features such as superposition, interference, and entanglement. By also including high-dimensional quantum states, i.e., systems that can take more than two possible values, and by developing different multi-player modes, the game can help the players to understand complex quantum state operations and can also be used as an introduction to quantum computational tasks for students. As such, it can also be used in a classroom environment to increase the conceptual understanding, interest, and motivation of a student. Therefore, the presented game contributes to the ongoing efforts on gamifying quantum physics education with a particular focus on the counter-intuitive features which quantum computing is based on.


title: About Standpoints for Surmounting Reversibility and Recurrence Paradoxes in Theoretical Thermodynamics

abstract: The reversibility and recurrence paradoxes are key issues that have been left unsolved in researches on the foundation of thermodynamics since the 19th century. This article shows that (1) the reversibility paradox can be overcome if we pay attention to observed quantities, which represent net results of the motion of a reversible character in the non-observable area and (2) the recurrence paradox can be surmounted if we look at an isolated system from the inside, in which there is no system with discrete energy levels. These arguments confirm the validity of the reported conclusion that the origin of the increase of entropy in an isolated system is the basic quality of microscopic particles of spontaneously spreading into every possible spatial area.


title: Weakly Supervised Attention Model for RV StrainClassification from volumetric CTPA Scans

abstract: Pulmonary embolus (PE) refers to obstruction of pulmonary arteries by blood clots. PE accounts for approximately 100,000 deaths per year in the United States alone. The clinical presentation of PE is often nonspecific, making the diagnosis challenging. Thus, rapid and accurate risk stratification is of paramount importance. High-risk PE is caused by right ventricular (RV) dysfunction from acute pressure overload, which in return can help identify which patients require more aggressive therapy. Reconstructed four-chamber views of the heart on chest CT can detect right ventricular enlargement. CT pulmonary angiography (CTPA) is the golden standard in the diagnostic workup of suspected PE. Therefore, it can link between diagnosis and risk stratification strategies. We developed a weakly supervised deep learning algorithm, with an emphasis on a novel attention mechanism, to automatically classify RV strain on CTPA. Our method is a 3D DenseNet model with integrated 3D residual attention blocks. We evaluated our model on a dataset of CTPAs of emergency department (ED) PE patients. This model achieved an area under the receiver operating characteristic curve (AUC) of 0.88 for classifying RV strain. The model showed a sensitivity of 87% and specificity of 83.7%. Our solution outperforms state-of-the-art 3D CNN networks. The proposed design allows for a fully automated network that can be trained easily in an end-to-end manner without requiring computationally intensive and time-consuming preprocessing or strenuous labeling of the data.We infer that unmarked CTPAs can be used for effective RV strain classification. This could be used as a second reader, alerting for high-risk PE patients. To the best of our knowledge, there are no previous deep learning-based studies that attempted to solve this problem.


title: Necessary conditions for a minimum in classical calculus of variation problems in the presence of various degenerations

abstract: In the paper, we offer a method for studying an extremal in the classical calculus of variation in the presence of various degenerations. This method is based on introduction of Weierstrass type variations characterized by a numerical parameter. To obtain more effective results, introduced variations are used in two forms: in the form of variations on the right with respect to the given point, and in the form of variations on the left with respect to the same point. The research is conducted under the assumption that along the considered extremal the Weierstrass condition and the Legendre condition degenerate, i.e. they are fulfilled as equalities at separate points or on some intervals. Two types of new necessary conditions are obtained: of equality type and of inequality type conditions for a strong and also a weak local minimum. Given specific examples and counterexample show that some of the necessary minimum conditions obtained in this article are strengthening and refining of the corresponding known results in this direction.


title: From robust tests to Bayes-like posterior distributions

abstract: In the Bayes paradigm and for a given loss function, we propose the construction of a new type of posterior distributions, that extends the classical Bayes one, for estimating the law of an $n$-sample. The loss functions we have in mind are based on the total variation and Hellinger distances as well as some $\mathbb{L}_{j}$-ones. We prove that, with a probability close to one, this new posterior distribution concentrates its mass in a neighbourhood of the law of the data, for the chosen loss function, provided that this law belongs to the support of the prior or, at least, lies close enough to it. We therefore establish that the new posterior distribution enjoys some robustness properties with respect to a possible misspecification of the prior, or more precisely, its support. For the total variation and squared Hellinger losses, we also show that the posterior distribution keeps its concentration properties when the data are only independent, hence not necessarily i.i.d., provided that most of their marginals or the average of these are close enough to some probability distribution around which the prior puts enough mass. The posterior distribution is therefore also stable with respect to the equidistribution assumption. We illustrate these results by several applications. We consider the problems of estimating a location parameter or both the location and the scale of a density in a nonparametric framework. Finally, we also tackle the problem of estimating a density, with the squared Hellinger loss, in a high-dimensional parametric model under some sparsity conditions. The results established in this paper are non-asymptotic and provide, as much as possible, explicit constants.


title: Strong non-exponential relaxation and memory effects in a fluid with non-linear drag

abstract: We analyse the dynamical evolution of a fluid with non-linear drag, for which binary collisions are elastic, described at the kinetic level by the Enskog-Fokker-Planck equation. This model system, rooted in the theory of non-linear Brownian motion, displays a really complex behaviour when quenched to low temperatures. Its glassy response is controlled by a long-lived non-equilibrium state, independent of the degree of non-linearity and also of the Brownian-Brownian collisions rate. The latter property entails that this behaviour persists in the collisionless case, where the fluid is described by the non-linear Fokker-Planck equation. The observed response, which includes non-exponential, algebraic, relaxation and strong memory effects, presents scaling properties: the time evolution of the temperature -- for both relaxation and memory effects -- falls onto a master curve, regardless of the details of the experiment. To account for the observed behaviour in simulations, it is necessary to develop an extended Sonine approximation for the kinetic equation -- which considers not only the fourth cumulant but also the sixth one.


title: A Shallow Ritz Method for Elliptic Problems with Singular Sources

abstract: In this paper, a shallow Ritz-type neural network for solving elliptic equations with delta function singular sources on an interface is developed. There are three novel features in the present work; namely, (i) the delta function singularity is naturally removed, (ii) level set function is introduced as a feature input, (iii) it is completely shallow, comprising only one hidden layer. We first introduce the energy functional of the problem and then transform the contribution of singular sources to a regular surface integral along the interface. In such a way, the delta function singularity can be naturally removed without introducing a discrete one that is commonly used in traditional regularization methods, such as the well-known immersed boundary method. The original problem is then reformulated as a minimization problem. We propose a shallow Ritz-type neural network with one hidden layer to approximate the global minimizer of the energy functional. As a result, the network is trained by minimizing the loss function that is a discrete version of the energy. In addition, we include the level set function of the interface as a feature input of the network and find that it significantly improves the training efficiency and accuracy. We perform a series of numerical tests to show the accuracy of the present method and its capability for problems in irregular domains and higher dimensions.


title: Synthetic Periocular Iris PAI from a Small Set of Near-Infrared-Images

abstract: Biometric has been increasing in relevance these days since it can be used for several applications such as access control for instance. Unfortunately, with the increased deployment of biometric applications, we observe an increase of attacks. Therefore, algorithms to detect such attacks (Presentation Attack Detection (PAD)) have been increasing in relevance. The LivDet-2020 competition which focuses on Presentation Attacks Detection (PAD) algorithms have shown still open problems, specially for unknown attacks scenarios. In order to improve the robustness of biometric systems, it is crucial to improve PAD methods. This can be achieved by augmenting the number of presentation attack instruments (PAI) and bona fide images that are used to train such algorithms. Unfortunately, the capture and creation of presentation attack instruments and even the capture of bona fide images is sometimes complex to achieve. This paper proposes a novel PAI synthetically created (SPI-PAI) using four state-of-the-art GAN algorithms (cGAN, WGAN, WGAN-GP, and StyleGAN2) and a small set of periocular NIR images. A benchmark between GAN algorithms is performed using the Frechet Inception Distance (FID) between the generated images and the original images used for training. The best PAD algorithm reported by the LivDet-2020 competition was tested for us using the synthetic PAI which was obtained with the StyleGAN2 algorithm. Surprisingly, The PAD algorithm was not able to detect the synthetic images as a Presentation Attack, categorizing all of them as bona fide. Such results demonstrated the feasibility of synthetic images to fool presentation attacks detection algorithms and the need for such algorithms to be constantly updated and trained with a larger number of images and PAI scenarios.


title: An optimal multiplier theorem for Grushin operators in the plane, I

abstract: Let $\mathcal{L} = -\partial_x^2 - V(x) \partial_y^2$ be the Grushin operator on $\mathbb{R}^2$ with coefficient $V : \mathbb{R} \to [0,\infty)$. Under the sole assumptions that $V(-x) \simeq V(x) \simeq xV'(x)$ and $x^2 |V''(x)| \lesssim V(x)$, we prove a spectral multiplier theorem of Mihlin--H\"ormander type for $\mathcal{L}$, whose smoothness requirement is optimal and independent of $V$. The assumption on the second derivative $V''$ can actually be weakened to a H\"older-type condition on $V'$. The proof hinges on the spectral analysis of one-dimensional Schr\"odinger operators, including universal estimates of eigenvalue gaps and matrix coefficients of the potential.


title: Cost-effective Land Cover Classification for Remote Sensing Images

abstract: Land cover maps are of vital importance to various fields such as land use policy development, ecosystem services, urban planning and agriculture monitoring, which are mainly generated from remote sensing image classification techniques. Traditional land cover classification usually needs tremendous computational resources, which often becomes a huge burden to the remote sensing community. Undoubtedly cloud computing is one of the best choices for land cover classification, however, if not managed properly, the computation cost on the cloud could be surprisingly high. Recently, cutting the unnecessary computation long tail has become a promising solution for saving the cost in the cloud. For land cover classification, it is generally not necessary to achieve the best accuracy and 85% can be regarded as a reliable land cover classification. Therefore, in this paper, we propose a framework for cost-effective remote sensing classification. Given the desired accuracy, the clustering algorithm can stop early for cost-saving whilst achieving sufficient accuracy for land cover image classification. Experimental results show that achieving 85%-99.9% accuracy needs only 27.34%-60.83% of the total cloud computation cost for achieving a 100% accuracy. To put it into perspective, for the US land cover classification example, the proposed approach can save over $1,593,490.18 for the government in each single-use when the desired accuracy is 90%.


title: SN 2019hcc: A Type II Supernova Displaying Early O II Lines

abstract: We present optical spectroscopy together with ultraviolet, optical and near-infrared photometry of SN 2019hcc, which resides in a host galaxy at redshift 0.044, displaying a sub-solar metallicity. The supernova spectrum near peak epoch shows a `w' shape at around 4000 {\AA} which is usually associated with O II lines and is typical of Type I superluminous supernovae. SN 2019hcc post-peak spectra show a well-developed H alpha P-Cygni profile from 19 days past maximum and its light curve, in terms of its absolute peak luminosity and evolution, resembles that of a fast-declining Hydrogen-rich supernova (SN IIL). The object does not show any unambiguous sign of interaction as there is no evidence of narrow lines in the spectra or undulations in the light curve. Our tardis spectral modelling of the first spectrum shows that Carbon, Nitrogen and Oxygen (CNO) at 19000 K reproduce the `w' shape and suggests that a combination of non-thermally excited CNO and metal lines at 8000 K could reproduce the feature seen at 4000 {\AA}. The Bolometric light curve modelling reveals that SN 2019hcc could be fit with a magnetar model, showing a relatively strong magnetic field (B > 3 x 10^14 G), which matches the peak luminosity and rise time without powering up the light curve to superluminous luminosities. The high-energy photons produced by the magnetar would then be responsible for the detected O II lines. As a consequence, SN 2019hcc shows that a `w' shape profile at around 4000 {\AA}, usually attributed to O II, is not only shown in superluminous supernovae and hence it should not be treated as the sole evidence of the belonging to such a supernova type.


title: UR Channel-Robust Synthetic Speech Detection System for ASVspoof 2021

abstract: In this paper, we present UR-AIR system submission to the logical access (LA) and the speech deepfake (DF) tracks of the ASVspoof 2021 Challenge. The LA and DF tasks focus on synthetic speech detection (SSD), i.e. detecting text-to-speech and voice conversion as spoofing attacks. Different from previous ASVspoof challenges, the LA task this year presents codec and transmission channel variability, while the new task DF presents general audio compression. Built upon our previous research work on improving the robustness of the SSD systems to channel effects, we propose a channel-robust synthetic speech detection system for the challenge. To mitigate the channel variability issue, we use an acoustic simulator to apply transmission codec, compression codec, and convolutional impulse responses to augmenting the original datasets. For the neural network backbone, we propose to use Emphasized Channel Attention, Propagation and Aggregation Time Delay Neural Networks (ECAPA-TDNN) as our primary model. We also incorporate one-class learning with channel-robust training strategies to further learn a channel-invariant speech representation. Our submission achieved EER 20.33% in the DF task; EER 5.46% and min-tDCF 0.3094 in the LA task.


title: Optomechanical lasing and domain walls driven by exciton-phonon interactions

abstract: We study theoretically interaction of optically-pumped excitons with acoustic waves in planar semiconductor nanostructures in the strongly nonlinear regime. We start with the multimode optomechanical lasing regime for optical pump frequency {above} the exciton resonance and demonstrate broadband chaotic-like lasing spectra. We also predict formation of propagating optomechanical domain walls driven by optomechanical nonlinearity for the optical pump {below} the exciton resonance. Stability conditions for the domain walls are examined analytically and are in agreement with direct numerical simulations. Our results apply to nonlinear sound propagation in the arrays of quantum wells or in the plane of Bragg semiconductor microcavities hosting excitonic polaritons.


title: Adiabatic quantum-flux-parametron with delay-line clocking: logic gate demonstration and phase skipping operation

abstract: Adiabatic quantum-flux-parametron (AQFP) logic is an energy-efficient superconductor logic family. The latency of AQFP circuits is relatively long compared to that of other superconductor logic families and thus such circuits require low-latency clocking schemes. In a previous study, we proposed a low-latency clocking scheme called delay-line clocking, in which the latency for each logic operation is determined by the propagation delay of the excitation current, and demonstrated a simple AQFP buffer chain that adopts delay-line clocking. However, it is unclear whether more complex AQFP circuits can adopt delay-line clocking. In the present study, we demonstrate AQFP logic gates (AND and XOR gates) that use delay-line clocking as a step towards implementing large-scale AQFP circuits with delay-line clocking. AND and XOR gates with a latency of approximately 20 ps per gate are shown to operate at up to 5 and 4 GHz, respectively, in experiments. We also demonstrate that delay-line clocking enables phase skipping operation, in which some of the AQFP buffers for phase synchronization are removed to reduce the junction count and energy dissipation. The results indicate that delay-line clocking can enable low-latency, low-energy, large-scale AQFP circuits.


title: Language Models as Zero-shot Visual Semantic Learners

abstract: Visual Semantic Embedding (VSE) models, which map images into a rich semantic embedding space, have been a milestone in object recognition and zero-shot learning. Current approaches to VSE heavily rely on static word em-bedding techniques. In this work, we propose a Visual Se-mantic Embedding Probe (VSEP) designed to probe the semantic information of contextualized word embeddings in visual semantic understanding tasks. We show that the knowledge encoded in transformer language models can be exploited for tasks requiring visual semantic understanding.The VSEP with contextual representations can distinguish word-level object representations in complicated scenes as a compositional zero-shot learner. We further introduce a zero-shot setting with VSEPs to evaluate a model's ability to associate a novel word with a novel visual category. We find that contextual representations in language mod-els outperform static word embeddings, when the compositional chain of object is short. We notice that current visual semantic embedding models lack a mutual exclusivity bias which limits their performance.


title: Distributed Neighbor Selection in Multi-agent Networks

abstract: Achieving consensus via nearest neighbor rules is an important prerequisite for multi-agent networks to accomplish collective tasks. A common assumption in consensus setup is that each agent interacts with all its neighbors. This paper examines whether network functionality and performance can be maintained-and even enhanced-when agents interact only with a subset of their respective (available) neighbors. As shown in the paper, the answer to this inquiry is affirmative. In this direction, we show that by exploring the monotonicity property of the Laplacian eigenvectors, a neighbor selection rule with guaranteed performance enhancements, can be realized for consensus-type networks. For distributed implementation, a quantitative connection between entries of Laplacian eigenvectors and the "relative rate of change" in the state between neighboring agents is further established; this connection facilitates a distributed algorithm for each agent to identify "favorable" neighbors to interact with. Multi-agent networks with and without external influence are examined, as well as extensions to signed networks. This paper underscores the utility of Laplacian eigenvectors in the context of distributed neighbor selection, providing novel insights into distributed data-driven control of multi-agent systems.


title: Beyond Pigouvian Taxes: A Worst Case Analysis

abstract: In the early $20^{th}$ century, Pigou observed that imposing a marginal cost tax on the usage of a public good induces a socially efficient level of use as an equilibrium. Unfortunately, such a "Pigouvian" tax may also induce other, socially inefficient, equilibria. We observe that this social inefficiency may be unbounded, and study whether alternative tax structures may lead to milder losses in the worst case, i.e. to a lower price of anarchy. We show that no tax structure leads to bounded losses in the worst case. However, we do find a tax scheme that has a lower price of anarchy than the Pigouvian tax, obtaining tight lower and upper bounds in terms of a crucial parameter that we identify. We generalize our results to various scenarios that each offers an alternative to the use of a public road by private cars, such as ride sharing, or using a bus or a train.


title: Leaf-FM: A Learnable Feature Generation Factorization Machine for Click-Through Rate Prediction

abstract: Click-through rate (CTR) prediction plays important role in personalized advertising and recommender systems. Though many models have been proposed such as FM, FFM and DeepFM in recent years, feature engineering is still a very important way to improve the model performance in many applications because using raw features can rarely lead to optimal results. For example, the continuous features are usually transformed to the power forms by adding a new feature to allow it to easily form non-linear functions of the feature. However, this kind of feature engineering heavily relies on peoples experience and it is both time consuming and labor consuming. On the other side, concise CTR model with both fast online serving speed and good model performance is critical for many real life applications. In this paper, we propose LeafFM model based on FM to generate new features from the original feature embedding by learning the transformation functions automatically. We also design three concrete Leaf-FM models according to the different strategies of combing the original and the generated features. Extensive experiments are conducted on three real-world datasets and the results show Leaf-FM model outperforms standard FMs by a large margin. Compared with FFMs, Leaf-FM can achieve significantly better performance with much less parameters. In Avazu and Malware dataset, add version Leaf-FM achieves comparable performance with some deep learning based models such as DNN and AutoInt. As an improved FM model, Leaf-FM has the same computation complexity with FM in online serving phase and it means Leaf-FM is applicable in many industry applications because of its better performance and high computation efficiency.


title: ContextNet: A Click-Through Rate Prediction Framework Using Contextual information to Refine Feature Embedding

abstract: Click-through rate (CTR) estimation is a fundamental task in personalized advertising and recommender systems and it's important for ranking models to effectively capture complex high-order features.Inspired by the success of ELMO and Bert in NLP field, which dynamically refine word embedding according to the context sentence information where the word appears, we think it's also important to dynamically refine each feature's embedding layer by layer according to the context information contained in input instance in CTR estimation tasks. We can effectively capture the useful feature interactions for each feature in this way. In this paper, We propose a novel CTR Framework named ContextNet that implicitly models high-order feature interactions by dynamically refining each feature's embedding according to the input context. Specifically, ContextNet consists of two key components: contextual embedding module and ContextNet block. Contextual embedding module aggregates contextual information for each feature from input instance and ContextNet block maintains each feature's embedding layer by layer and dynamically refines its representation by merging contextual high-order interaction information into feature embedding. To make the framework specific, we also propose two models(ContextNet-PFFN and ContextNet-SFFN) under this framework by introducing linear contextual embedding network and two non-linear mapping sub-network in ContextNet block. We conduct extensive experiments on four real-world datasets and the experiment results demonstrate that our proposed ContextNet-PFFN and ContextNet-SFFN model outperform state-of-the-art models such as DeepFM and xDeepFM significantly.


title: Hemodynamic Deconvolution Demystified: Sparsity-Driven Regularization at Work

abstract: Deconvolution of the hemodynamic response is an important step to access short timescales of brain activity recorded by functional magnetic resonance imaging (fMRI). Albeit conventional deconvolution algorithms have been around for a long time (e.g., Wiener deconvolution), recent state-of-the-art methods based on sparsity-pursuing regularization are attracting increasing interest to investigate brain dynamics and connectivity with fMRI. This technical note revisits the main concepts underlying two main methods, Paradigm Free Mapping and Total Activation, in the most accessible way. Despite their apparent differences in the formulation, these methods are theoretically equivalent as they represent the synthesis and analysis sides of the same problem, respectively. We demonstrate this equivalence in practice with their best-available implementations using both simulations, with different signal-to-noise ratios, and experimental fMRI data acquired during a motor task and resting-state. We evaluate the parameter settings that lead to equivalent results, and showcase the potential of these algorithms compared to other common approaches. This note is useful for practitioners interested in gaining a better understanding of state-of-the-art hemodynamic deconvolution, and aims to answer questions that practitioners often have regarding the differences between the two methods.


title: High-order accurate entropy stable adaptive moving mesh finite difference schemes for special relativistic (magneto)hydrodynamics

abstract: This paper develops high-order accurate entropy stable (ES) adaptive moving mesh finite difference schemes for the two- and three-dimensional special relativistic hydrodynamic (RHD) and magnetohydrodynamic (RMHD) equations, which is the high-order accurate extension of [J.M. Duan and H.Z. Tang, Entropy stable adaptive moving mesh schemes for 2D and 3D special relativistic hydrodynamics, J. Comput. Phys., 426(2021), 109949]. The key point is the derivation of the higher-order accurate entropy conservative (EC) and ES finite difference schemes in the curvilinear coordinates by carefully dealing with the discretization of the temporal and spatial metrics and the Jacobian of the coordinate transformation and constructing the high-order EC and ES fluxes with the discrete metrics. The spatial derivatives in the source terms of the symmetrizable RMHD equations and the geometric conservation laws are discretized by using the linear combinations of the corresponding second-order case to obtain high-order accuracy. Based on the proposed high-order accurate EC schemes and the high-order accurate dissipation terms built on the WENO reconstruction, the high-order accurate ES schemes are obtained for the RHD and RMHD equations in the curvilinear coordinates. The mesh iteration redistribution or adaptive moving mesh strategy is built on the minimization of the mesh adaption functional. Several numerical tests are conducted to validate the shock-capturing ability and high efficiency of our high-order accurate ES adaptive moving mesh methods on the parallel computer system with the MPI communication. The numerical results show that the high-order accurate ES adaptive moving mesh schemes outperform both their counterparts on the uniform mesh and the second-order ES adaptive moving mesh schemes.


title: Parametric Contrastive Learning

abstract: In this paper, we propose Parametric Contrastive Learning (PaCo) to tackle long-tailed recognition. Based on theoretical analysis, we observe supervised contrastive loss tends to bias on high-frequency classes and thus increases the difficulty of imbalanced learning. We introduce a set of parametric class-wise learnable centers to rebalance from an optimization perspective. Further, we analyze our PaCo loss under a balanced setting. Our analysis demonstrates that PaCo can adaptively enhance the intensity of pushing samples of the same class close as more samples are pulled together with their corresponding centers and benefit hard example learning. Experiments on long-tailed CIFAR, ImageNet, Places, and iNaturalist 2018 manifest the new state-of-the-art for long-tailed recognition. On full ImageNet, models trained with PaCo loss surpass supervised contrastive learning across various ResNet backbones, e.g., our ResNet-200 achieves 81.8% top-1 accuracy. Our code is available at https://github.com/dvlab-research/Parametric-Contrastive-Learning.


title: Global regularity and large time behavior for some inviscid Oldroyd-B models in $\mathbb{R}^2$

abstract: In this paper, we are concerned with global strong solutions and large time behavior for some inviscid Oldroyd-B models. We first establish the energy estimate and B-K-M criterion for the 2-D co-rotation inviscid Oldroyd-B model. Then, we obtain global strong solutions with large data in Sobolev space by proving the boundedness of vorticity. As a corollary, we prove global existence of the corresponding inviscid Hooke model near equilibrium. Furthermore, we present global existence for the 2-D co-rotation inviscid Oldroyd-B model in critical Besov space by a refined estimate in Besov spaces with index $0$. Finally, we study large time behaviour for the noncorotation inviscid Oldroyd-B model. Applying the Fourier splitting method, we prove the $H^1$ decay rate for global strong solutions constructed by T. M. Elgindi and F. Rousset.


title: Pluto: Motion Detection for Navigation in a VR Headset

abstract: Untethered, inside-out tracking is considered a new goalpost for virtual reality, which became attainable with advent of machine learning in SLAM. Yet computer vision-based navigation is always at risk of a tracking failure due to poor illumination or saliency of the environment. An extension for a navigation system is proposed, which recognizes agents motion and stillness states with 87% accuracy from accelerometer data. 40% reduction in navigation drift is demonstrated in a repeated tracking failure scenario on a challenging dataset.


title: Defective Ramsey Numbers and Defective Cocolorings in Some Subclasses of Perfect Graphs

abstract: In this paper, we investigate a variant of Ramsey numbers called defective Ramsey numbers where cliques and independent sets are generalized to $k$-dense and $k$-sparse sets, both commonly called $k$-defective sets. We focus on the computation of defective Ramsey numbers restricted to some subclasses of perfect graphs. Since direct proof techniques are often insufficient for obtaining new values of defective Ramsey numbers, we provide a generic algorithm to compute defective Ramsey numbers in a given target graph class. We combine direct proof techniques with our efficient graph generation algorithm to compute several new defective Ramsey numbers in perfect graphs, bipartite graphs and chordal graphs. We also initiate the study of a related parameter, denoted by $c^{\mathcal G}_k(m)$, which is the maximum order $n$ such that the vertex set of any graph of order at $n$ in a class $\mathcal{G}$ can be partitioned into at most $m$ subsets each of which is $k$-defective. We obtain several values for $c^{\mathcal G}_k(m)$ in perfect graphs and cographs.


title: Solar chromosphere heating and generation of plasma outflows by impulsively generated two fluid Alfven waves

abstract: Context. We address the heating of the solar chromosphere and the related generation of plasma inflows and outflows. Aims. We attempt to detect variations in ion temperature and vertical plasma flows, which are driven by impulsively excited two-fluid Alfv\'en waves. We aim to investigate the possible contribution of these waves to solar chromosphere heating and plasma outflows. Methods. We performed numerical simulations of the generation and evolution of Alfv\'en waves with the use of the JOANNA code, which solves the two-fluid equations for ions+electrons and neutrals, coupled by collision terms. Results. We confirm that the damping of impulsively generated small-amplitude Alfv\'en waves slightly affects the temperature of the chromosphere and generates slow plasma flows. In contrast, the Alfv\'en waves generated by large-amplitude pulses increase the chromospheric plasma temperature more significantly and result in faster plasma outflows. The maximum heating occurs when the pulse is launched from the central photosphere, and the magnitude of the related plasma flows grows with the amplitude of the pulse. Conclusions. Large-amplitude two-fluid Alfv\'en waves can contribute significantly to the heating of the solar chromosphere and to the generation of plasma outflows.