title: Accelerated first-order methods for a class of semidefinite programs

abstract: This paper introduces a new storage-optimal first-order method (FOM), CertSDP, for solving a special class of semidefinite programs (SDPs) to high accuracy. The class of SDPs that we consider, the exact QMP-like SDPs, is characterized by low-rank solutions, a priori knowledge of the restriction of the SDP solution to a small subspace, and standard regularity assumptions such as strict complementarity. Crucially, we show how to use a certificate of strict complementarity to construct a low-dimensional strongly convex minimax problem whose optimizer coincides with a factorization of the SDP optimizer. From an algorithmic standpoint, we show how to construct the necessary certificate and how to solve the minimax problem efficiently. We accompany our theoretical results with preliminary numerical experiments suggesting that CertSDP significantly outperforms current state-of-the-art methods on large sparse exact QMP-like SDPs.


title: Can Artificial Intelligence Transform DevOps?

abstract: DevOps and Artificial Intelligence (AI) are interconnected with each other. DevOps is a business-driven approach to providing quickly delivered quality software, and AI is the technology that can be used in the system to enhance its functionality. So, DevOps teams can use AI to test, code, release, monitor, and improve the system. Through AI, the automation process delivered by DevOps could be improved efficiently. This study aims to explore how AI can transform DevOps. The research is useful in terms of facilitating software developers and businesses to assess the importance of AI in DevOps. The study has practical implications as it elaborates on how AI transforms DevOps and in what way it can support businesses in their business.


title: Arcsine law for random dynamics with a core

abstract: In their recent paper [8], G.Hata and the fourth author first gave an example of random iterations of two piecewise linear interval maps without (deterministic) indifferent periodic points for which the arcsine law -- a characterization of intermittent dynamics in infinite ergodic theory -- holds. The key in the proof of the result is the existence of a Markov partition preserved by each interval maps. In the present paper, we give a class of random iterations of two interval maps without indifferent periodic points but satisfying the arcsine law, by introducing a concept of core random dynamics. As applications, we show that the generalized arcsine law holds for generalized Hata-Yano maps and piecewise linear versions of Gharaei-Homburg maps, both of which do not have a Markov partition in general.


title: Rethinking the Augmentation Module in Contrastive Learning: Learning Hierarchical Augmentation Invariance with Expanded Views

abstract: A data augmentation module is utilized in contrastive learning to transform the given data example into two views, which is considered essential and irreplaceable. However, the predetermined composition of multiple data augmentations brings two drawbacks. First, the artificial choice of augmentation types brings specific representational invariances to the model, which have different degrees of positive and negative effects on different downstream tasks. Treating each type of augmentation equally during training makes the model learn non-optimal representations for various downstream tasks and limits the flexibility to choose augmentation types beforehand. Second, the strong data augmentations used in classic contrastive learning methods may bring too much invariance in some cases, and fine-grained information that is essential to some downstream tasks may be lost. This paper proposes a general method to alleviate these two problems by considering where and what to contrast in a general contrastive learning framework. We first propose to learn different augmentation invariances at different depths of the model according to the importance of each data augmentation instead of learning representational invariances evenly in the backbone. We then propose to expand the contrast content with augmentation embeddings to reduce the misleading effects of strong data augmentations. Experiments based on several baseline methods demonstrate that we learn better representations for various benchmarks on classification, detection, and segmentation downstream tasks.


title: Lower and Upper Bounds for Numbers of Linear Regions of Graph Convolutional Networks

abstract: The research for characterizing GNN expressiveness attracts much attention as graph neural networks achieve a champion in the last five years. The number of linear regions has been considered a good measure for the expressivity of neural networks with piecewise linear activation. In this paper, we present some estimates for the number of linear regions of the classic graph convolutional networks (GCNs) with one layer and multiple-layer scenarios. In particular, we obtain an optimal upper bound for the maximum number of linear regions for one-layer GCNs, and the upper and lower bounds for multi-layer GCNs. The simulated estimate shows that the true maximum number of linear regions is possibly closer to our estimated lower bound. These results imply that the number of linear regions of multi-layer GCNs is exponentially greater than one-layer GCNs per parameter in general. This suggests that deeper GCNs have more expressivity than shallow GCNs.


title: Multi-Object Grasping in the Plane

abstract: We consider a novel problem where multiple rigid convex polygonal objects rest in randomly placed positions and orientations on a planar surface visible from an overhead camera. The objective is to efficiently grasp and transport all objects into a bin using multi-object push-grasps, where multiple objects are pushed together to facilitate multi-object grasping. We provide necessary conditions for frictionless multi-object push-grasps and apply these to filter inadmissible grasps in a novel multi-object grasp planner. We find that our planner is 19 times faster than a Mujoco simulator baseline. We also propose a picking algorithm that uses both single- and multi-object grasps to pick objects. In physical grasping experiments comparing performance with a single-object picking baseline, we find that the frictionless multi-object grasping system achieves 13.6\% higher grasp success and is 59.9\% faster, from 212 PPH to 340 PPH. See \url{https://sites.google.com/view/multi-object-grasping} for videos and code.


title: The critical variational setting for stochastic evolution equations

abstract: In this paper we introduce the critical variational setting for parabolic stochastic evolution equations of quasi- or semi-linear type. Our results improve many of the abstract results in the classical variational setting. In particular, we are able to replace the usual weak or local monotonicity condition by a more flexible local Lipschitz condition. Moreover, the usual growth conditions on the multiplicative noise are weakened considerably. Our new setting provides general conditions under which local and global existence and uniqueness hold. In addition, we prove continuous dependence on the initial data. We show that many classical SPDEs, which could not be covered by the classical variational setting, do fit in the critical variational setting. In particular, this is the case for the Cahn-Hilliard equation, tamed Navier-Stokes equations, and Allen-Cahn equation.


title: On Approximations of Data-Driven Chance Constrained Programs over Wasserstein Balls

abstract: Distributionally robust chance constrained programs minimize a deterministic cost function subject to the satisfaction of one or more safety conditions with high probability, given that the probability distribution of the uncertain problem parameters affecting the safety condition(s) is only known to belong to some ambiguity set. We study three popular approximation schemes for distributionally robust chance constrained programs over Wasserstein balls, where the ambiguity set contains all probability distributions within a certain Wasserstein distance to a reference distribution. The first approximation replaces the chance constraint with a bound on the conditional value-at-risk, the second approximation decouples different safety conditions via Bonferroni's inequality, and the third approximation restricts the expected violation of the safety condition(s) so that the chance constraint is satisfied. We show that the conditional value-at-risk approximation can be characterized as a tight convex approximation, which complements earlier findings on classical (non-robust) chance constraints, and we offer a novel interpretation in terms of transportation savings. We also show that the three approximations can perform arbitrarily poorly in data-driven settings, and that they are generally incomparable with each other.


title: Geometric Characterization of the $H$-property for Step-graphons

abstract: In a recent paper arXiv:2109.08340, we have exhibited a set of conditions that are necessary for the $H$-property to hold for the class of step-graphons. In this paper, we prove that these conditions are essentially sufficient.


title: DM$^2$: Decentralized Multi-Agent Reinforcement Learning for Distribution Matching

abstract: Current approaches to multi-agent cooperation rely heavily on centralized mechanisms or explicit communication protocols to ensure convergence. This paper studies the problem of distributed multi-agent learning without resorting to centralized components or explicit communication. It examines the use of distribution matching to facilitate the coordination of independent agents. In the proposed scheme, each agent independently minimizes the distribution mismatch to the corresponding component of a target visitation distribution. The theoretical analysis shows that under certain conditions, each agent minimizing its individual distribution mismatch allows the convergence to the joint policy that generated the target distribution. Further, if the target distribution is from a joint policy that optimizes a cooperative task, the optimal policy for a combination of this task reward and the distribution matching reward is the same joint policy. This insight is used to formulate a practical algorithm (DM$^2$), in which each individual agent matches a target distribution derived from concurrently sampled trajectories from a joint expert policy. Experimental validation on the StarCraft domain shows that combining (1) a task reward, and (2) a distribution matching reward for expert demonstrations for the same task, allows agents to outperform a naive distributed baseline. Additional experiments probe the conditions under which expert demonstrations need to be sampled to obtain the learning benefits.


title: Assessing Group-level Gender Bias in Professional Evaluations: The Case of Medical Student End-of-Shift Feedback

abstract: Although approximately 50% of medical school graduates today are women, female physicians tend to be underrepresented in senior positions, make less money than their male counterparts and receive fewer promotions. There is a growing body of literature demonstrating gender bias in various forms of evaluation in medicine, but this work was mainly conducted by looking for specific words using fixed dictionaries such as LIWC and focused on recommendation letters. We use a dataset of written and quantitative assessments of medical student performance on individual shifts of work, collected across multiple institutions, to investigate the extent to which gender bias exists in a day-to-day context for medical students. We investigate differences in the narrative comments given to male and female students by both male or female faculty assessors, using a fine-tuned BERT model. This allows us to examine whether groups are written about in systematically different ways, without relying on hand-crafted wordlists or topic models. We compare these results to results from the traditional LIWC method and find that, although we find no evidence of group-level gender bias in this dataset, terms related to family and children are used more in feedback given to women.


title: Fairing of planar curves to log-aesthetic curves

abstract: We present an algorithm to fair a given planar curve by a log-aesthetic curve (LAC). We show how a general LAC segment can be uniquely characterized by seven parameters and present a method of parametric approximation based on this fact. This work aims to provide tools to be used in reverse engineering for computer aided geometric design. Finally, we show an example of usage by applying this algorithm to the point data obtained from 3D scanning a car's roof.


title: Continuous Prediction with Experts' Advice

abstract: Prediction with experts' advice is one of the most fundamental problems in online learning and captures many of its technical challenges. A recent line of work has looked at online learning through the lens of differential equations and continuous-time analysis. This viewpoint has yielded optimal results for several problems in online learning. In this paper, we employ continuous-time stochastic calculus in order to study the discrete-time experts' problem. We use these tools to design a continuous-time, parameter-free algorithm with improved guarantees for the quantile regret. We then develop an analogous discrete-time algorithm with a very similar analysis and identical quantile regret bounds. Finally, we design an anytime continuous-time algorithm with regret matching the optimal fixed-time rate when the gains are independent Brownian Motions; in many settings, this is the most difficult case. This gives some evidence that, even with adversarial gains, the optimal anytime and fixed-time regrets may coincide.


title: Matroids of Gain Signed Graphs

abstract: A signed graph has edge signs. A gain graph has oriented edge gains drawn from a group. We define the combination of the two for the abelian case, in which each oriented edge of a signed graph has a gain from an abelian group, concentrating on the case of the additive group of a field. We develop the elementary graph properties, the associated matroid, and the vector and hyperplanar representations.


title: Transferable Reward Learning by Dynamics-Agnostic Discriminator Ensemble

abstract: Recovering reward function from expert demonstrations is a fundamental problem in reinforcement learning. The recovered reward function captures the motivation of the expert. Agents can imitate experts by following these reward functions in their environment, which is known as apprentice learning. However, the agents may face environments different from the demonstrations, and therefore, desire transferable reward functions. Classical reward learning methods such as inverse reinforcement learning (IRL) or, equivalently, adversarial imitation learning (AIL), recover reward functions coupled with training dynamics, which are hard to be transferable. Previous dynamics-agnostic reward learning methods rely on assumptions such as that the reward function has to be state-only, restricting their applicability. In this work, we present a dynamics-agnostic discriminator-ensemble reward learning method (DARL) within the AIL framework, capable of learning both state-action and state-only reward functions. DARL achieves this by decoupling the reward function from training dynamics, employing a dynamics-agnostic discriminator on a latent space derived from the original state-action space. This latent space is optimized to minimize information on the dynamics. We moreover discover the policy-dependency issue of the AIL framework that reduces the transferability. DARL represents the reward function as an ensemble of discriminators during training to eliminate policy dependencies. Empirical studies on MuJoCo tasks with changed dynamics show that DARL better recovers the reward function and results in better imitation performance in transferred environments, handling both state-only and state-action reward scenarios.


title: $\tau$-tilting finiteness of two-point algebras II

abstract: In this paper, we explain a strategy on $g$-vectors to discover some new minimal $\tau$-tilting infinite two-point algebras. Consequently, the $\tau$-tilting finiteness of various two-point monomial algebras, including all radical cube zero cases, could be determined. Moreover, we find that the derived equivalence class of the Kronecker algebra contains only itself and its opposite algebra.


title: Privacy for Free: How does Dataset Condensation Help Privacy?

abstract: To prevent unintentional data leakage, research community has resorted to data generators that can produce differentially private data for model training. However, for the sake of the data privacy, existing solutions suffer from either expensive training cost or poor generalization performance. Therefore, we raise the question whether training efficiency and privacy can be achieved simultaneously. In this work, we for the first time identify that dataset condensation (DC) which is originally designed for improving training efficiency is also a better solution to replace the traditional data generators for private data generation, thus providing privacy for free. To demonstrate the privacy benefit of DC, we build a connection between DC and differential privacy, and theoretically prove on linear feature extractors (and then extended to non-linear feature extractors) that the existence of one sample has limited impact ($O(m/n)$) on the parameter distribution of networks trained on $m$ samples synthesized from $n (n \gg m)$ raw samples by DC. We also empirically validate the visual privacy and membership privacy of DC-synthesized data by launching both the loss-based and the state-of-the-art likelihood-based membership inference attacks. We envision this work as a milestone for data-efficient and privacy-preserving machine learning.


title: Asymptotic Properties for Bayesian Neural Network in Besov Space

abstract: Neural networks have shown great predictive power when dealing with various unstructured data such as images and natural languages. The Bayesian neural network captures the uncertainty of prediction by putting a prior distribution for the parameter of the model and computing the posterior distribution. In this paper, we show that the Bayesian neural network using spike-and-slab prior has consistency with nearly minimax convergence rate when the true regression function is in the Besov space. Even when the smoothness of the regression function is unknown the same posterior convergence rate holds and thus the spike-and-slab prior is adaptive to the smoothness of the regression function. We also consider the shrinkage prior, which is more feasible than other priors, and show that it has the same convergence rate. In other words, we propose a practical Bayesian neural network with guaranteed asymptotic properties.


title: CrossCBR: Cross-view Contrastive Learning for Bundle Recommendation

abstract: Bundle recommendation aims to recommend a bundle of related items to users, which can satisfy the users' various needs with one-stop convenience. Recent methods usually take advantage of both user-bundle and user-item interactions information to obtain informative representations for users and bundles, corresponding to bundle view and item view, respectively. However, they either use a unified view without differentiation or loosely combine the predictions of two separate views, while the crucial cooperative association between the two views' representations is overlooked. In this work, we propose to model the cooperative association between the two different views through cross-view contrastive learning. By encouraging the alignment of the two separately learned views, each view can distill complementary information from the other view, achieving mutual enhancement. Moreover, by enlarging the dispersion of different users/bundles, the self-discrimination of representations is enhanced. Extensive experiments on three public datasets demonstrate that our method outperforms SOTA baselines by a large margin. Meanwhile, our method requires minimal parameters of three set of embeddings (user, bundle, and item) and the computational costs are largely reduced due to more concise graph structure and graph learning module. In addition, various ablation and model studies demystify the working mechanism and justify our hypothesis. Codes and datasets are available at https://github.com/mysbupt/CrossCBR.


title: A LN2-based cryogenic system prototype for future PandaX experiment

abstract: This paper describes results on R&D of an economical and efficient cryogenic system prototype for future liquid xenon detector. The test module of the prototype has a "cold head" attached to a copper rod, which is specially designed to transport heat loads to a free-boiling liquid nitrogen bath. The performance of the test module and commercial refrigerators is compared. The module with an optimized copper rod has demonstrated more than 1500W cooling power at 178K.The temperature of the "cold head" can be kept stable with an error of 0.02K, its fluctuation is within 0.1K.


title: Fair Comparison between Efficient Attentions

abstract: Transformers have been successfully used in various fields and are becoming the standard tools in computer vision. However, self-attention, a core component of transformers, has a quadratic complexity problem, which limits the use of transformers in various vision tasks that require dense prediction. Many studies aiming at solving this problem have been reported proposed. However, no comparative study of these methods using the same scale has been reported due to different model configurations, training schemes, and new methods. In our paper, we validate these efficient attention models on the ImageNet1K classification task by changing only the attention operation and examining which efficient attention is better.


title: Gradient Gibbs measures of an SOS model with alternating magnetism on Cayley trees

abstract: The work is devoted to gradient Gibbs measures (GGMs) of a SOS model with countable set $\mathbb Z$ of spin values and having alternating magnetism on Cayley trees. This model is defined by a nearest-neighbor gradient interaction potential. Using K\"ulske-Schriever argument, based on boundary law equations, we give several $q$-height-periodic translations invariant GGMs for $q=2,3,4$.


title: Optimizing measurement-based cooling by reinforcement learning

abstract: Conditional cooling-by-measurement holds a significant advantage over its unconditional (nonselective) counterpart in the average-population-reduction rate. However, it has a clear weakness with respect to the limited success probability of finding the detector in the measured state. In this work, we propose an optimized architecture to cool down a target resonator, which is initialized as a thermal state, using an interpolation of conditional and unconditional measurement strategies. An optimal measurement-interval $\tau_{\rm opt}^u$ for unconditional measurement is analytically derived for the first time, which is inversely proportional to the collective dominant Rabi frequency $\Omega_d$ as a function of the resonator's population in the end of the last round. A cooling algorithm under global optimization by the reinforcement learning results in the maximum value for the cooperative cooling performance, an indicator to measure the comprehensive cooling efficiency for arbitrary cooling-by-measurement architecture. In particular, the average population of the target resonator under only $16$ rounds of measurements can be reduced by four orders in magnitude with a success probability about $30\%$.


title: Uniqueness of global weak solutions to the frame hydrodynamics for biaxial nematic phases in $\mathbb{R}^2$

abstract: We consider the hydrodynamics for biaxial nematic phases described by a field of orthonormal frame, which can be derived from a molecular-theory-based tensor model. We prove the uniqueness of global weak solutions to the Cauchy problem of the frame hydrodynamics in dimensional two. The proof is mainly based on the suitable weaker energy estimates within the Littlewood--Paley analysis. We take full advantage of the estimates of nonlinear terms with rotational derivatives on $SO(3)$, together with cancellation relations and dissipative structures of the biaxial frame system.


title: Transcranial photoacoustic computed tomography of human brain function

abstract: Herein we report the first in-human transcranial imaging of brain function using photoacoustic computed tomography. Functional responses to benchmark motor tasks were imaged on both the skull-less and the skull-intact hemispheres of a hemicraniectomy patient. The observed brain responses in these preliminary results demonstrate the potential of photoacoustic computed tomography for achieving transcranial functional imaging.


title: Low mass young stars in the Milky Way unveiled by DBSCAN and Gaia EDR3. Mapping the star forming regions within 1.5 Kpc

abstract: With an unprecedented astrometric and photometric data precision, Gaia EDR3 gives us, for the first time, the opportunity to systematically detect and map in the optical bands, the low mass populations of the star forming regions (SFRs) in the Milky Way. We provide a catalogue of the Gaia EDR3 data (photometry, proper motions and parallaxes) of the young stellar objects (YSOs) identified in the Galactic Plane (|b|<30 deg) within about 1.5 kpc. The catalogue of the SFRs to which they belong is also provided to study the properties of the very young clusters and put them in the context of the Galaxy structure. We applied the machine learning unsupervised clustering algorithm DBSCAN on a sample of Gaia EDR3 data photometrically selected on the region where very young stars (t<10 Myr) are expected to be found, with the aim to identify co-moving and spatially consistent stellar clusters. A subsample of 52 clusters, selected among the 7323 found with DBSCAN, has been used as template data set, to identify very young clusters from the pattern of the observed color-absolute magnitude diagrams through a pattern match process. We find 124440 candidate YSOs clustered in 354 SFRs and stellar clusters younger than 10 Myr and within about 1.5 Kpc. In addition, 65863 low mass members of 322 stellar clusters located within about 500 pc and with ages 10 Myr<t<100 Myr were also found. The selected YSOs are spatially correlated with the well known SFRs. Most of them are associated with well concentrated regions or complex structures of the Galaxy and a substantial number of them have been recognized for the first time. The massive SFRs, such as, for example, Orion, Sco-Cen and Vela, located within 600-700 pc trace a very complex three-dimensional pattern, while the farthest ones seem to follow a more regular pattern along the Galactic Plane.


title: Time-multiplexed In-memory computation scheme for mapping Quantized Neural Networks on hybrid CMOS-OxRAM building blocks

abstract: In this work, we experimentally demonstrate two key building blocks for realizing Binary/Ternary Neural Networks (BNNs/TNNs): (i) 130 nm CMOS based sigmoidal neurons and (ii) HfOx based multi-level (MLC) OxRAM-synaptic blocks. An optimized vector matrix multiplication programming scheme that utilizes the two building blocks is also presented. Compared to prior approaches that utilize differential synaptic structures, a single device per synapse with two sets of READ operations is used. Proposed hardware mapping strategy shows performance change of <5% (decrease of 2-5% for TNN, increase of 0.2% for BNN) compared to ideal quantized neural networks (QNN) with significant memory savings in the order of 16-32x for classification problem on Fashion MNIST (FMNIST) dataset. Impact of OxRAM device variability on the performance of Hardware QNN (BNN/TNN) is also analyzed.


title: The Reactive Synthesis Competition (SYNTCOMP): 2018-2021

abstract: We report on the last four editions of the reactive synthesis competition (SYNTCOMP 2018-2021). We briefly describe the evaluation scheme and the experimental setup of SYNTCOMP. Then, we introduce new benchmark classes that have been added to the SYNTCOMP library and give an overview of the participants of SYNTCOMP. Finally, we present and analyze the results of our experimental evaluations, including a ranking of tools with respect to quantity and quality - that is, the total size in terms of logic and memory elements - of solutions.


title: Interpretable Deep Learning Classifier by Detection of Prototypical Parts on Kidney Stones Images

abstract: Identifying the type of kidney stones can allow urologists to determine their formation cause, improving the early prescription of appropriate treatments to diminish future relapses. However, currently, the associated ex-vivo diagnosis (known as morpho-constitutional analysis, MCA) is time-consuming, expensive, and requires a great deal of experience, as it requires a visual analysis component that is highly operator dependant. Recently, machine learning methods have been developed for in-vivo endoscopic stone recognition. Shallow methods have been demonstrated to be reliable and interpretable but exhibit low accuracy, while deep learning-based methods yield high accuracy but are not explainable. However, high stake decisions require understandable computer-aided diagnosis (CAD) to suggest a course of action based on reasonable evidence, rather than merely prescribe one. Herein, we investigate means for learning part-prototypes (PPs) that enable interpretable models. Our proposal suggests a classification for a kidney stone patch image and provides explanations in a similar way as those used on the MCA method.


title: Intelligent UNIT LEVEL TEST Generator for Enhanced Software Quality

abstract: Unit level test has been widely recognized as an important approach to improve the software quality, as it can expose bugs earlier during the development phase. However, manual unit level test development is often tedious and insufficient. Also, it is hard for developers to precisely identify the most error prone code block deserving the best test coverage by themselves. In this paper, we present the automatic Unit level test framework we used for intel media driver development. It can help us identify the most critical code block, provide the test coverage recommendation, and automatically generate >80% ULT code (~400K Lines of test code) as well as ~35% test cases (~7K test cases) for intel media driver. It helps us to greatly shrink the average ULT development effort from ~24 Man hours to ~3 Man hours per 1000 Lines of driver source code.


title: A Unified Multi-Task Semantic Communication System with Domain Adaptation

abstract: The task-oriented semantic communication systems have achieved significant performance gain, however, the paradigm that employs a model for a specific task might be limited, since the system has to be updated once the task is changed or multiple models are stored for serving various tasks. To address this issue, we firstly propose a unified deep learning enabled semantic communication system (U-DeepSC), where a unified model is developed to serve various transmission tasks. To jointly serve these tasks in one model with fixed parameters, we employ domain adaptation in the training procedure to specify the task-specific features for each task. Thus, the system only needs to transmit the task-specific features, rather than all the features, to reduce the transmission overhead. Moreover, since each task is of different difficulty and requires different number of layers to achieve satisfactory performance, we develop the multi-exit architecture to provide early-exit results for relatively simple tasks. In the experiments, we employ a proposed U-DeepSC to serve five tasks with multi-modalities. Simulation results demonstrate that our proposed U-DeepSC achieves comparable performance to the task-oriented semantic communication system designed for a specific task with significant transmission overhead reduction and much less number of model parameters.


title: Star algorithm for NN ensembling

abstract: Neural network ensembling is a common and robust way to increase model efficiency. In this paper, we propose a new neural network ensemble algorithm based on Audibert's empirical star algorithm. We provide optimal theoretical minimax bound on the excess squared risk. Additionally, we empirically study this algorithm on regression and classification tasks and compare it to most popular ensembling methods.


title: Wavelength-division multiplexing communications using integrated soliton microcomb laser source

abstract: In this Letter, we investigate the feasibility and performance of wavelength division multiplexed (WDM) optical communications using an integrated dissipative Kerr soliton micro-comb as the multi-channel laser source. First, we confirm that soliton microcomb pumped directly by a DFB laser self-injection locked to the host micro-cavity has sufficiently low frequency and amplitude noises to encode advanced data formats. Second, perfect soliton crystals are exploited to boost the power level of each microcomb line, so that they can be directly used for data modulation excluding pre-amplification. Third, in a proof-of-concept experiment we demonstrate 7-channel 16-QAM data transmissions using an integrated perfect soliton microcomb as the laser carriers, excellent data receiving performances are obtained under various fiber link distances and amplifier configurations. Our study reveals that fully integrated Kerr soliton microcombs are viable and advantageous for optical data communications.


title: CoNSoLe: Convex Neural Symbolic Learning

abstract: Learning the underlying equation from data is a fundamental problem in many disciplines. Recent advances rely on Neural Networks (NNs) but do not provide theoretical guarantees in obtaining the exact equations owing to the non-convexity of NNs. In this paper, we propose Convex Neural Symbolic Learning (CoNSoLe) to seek convexity under mild conditions. The main idea is to decompose the recovering process into two steps and convexify each step. In the first step of searching for right symbols, we convexify the deep Q-learning. The key is to maintain double convexity for both the negative Q-function and the negative reward function in each iteration, leading to provable convexity of the negative optimal Q function to learn the true symbol connections. Conditioned on the exact searching result, we construct a Locally Convex equation Learner (LoCaL) neural network to convexify the estimation of symbol coefficients. With such a design, we quantify a large region with strict convexity in the loss surface of LoCaL for commonly used physical functions. Finally, we demonstrate the superior performance of the CoNSoLe framework over the state-of-the-art on a diverse set of datasets.


title: On the Simulation of Hypervisor Instructions for Accurate Timing Simulation of Virtualized Systems

abstract: Architectural simulators help in better understanding the behaviour of existing architectures and the design of new architectures. Virtualization has regained importance and this has put a pressing demand for the simulation of virtualized systems. Existing full-system simulators for virtualized systems simulate the application program instructions and the operating system instructions but abstract the hypercalls or traps to the hypervisor. This leads to inaccuracy in the simulation. This paper proposes an approach to simulate hypervisor instructions in addition to operating system instructions for accurate timing simulation of virtualized systems. The proposed approach is demonstrated by simulating RISC-V binary instructions. The simulator is an execution-driven, functional-first, hardware-based simulator coded in Verilog. The paper concludes that the proposed approach leads to accurate timing simulation of virtualized systems.


title: IDANI: Inference-time Domain Adaptation via Neuron-level Interventions

abstract: Large pre-trained models are usually fine-tuned on downstream task data, and tested on unseen data. When the train and test data come from different domains, the model is likely to struggle, as it is not adapted to the test domain. We propose a new approach for domain adaptation (DA), using neuron-level interventions: We modify the representation of each test example in specific neurons, resulting in a counterfactual example from the source domain, which the model is more familiar with. The modified example is then fed back into the model. While most other DA methods are applied during training time, ours is applied during inference only, making it more efficient and applicable. Our experiments show that our method improves performance on unseen domains.


title: Multi-block Min-max Bilevel Optimization with Applications in Multi-task Deep AUC Maximization

abstract: In this paper, we study multi-block min-max bilevel optimization problems, where the upper level is non-convex strongly-concave minimax objective and the lower level is a strongly convex objective, and there are multiple blocks of dual variables and lower level problems. Due to the intertwined multi-block min-max bilevel structure, the computational cost at each iteration could be prohibitively high, especially with a large number of blocks. To tackle this challenge, we present a single-loop randomized stochastic algorithm, which requires updates for only a constant number of blocks at each iteration. Under some mild assumptions on the problem, we establish its sample complexity of $O(1/\epsilon^4)$ for finding an $\epsilon$-stationary point. This matches the optimal complexity for solving stochastic nonconvex optimization under a general unbiased stochastic oracle model. Moreover, we provide two applications of the proposed method in multi-task deep AUC (area under ROC curve) maximization and multi-task deep partial AUC maximization. Experimental results validate our theory and demonstrate the effectiveness of our method on problems with hundreds of tasks.


title: Structured Neural-PI Control for Networked Systems: Stability and Steady-State Optimality Guarantees

abstract: We study the control of networked systems with the goal of optimizing both transient and steady-state performances while providing stability guarantees. Linear proportional-integral (PI) controllers are almost always used in practice, but the linear parameterization of the controller fundamentally limits its performance. Learning-based approaches are becoming popular in designing nonlinear controllers, but the lack of stability guarantees makes the learned controllers difficult to apply in practical applications. This paper bridges the gap between neural network-based controller design and the need for stability guarantees. Using equilibrium-independent passivity, a property present in a wide range of physical systems, we propose structured neural-PI controllers that have provable guarantees on the convergence of output to a desired agreement value. If communication between neighbours is available, we further extend the controller to distributedly achieve optimal resource allocation at the steady state. We explicitly characterize the stability conditions and engineer neural networks that satisfy them by design. Experiments on traffic and power networks demonstrate that the proposed approach can improve transient and steady-state performances compared to existing state-of-the-art, while unstructured neural networks lead to unstable behaviors.


title: Self-supervised Learning for Label Sparsity in Computational Drug Repositioning

abstract: The computational drug repositioning aims to discover new uses for marketed drugs, which can accelerate the drug development process and play an important role in the existing drug discovery system. However, the number of validated drug-disease associations is scarce compared to the number of drugs and diseases in the real world. Too few labeled samples will make the classification model unable to learn effective latent factors of drugs, resulting in poor generalization performance. In this work, we propose a multi-task self-supervised learning framework for computational drug repositioning. The framework tackles label sparsity by learning a better drug representation. Specifically, we take the drug-disease association prediction problem as the main task, and the auxiliary task is to use data augmentation strategies and contrast learning to mine the internal relationships of the original drug features, so as to automatically learn a better drug representation without supervised labels. And through joint training, it is ensured that the auxiliary task can improve the prediction accuracy of the main task. More precisely, the auxiliary task improves drug representation and serving as additional regularization to improve generalization. Furthermore, we design a multi-input decoding network to improve the reconstruction ability of the autoencoder model. We evaluate our model using three real-world datasets. The experimental results demonstrate the effectiveness of the multi-task self-supervised learning framework, and its predictive ability is superior to the state-of-the-art model.


title: PiDRAM: An FPGA-based Framework for End-to-end Evaluation of Processing-in-DRAM Techniques

abstract: DRAM-based main memory is used in nearly all computing systems as a major component. One way of overcoming the main memory bottleneck is to move computation near memory, a paradigm known as processing-in-memory (PiM). Recent PiM techniques provide a promising way to improve the performance and energy efficiency of existing and future systems at no additional DRAM hardware cost. We develop the Processing-in-DRAM (PiDRAM) framework, the first flexible, end-to-end, and open source framework that enables system integration studies and evaluation of real PiM techniques using real DRAM chips. We demonstrate a prototype of PiDRAM on an FPGA-based platform (Xilinx ZC706) that implements an open-source RISC-V system (Rocket Chip). To demonstrate the flexibility and ease of use of PiDRAM, we implement two PiM techniques: (1) RowClone, an in-DRAM copy and initialization mechanism (using command sequences proposed by ComputeDRAM), and (2) D-RaNGe, an in-DRAM true random number generator based on DRAM activation-latency failures. Our end-to-end evaluation of RowClone shows up to 14.6X speedup for copy and 12.6X initialization operations over CPU copy (i.e., conventional memcpy) and initialization (i.e., conventional calloc) operations. Our implementation of D-RaNGe provides high throughput true random numbers, reaching 8.30 Mb/s throughput. Over the Verilog and C++ basis provided by PiDRAM, implementing the required hardware and software components, implementing RowClone end-to-end takes 198 (565) and implementing D-RaNGe end-to-end takes 190 (78) lines of Verilog (C++) code. PiDRAM is open sourced on Github: https://github.com/CMU-SAFARI/PiDRAM.


title: Pinch-points to half-moons and up in the stars: the kagome skymap

abstract: Pinch point singularities, associated with flat band magnetic excitations, are tell-tale signatures of Coulomb spin liquids. While their properties in the presence of quantum fluctuations have been widely studied, the fate of the complementary non-analytic features -- shaped as half-moons and stars -- arising from adjacent shallow dispersive bands has remained unexplored. Here, we address this question for the spin $S=1/2$ Heisenberg antiferromagnet on the kagome lattice with second and third neighbor couplings, which allows one to tune the classical ground state from flat bands to being governed by shallow dispersive bands for intermediate coupling strengths. Employing the complementary strengths of variational Monte Carlo, pseudo-fermion functional renormalization group, and density-matrix renormalization group, we establish the quantum phase diagram. The U(1) Dirac spin liquid ground state of the nearest-neighbor antiferromagnet remains remarkably robust till intermediate coupling strengths when it transitions into a pinwheel valence bond crystal displaying signatures of half-moons in its structure factor. Our work thus identifies a microscopic setting that realizes one of the proximate orders of the Dirac spin liquid identified in a recent work [Song, Wang, Vishwanath, He, Nat. Commun. 10, 4254 (2019)]. For larger couplings, we obtain a collinear magnetically ordered ground state characterized by star-like patterns.


title: InducT-GCN: Inductive Graph Convolutional Networks for Text Classification

abstract: Text classification aims to assign labels to textual units by making use of global information. Recent studies have applied graph neural network (GNN) to capture the global word co-occurrence in a corpus. Existing approaches require that all the nodes (training and test) in a graph are present during training, which are transductive and do not naturally generalise to unseen nodes. To make those models inductive, they use extra resources, like pretrained word embedding. However, high-quality resource is not always available and hard to train. Under the extreme settings with no extra resource and limited amount of training set, can we still learn an inductive graph-based text classification model? In this paper, we introduce a novel inductive graph-based text classification framework, InducT-GCN (InducTive Graph Convolutional Networks for Text classification). Compared to transductive models that require test documents in training, we construct a graph based on the statistics of training documents only and represent document vectors with a weighted sum of word vectors. We then conduct one-directional GCN propagation during testing. Across five text classification benchmarks, our InducT-GCN outperformed state-of-the-art methods that are either transductive in nature or pre-trained additional resources. We also conducted scalability testing by gradually increasing the data size and revealed that our InducT-GCN can reduce the time and space complexity. The code is available on: https://github.com/usydnlp/InductTGCN.


title: PaGO-LOAM: Robust Ground-Optimized LiDAR Odometry

abstract: Numerous researchers have conducted studies to achieve fast and robust ground-optimized LiDAR odometry methods for terrestrial mobile platforms. In particular, ground-optimized LiDAR odometry usually employs ground segmentation as a preprocessing method. This is because most of the points in a 3D point cloud captured by a 3D LiDAR sensor on a terrestrial platform are from the ground. However, the effect of the performance of ground segmentation on LiDAR odometry is still not closely examined. In this paper, a robust ground-optimized LiDAR odometry framework is proposed to facilitate the study to check the effect of ground segmentation on LiDAR SLAM based on the state-of-the-art (SOTA) method. By using our proposed odometry framework, it is easy and straightforward to test whether ground segmentation algorithms help extract well-described features and thus improve SLAM performance. In addition, by leveraging the SOTA ground segmentation method called Patchwork, which shows robust ground segmentation even in complex and uneven urban environments with little performance perturbation, a novel ground-optimized LiDAR odometry is proposed, called PaGO-LOAM. The methods were tested using the KITTI odometry dataset. \textit{PaGO-LOAM} shows robust and accurate performance compared with the baseline method. Our code is available at https://github.com/url-kaist/AlterGround-LeGO-LOAM.


title: LPFS: Learnable Polarizing Feature Selection for Click-Through Rate Prediction

abstract: In industry, feature selection is a standard but necessary step to search for an optimal set of informative feature fields for efficient and effective training of deep Click-Through Rate (CTR) models. Most previous works measure the importance of feature fields by using their corresponding continuous weights from the model, then remove the feature fields with small weight values. However, removing many features that correspond to small but not exact zero weights will inevitably hurt model performance and not be friendly to hot-start model training. There is also no theoretical guarantee that the magnitude of weights can represent the importance, thus possibly leading to sub-optimal results if using these methods. To tackle this problem, we propose a novel Learnable Polarizing Feature Selection (LPFS) method using a smoothed-$\ell^0$ function in literature. Furthermore, we extend LPFS to LPFS++ by our newly designed smoothed-$\ell^0$-liked function to select a more informative subset of features. LPFS and LPFS++ can be used as gates inserted at the input of the deep network to control the active and inactive state of each feature. When training is finished, some gates are exact zero, while others are around one, which is particularly favored by the practical hot-start training in the industry, due to no damage to the model performance before and after removing the features corresponding to exact-zero gates. Experiments show that our methods outperform others by a clear margin, and have achieved great A/B test results in KuaiShou Technology.


title: The Hipster Paradox in Electronic Dance Music: How Musicians Trade Mainstream Success off against Alternative Status

abstract: The hipster paradox in Electronic Dance Music is the phenomenon that commercial success is collectively considered illegitimate while serious and aspiring professional musicians strive for it. We study this behavioral dilemma using digital traces of performing live and releasing music as they are stored in the \textit{Resident Advisor}, \textit{Juno Download}, and \textit{Discogs} databases from 2001-2018. We construct network snapshots following a formal sociological approach based on bipartite networks, and we use network positions to explain success in regression models of artistic careers. We find evidence for a structural trade-off among success and autonomy. Musicians in EDM embed into exclusive performance-based communities for autonomy but, in earlier career stages, seek the mainstream for commercial success. Our approach highlights how Computational Social Science can benefit from a close connection of data analysis and theory.


title: On two-elementary K3 surfaces with finite automorphism group

abstract: We study complex algebraic K3 surfaces of finite automorphism group that admit a Jacobian elliptic fibration with a section of order two. We classify the K3 surfaces in question, describe their coarse moduli spaces and provide appropriate birational models.


title: Provably Efficient Lifelong Reinforcement Learning with Linear Function Approximation

abstract: We study lifelong reinforcement learning (RL) in a regret minimization setting of linear contextual Markov decision process (MDP), where the agent needs to learn a multi-task policy while solving a streaming sequence of tasks. We propose an algorithm, called UCB Lifelong Value Distillation (UCBlvd), that provably achieves sublinear regret for any sequence of tasks, which may be adaptively chosen based on the agent's past behaviors. Remarkably, our algorithm uses only sublinear number of planning calls, which means that the agent eventually learns a policy that is near optimal for multiple tasks (seen or unseen) without the need of deliberate planning. A key to this property is a new structural assumption that enables computation sharing across tasks during exploration. Specifically, for $K$ task episodes of horizon $H$, our algorithm has a regret bound $\tilde{\mathcal{O}}(\sqrt{(d^3+d^\prime d)H^4K})$ based on $\mathcal{O}(dH\log(K))$ number of planning calls, where $d$ and $d^\prime$ are the feature dimensions of the dynamics and rewards, respectively. This theoretical guarantee implies that our algorithm can enable a lifelong learning agent to accumulate experiences and learn to rapidly solve new tasks.


title: The Relative Entropy Method for Inhomogeneous Systems of Balance Laws

abstract: General hyperbolic systems of balance laws with inhomogeneity in space and time in all constitutive functions are studied in the context of relative entropy. A framework is developed in this setting that contributes to a measure-valued weak vs strong uniqueness theorem, a stability theorem of viscous solutions and a convergence theorem as the viscosity parameter tends to zero. The main goal of this paper is to develop hypotheses under which the relative entropy framework can still be applied. Examples of systems with inhomogeneity that have different charateristics are presented and the hypotheses are discussed in the setting of each example.


title: Vision GNN: An Image is Worth Graph of Nodes

abstract: Network architecture plays a key role in the deep learning-based computer vision system. The widely-used convolutional neural network and transformer treat the image as a grid or sequence structure, which is not flexible to capture irregular and complex objects. In this paper, we propose to represent the image as a graph structure and introduce a new Vision GNN (ViG) architecture to extract graph-level feature for visual tasks. We first split the image to a number of patches which are viewed as nodes, and construct a graph by connecting the nearest neighbors. Based on the graph representation of images, we build our ViG model to transform and exchange information among all the nodes. ViG consists of two basic modules: Grapher module with graph convolution for aggregating and updating graph information, and FFN module with two linear layers for node feature transformation. Both isotropic and pyramid architectures of ViG are built with different model sizes. Extensive experiments on image recognition and object detection tasks demonstrate the superiority of our ViG architecture. We hope this pioneering study of GNN on general visual tasks will provide useful inspiration and experience for future research. The PyTorch code is available at https://github.com/huawei-noah/Efficient-AI-Backbones and the MindSpore code is available at https://gitee.com/mindspore/models.


title: A reinforcement learning-based link quality estimation strategy for RPL and its impact on topology management

abstract: Over the last few years, standardisation efforts are consolidating the role of the Routing Protocol for LowPower and Lossy Networks (RPL) as the standard routing protocol for IPv6 based Wireless Sensor Networks (WSNs). Although many core functionalities are well defined, others are left implementation dependent. Among them, the definition of an efficient link quality estimation (LQE) strategy is of paramount importance, as it influences significantly both the quality of the selected network routes and nodes' energy consumption. In this paper, we present RLProbe, a novel strategy for link quality monitoring in RPL, which accurately measures link quality with minimal overhead and energy waste. To achieve this goal, RLProbe leverages both synchronous and asynchronous monitoring schemes to maintain up-to-date information on link quality and to promptly react to sudden topology changes, e.g. due to mobility. Our solution relies on a reinforcement learning model to drive the monitoring procedures in order to minimise the overhead caused by active probing operations. The performance of the proposed solution is assessed by means of simulations and real experiments. Results demonstrated that RLProbe helps in effectively improving packet loss rates, allowing nodes to promptly react to link quality variations as well as to link failures due to node mobility.


title: Point-Teaching: Weakly Semi-Supervised Object Detection with Point Annotations

abstract: Point annotations are considerably more time-efficient than bounding box annotations. However, how to use cheap point annotations to boost the performance of semi-supervised object detection remains largely unsolved. In this work, we present Point-Teaching, a weakly semi-supervised object detection framework to fully exploit the point annotations. Specifically, we propose a Hungarian-based point matching method to generate pseudo labels for point annotated images. We further propose multiple instance learning (MIL) approaches at the level of images and points to supervise the object detector with point annotations. Finally, we propose a simple-yet-effective data augmentation, termed point-guided copy-paste, to reduce the impact of the unmatched points. Experiments demonstrate the effectiveness of our method on a few datasets and various data regimes.


title: Effect of thresholding on avalanches and their clustering for interfaces with long-range elasticity

abstract: Avalanches are often defined as signals higher than some detection level in bursty systems. The choice of the detection threshold affects the number of avalanches, but it can also affect their temporal correlations. We simulated the depinning of a long-range elastic interface and applied different thresholds including a zero one on the data to see how the sizes and durations of events change and how this affects temporal avalanche clustering. Higher thresholds result in steeper size and duration distributions and cause the avalanches to cluster temporally. Using methods from seismology, the frequency of the events in the clusters was found to decrease as a power-law of time, and the size of an event in a cluster was found to help predict how many events it is followed by. The results bring closer theoretical studies of this class of models to real experiments, but also highlight how different phenomena can be obtained from the same set of data.


title: An adaptive fuzzy dead-zone compensation scheme for nonlinear systems

abstract: The dead-zone nonlinearity is frequently encountered in many industrial automation equipment and its presence can severely compromise control system performance. Due to the possibility to express human experience in an algorithmic manner, fuzzy logic has been largely employed in the last decades to both control and identification of uncertain dynamical systems. In spite of the simplicity of this heuristic approach, in some situations a more rigorous mathematical treatment of the problem is required. In this work, an adaptive fuzzy controller is proposed for nonlinear systems subject to dead-zone input. The convergence properties of the tracking error will be proven using Lyapunov stability theory and Barbalat's lemma. An application of this adaptive fuzzy scheme to a Van der Pol oscillator is introduced to illustrate the controller design method. Numerical results are also presented in order to demonstrate the control system performance.


title: Task-Specific Expert Pruning for Sparse Mixture-of-Experts

abstract: The sparse Mixture-of-Experts (MoE) model is powerful for large-scale pre-training and has achieved promising results due to its model capacity. However, with trillions of parameters, MoE is hard to be deployed on cloud or mobile environment. The inference of MoE requires expert parallelism, which is not hardware-friendly and communication expensive. Especially for resource-limited downstream tasks, such sparse structure has to sacrifice a lot of computing efficiency for limited performance gains. In this work, we observe most experts contribute scarcely little to the MoE fine-tuning and inference. We further propose a general method to progressively drop the non-professional experts for the target downstream task, which preserves the benefits of MoE while reducing the MoE model into one single-expert dense model. Our experiments reveal that the fine-tuned single-expert model could preserve 99.3% benefits from MoE across six different types of tasks while enjoying 2x inference speed with free communication cost.


title: On the Perils of Cascading Robust Classifiers

abstract: Ensembling certifiably robust neural networks is a promising approach for improving the \emph{certified robust accuracy} of neural models. Black-box ensembles that assume only query-access to the constituent models (and their robustness certifiers) during prediction are particularly attractive due to their modular structure. Cascading ensembles are a popular instance of black-box ensembles that appear to improve certified robust accuracies in practice. However, we show that the robustness certifier used by a cascading ensemble is unsound. That is, when a cascading ensemble is certified as locally robust at an input $x$ (with respect to $\epsilon$), there can be inputs $x'$ in the $\epsilon$-ball centered at $x$, such that the cascade's prediction at $x'$ is different from $x$ and thus the ensemble is not locally robust. Our theoretical findings are accompanied by empirical results that further demonstrate this unsoundness. We present \emph{cascade attack} (CasA), an adversarial attack against cascading ensembles, and show that: (1) there exists an adversarial input for up to 88\% of the samples where the ensemble claims to be certifiably robust and accurate; and (2) the accuracy of a cascading ensemble under our attack is as low as 11\% when it claims to be certifiably robust and accurate on 97\% of the test set. Our work reveals a critical pitfall of cascading certifiably robust models by showing that the seemingly beneficial strategy of cascading can actually hurt the robustness of the resulting ensemble. Our code is available at \url{https://github.com/TristaChi/ensembleKW}.


title: Defensive Design of Saturating Counters Based on Differential Privacy

abstract: The saturating counter is the basic module of the dynamic branch predictor, which involves the core technique to improve instruction level parallelism performance in modern processors. However, most studies focus on the performance improvement and hardware consumption of saturating counters, while ignoring the security problems they may cause. In this paper, we creatively propose to study and design saturating counters from the defense perspective of differential privacy, so that attackers cannot distinguish the states that saturating counters are in and further infer sensitive information. To obtain theoretical guarantees, we use Markov chain to formalize the attack algorithm applied to the saturating counter, investigate into the optimal attack strategy and calculate the probability of successful attack. Furthermore, we find that the attacker is able to accurately guess the branch execution of the victim's process in the existing saturating counters. To avoid this, we design a new probabilistic saturating counter, which generalizes the existing conventional and probabilistic saturating counters. The guarantee of differential privacy is applied to deduce parameters of the new saturating counters so that the security requirement can be satisfied. We also theoretically calculate the misprediction rate when the saturating counter reaches the steady state. The experimental results on testing programs show that the calculated theoretical results agree with the experimental performances. Compared with the existing conventional and probabilistic saturating counters, when the parameters of our designed models are selected appropriately, the new saturating counters can not only ensure similar operational performance, but also establish strict security guarantee.


title: Automatic Bounding Box Annotation with Small Training Data Sets for Industrial Manufacturing

abstract: In the past few years, object detection has attracted a lot of attention in the context of human-robot collaboration and Industry 5.0 due to enormous quality improvements in deep learning technologies. In many applications, object detection models have to be able to quickly adapt to a changing environment, i.e., to learn new objects. A crucial but challenging prerequisite for this is the automatic generation of new training data which currently still limits the broad application of object detection methods in industrial manufacturing. In this work, we discuss how to adapt state-of-the-art object detection methods for the task of automatic bounding box annotation for the use case where the background is homogeneous and the object's label is provided by a human. We compare an adapted version of Faster R-CNN and the Scaled Yolov4-p5 architecture and show that both can be trained to distinguish unknown objects from a complex but homogeneous background using only a small amount of training data.


title: Charge density wave and superconductivity in 6R-TaS2

abstract: The layered transition metal dichalcogenide compounds 1T-TaS2 and 4H-TaS2 are well known for their exotic properties, which include charge density wave, superconductivity, Mott transition, etc., and lately quantum spin liquid. Here, we report the magnetic, transport and transmission electron microscopy study of the charge density wave and superconductivity in 6R-TaS2 which is a relatively less studied polymorph of this dichalcogenide TaS2. Our high temperature electron microscopy reveals multiple charge density wave transitions between room temperature and 650K. Magnetization, and the electrical resistivity measurements in the temperature range of 2-400 K reveal that 6R-TaS2 undergoes a charge density wave transition around 305 K and is followed by a transition to a superconducting state around 3.5 K. The low temperature specific heat measurement exhibits anomaly associated with the superconducting transition around 2.4 K. The estimated Ginzburg Landau parameter suggests that this compound lies at the extreme limit of type-II superconductivity.


title: Needle In A Haystack, Fast: Benchmarking Image Perceptual Similarity Metrics At Scale

abstract: The advent of the internet, followed shortly by the social media made it ubiquitous in consuming and sharing information between anyone with access to it. The evolution in the consumption of media driven by this change, led to the emergence of images as means to express oneself, convey information and convince others efficiently. With computer vision algorithms progressing radically over the last decade, it is become easier and easier to study at scale the role of images in the flow of information online. While the research questions and overall pipelines differ radically, almost all start with a crucial first step - evaluation of global perceptual similarity between different images. That initial step is crucial for overall pipeline performance and processes most images. A number of algorithms are available and currently used to perform it, but so far no comprehensive review was available to guide the choice of researchers as to the choice of an algorithm best suited to their question, assumptions and computational resources. With this paper we aim to fill this gap, showing that classical computer vision methods are not necessarily the best approach, whereas a pair of relatively little used methods - Dhash perceptual hash and SimCLR v2 ResNets achieve excellent performance, scale well and are computationally efficient.


title: Noether's 1st theorem with local symmetries

abstract: Noether's 2nd theorem applied to a total system states that a global symmetry which is a part of local symmetries does not provide a physically meaningful conserved charge but it instead leads to off-shell constraints as a form of conserved currents. In this paper, we propose a general method to derive a matter conserved current associated with a special global symmetry in the presence of local symmetries. While currents derived from local symmetries of a matter sector with a covariant background gauge field are not conserved in general, we show that the current associated with a special type of a global symmetry, called a hidden matter symmetry, is on-shell conserved. We apply this derivation to a $U(1)$ gauge theory, general relativity and a non-abelian gauge theory. In general relativity, the associated conserved charge agrees with the one recently proposed from a different point of view.


title: A Chandra Survey of Milky Way Globular Clusters. III. Searching for X-ray Signature of Intermediate-mass Black Holes

abstract: Globular clusters (GCs) are thought to harbor the long-sought population of intermediate-mass black holes (IMBHs). We present a systematic search for a putative IMBH in 81 Milky Way GCs, based on archival Chandra X-ray observations. We find in only six GCs a significant X-ray source positionally coincident with the cluster center, which have 0.5-8 keV luminosities between $\sim1\times 10^{30}~{\rm erg~s^{-1}}$ to $\sim 4\times10^{33}~{\rm erg~s^{-1}}$. However, the spectral and temporal properties of these six sources can also be explained in terms of binary stars. The remaining 75 GCs do not have a detectable central source, most with $3\sigma$ upper limits ranging between $10^{29-32}~{\rm erg~s^{-1}}$ over 0.5-8 keV, which are significantly lower than predicted for canonical Bondi accretion. To help understand the feeble X-ray signature, we perform hydrodynamic simulations of stellar wind accretion onto a $1000~{\rm M_\odot}$ IMBH from the most-bound orbiting star, for stellar wind properties consistent with either a main-sequence (MS) star or an asymptotic giant branch (AGB) star. We find that the synthetic X-ray luminosity for the MS case ($\sim 10^{19}\rm~erg~s^{-1}$) is far below the current X-ray limits. The predicted X-ray luminosity for the AGB case ($\sim 10^{34}\rm~erg~s^{-1}$), on the other hand, is compatible with the detected central X-ray sources, in particular the ones in Terzan 5 and NGC 6652. However, the probability of having an AGB star as the most-bound star around the putative IMBH is very low. Our study strongly suggests that it is very challenging to detect the accretion-induced X-ray emission from IMBHs, even if they were prevalent in present-day GCs.


title: Stochastic Gradient Methods with Preconditioned Updates

abstract: This work considers the non-convex finite sum minimization problem. There are several algorithms for such problems, but existing methods often work poorly when the problem is badly scaled and/or ill-conditioned, and a primary goal of this work is to introduce methods that alleviate this issue. Thus, here we include a preconditioner based on Hutchinson's approach to approximating the diagonal of the Hessian, and couple it with several gradient-based methods to give new scaled algorithms: Scaled SARAH and Scaled L-SVRG. Theoretical complexity guarantees under smoothness assumptions are presented. We prove linear convergence when both smoothness and the PL condition are assumed. Our adaptively scaled methods use approximate partial second-order curvature information and, therefore, can better mitigate the impact of badly scaled problems. This improved practical performance is demonstrated in the numerical experiments also presented in this work.


title: Non-equilibrium magnetic response in concentrated spin-glass AuFe(11%) alloy

abstract: We report a detailed study of dc magnetization and ac susceptibility performed on the zero field cooled (ZFC) and field cooled (FC) state of polycrystalline AuFe(11%) alloy. The temperature variation of ZFC and FC dc magnetization at low fields show a distinct peak around Tf = 33 K, which indicates the cooperative freezing of the finite size spin clusters. A weak thermomagnetic irreversibility between ZFC and FC magnetization appears at a temperature Tir, which is slightly below Tf. The ZFC ac susceptibility shows a sharp cusp at Tf, which shifts towards higher temperatures with an increase in the frequency of the ac magnetic field. When ac susceptibility is recorded after cooling the sample from high temperature in the presence of dc bias magnetic field, the susceptibility cusp gets broadened. In this case, no perceptible frequency dependency of the Tf has been observed, but a significant dispersion in the ac susceptibility is present below Tf. This clearly indicates the non-equilibrium nature of the FC state.In addition, the FC state of AuFe(11%) alloy exhibits a pronounced memory effect which further underlines that the FC state is not an equilibrium state. In contrast to the general perception obtained through the meanfield theories of thermodynamic phase transition in spin-glass envisaging the FC state to be an equilibrium state, the present experimental results clearly indicate that the energy landscape of the FC state of AuFe(11%) alloy is a nontrivial one


title: Strict Half-Singleton Bound, Strict Direct Upper Bound for Linear Insertion-Deletion Codes and Optimal Codes

abstract: Insertion-deletion codes (insdel codes for short) are used for correcting synchronization errors in communications, and in other many interesting fields such as DNA storage, date analysis, race-track memory error correction and language processing, and have recently gained a lot of attention. To determine the insdel distances of linear codes is a very challenging problem. The half-Singleton bound on the insdel distances of linear codes due to Cheng-Guruswami-Haeupler-Li is a basic upper bound on the insertion-deletion error-correcting capabilities of linear codes. On the other hand the natural direct upper bound $d_I(\mathcal C) \leq 2d_H(\mathcal C)$ is valid for any insdel code. In this paper, for a linear insdel code $\mathcal C$ we propose a strict half-Singleton upper bound $d_I(\mathcal C) \leq 2(n-2k+1)$ if $\mathcal C$ does not contain the codeword with all 1s, and a stronger direct upper bound $d_I(\mathcal C) \leq 2(d_H(\mathcal C)-t)$ under a weak condition, where $t\geq 1$ is a positive integer determined by the generator matrix. We also give optimal linear insdel codes attaining our strict half-Singleton bound and direct upper bound, and show that the code length of optimal binary linear insdel codes with respect to the (strict) half-Singleton bound is about twice the dimension. Interestingly explicit optimal linear insdel codes attaining the (strict) half-Singleton bound, with the code length being independent of the finite field size, are given.


title: Sustaining Security and Safety in ICT: A Quest for Terminology, Objectives, and Limits

abstract: Security and safety are intertwined concepts in the world of computing. In recent years, the terms "sustainable security" and "sustainable safety" came into fashion and are being used referring to a variety of systems properties ranging from efficiency to profitability, and sometimes meaning that a product or service is good for people and planet. This leads to confusing perceptions of products where customers might expect a sustainable product to be developed without child labour, while the producer uses the term to signify that their new product uses marginally less power than the previous generation of that products. Even in research on sustainably safe and secure ICT, these different notions of terminology are prevalent. As researchers we often work towards optimising our subject of study towards one specific sustainability metric - let's say energy consumption - while being blissfully unaware of, e.g., social impacts, life-cycle impacts, or rebound effects of such optimisations. In this paper I dissect the idea of sustainable safety and security, starting from the questions of what we want to sustain, and for whom we want to sustain it. I believe that a general "people and planet" answer is inadequate here because this form of sustainability cannot be the property of a single industry sector but must be addressed by society as a whole. However, with sufficient understanding of life-cycle impacts we may very well be able to devise research and development efforts, and inform decision making processes towards the use of integrated safety and security solutions that help us to address societal challenges in the context of the climate and ecological crises, and that are aligned with concepts such as intersectionality and climate justice. Of course, these solutions can only be effective if they are embedded in societal and economic change towards more frugal uses of data and ICT.


title: MORE: A Metric Learning Based Framework for Open-domain Relation Extraction

abstract: Open relation extraction (OpenRE) is the task of extracting relation schemes from open-domain corpora. Most existing OpenRE methods either do not fully benefit from high-quality labeled corpora or can not learn semantic representation directly, affecting downstream clustering efficiency. To address these problems, in this work, we propose a novel learning framework named MORE (Metric learning-based Open Relation Extraction). The framework utilizes deep metric learning to obtain rich supervision signals from labeled data and drive the neural model to learn semantic relational representation directly. Experiments result in two real-world datasets show that our method outperforms other state-of-the-art baselines. Our source code is available on Github.


title: Discrete Gradient Flow Approximations of High Dimensional Evolution Partial Differential Equations via Deep Neural Networks

abstract: We consider the approximation of initial/boundary value problems involving, possibly high-dimensional, dissipative evolution partial differential equations (PDEs) using a deep neural network framework. More specifically, we first propose discrete gradient flow approximations based on non-standard Dirichlet energies for problems involving essential boundary conditions posed on bounded spatial domains. The imposition of the boundary conditions is realized weakly via non-standard functionals; the latter classically arise in the construction of Galerkin-type numerical methods and are often referred to as "Nitsche-type" methods. Moreover, inspired by the seminal work of Jordan, Kinderleher, and Otto (JKO) \cite{jko}, we consider the second class of discrete gradient flows for special classes of dissipative evolution PDE problems with non-essential boundary conditions. These JKO-type gradient flows are solved via deep neural network approximations. A key, distinct aspect of the proposed methods is that the discretization is constructed via a sequence of residual-type deep neural networks (DNN) corresponding to implicit time-stepping. As a result, a DNN represents the PDE problem solution at each time node. This approach offers several advantages in the training of each DNN. We present a series of numerical experiments which showcase the good performance of Dirichlet-type energy approximations for lower space dimensions and the excellent performance of the JKO-type energies for higher spatial dimensions.


title: Efficient Multi-Purpose Cross-Attention Based Image Alignment Block for Edge Devices

abstract: Image alignment, also known as image registration, is a critical block used in many computer vision problems. One of the key factors in alignment is efficiency, as inefficient aligners can cause significant overhead to the overall problem. In the literature, there are some blocks that appear to do the alignment operation, although most do not focus on efficiency. Therefore, an image alignment block which can both work in time and/or space and can work on edge devices would be beneficial for almost all networks dealing with multiple images. Given its wide usage and importance, we propose an efficient, cross-attention-based, multi-purpose image alignment block (XABA) suitable to work within edge devices. Using cross-attention, we exploit the relationships between features extracted from images. To make cross-attention feasible for real-time image alignment problems and handle large motions, we provide a pyramidal block based cross-attention scheme. This also captures local relationships besides reducing memory requirements and number of operations. Efficient XABA models achieve real-time requirements of running above 20 FPS performance on NVIDIA Jetson Xavier with 30W power consumption compared to other powerful computers. Used as a sub-block in a larger network, XABA also improves multi-image super-resolution network performance in comparison to other alignment methods.


title: Transition between long and short-range helical orders in mixed B20 cubic helimagnets

abstract: A model of B20 helimagnet with strong (frustrating) defect bonds is considered. Single defect provides dipolar field-like distortion of the helical magnetic ordering. At finite defect bond concentrations, the spiral vector acquires correction to its value in the pure system. Moreover, it is shown that the strong defects of sufficient but small concentration are able to destroy long-range order driving the system to the phase with short-range helical ordering. It is argued that the developed approach allows describing main experimental observations in Mn$_{1-x}$Fe$_x$Si and Mn$_{1-x}$Co$_x$Si compounds.


title: Multi-dimensional structure of C. elegans thermal learning

abstract: Quantitative models of associative learning that explain the behavior of real animals with high precision have turned out very difficult to construct. We do this in the context of the dynamics of the thermal preference of C. elegans. For this, we quantify C. elegans thermotaxis in response to various conditioning parameters, genetic perturbations, and operant behavior using a fast, high-throughput microfluidic droplet assay. We then model this data comprehensively, within a new, biologically interpretable, multi-modal framework. We discover that the dynamics of thermal preference are described by two independent contributions and require a model with at least four dynamical variables. One pathway positively associates the experienced temperature independently of food and the other negatively associates to the temperature when food is absent.


title: Tutorial notes for the evaluation of thermoelectric quantum bounds in ideal nanostructures

abstract: The wave-like nature of electrons leads to the existence of upper bounds on the thermoelectric response of nanostructured devices [R. S. Whitney, Phys. Rev. Lett. 112, 130601 (2014); Phys. Rev. B 91, 115425 (2015)]. This fundamental result, not present in classical thermodynamics, was demonstrated exploiting a two-terminal device modelled by non-linear scattering theory. In the present paper, we consider non-linear quantum transport through the same type of device working both as thermal machine and as refrigerator. For both operations, starting from charge and heat current expressions, we provide analytic quantum bounds for power exchanged, thermal currents and device efficiencies. For this purpose, we adopt a transmission function that maximizes the engine efficiency for given power output. For the optimal boxcar- or theta function-transmission shapes, we provide in a tutorial way an explicit deduction of the quantum bound expressions reported in the above cited papers.


title: Redundant apodization for direct imaging of exoplanets 2: Application to island effects

abstract: Telescope pupil fragmentation from spiders generates specific aberrations observed at various telescopes and expected on the large telescopes under construction. This so-called island effect induces differential pistons, tips and tilts on the pupil petals, deforming the instrumental PSF, and is one of the main limitations to the detection of exoplanets with high-contrast imaging. These aberrations have different origins such as the low-wind effect or petaling errors in the adaptive-optics reconstruction. In this paper, we propose to alleviate the impact of the aberrations induced by island effects on high-contrast imaging by adapting the coronagraph design in order to increase its robustness to petal-level aberrations. Following a method first developed for errors due to primary mirror segmentation (segment phasing errors, missing segments...), we develop and test Redundant Apodized Pupils (RAP), i.e. apodizers designed at the petal-scale, then duplicated and rotated to mimic the pupil petal geometry. We apply this concept to the ELT architecture, made of six identical petals, to yield a 10^-6 contrast in a dark region from 8 to 40lambda/D. Both amplitude and phase apodizers proposed in this paper are robust to differential pistons between petals, with minimal degradation to their coronagraphic PSFs and contrast levels. In addition, they are also more robust to petal-level tip-tilt errors than apodizers designed for the whole pupil, with which the limit of contrast of 10^-6 in the coronagraph dark zone is achieved for constraints up to 2 rad RMS of these petal-level modes. The RAP concept proves its robustness to island effects (low-wind effect and post-adaptive optics petaling), with an application to the ELT architecture. It can also be considered for other 8- to 30-meter class ground-based units such as VLT/SPHERE, Subaru/SCExAO, GMT/GMagAO-X, or TMT/PSI.


title: Puzzling time properties of proportional electroluminescence in two-phase argon detectors for dark matter searches

abstract: Proportional electroluminescence (EL) in noble gases is a physical process routinely used in two-phase (liquid-gas) detectors for low-energy astroparticle-physics experiments. In this work, the time properties of visible-light EL in two-phase argon detectors have been systematically studied for the first time. In particular, two unusual slow components in the EL signal, with their contributions and time constants increasing with electric field, were observed. This puzzling property is not expected in any of the known mechanisms of photon and electron emission in two-phase media. Time constants of these components is about 4-5 $\mu$s and 50 $\mu$s. In addition, a specific threshold behavior of the slow components was revealed: they emerged at a threshold in reduced electric field of 4.8 $\pm$ 0.2 Td regardless of the gas phase density, which is about 1 Td above the onset of standard (excimer) EL. There is a conspicuous similarity between this threshold and reduced field threshold of EL in NIR occurring via higher atomic excited states Ar$^{*}(3p^{5}4p)$. An unexpected temperature dependence of slow components was also observed: their contribution decreased with temperature, practically disappearing at room temperature. We show that the puzzling properties of slow components can be explained in the framework of hypothesis that these are produced in the charge signal itself due to trapping of drifting electrons on metastable negative argon ions.


title: First-order conditions for the optimal control of learning-informed nonsmooth PDEs

abstract: In this paper we study the optimal control of a class of semilinear elliptic partial differential equations which have nonlinear constituents that are only accessible by data and are approximated by nonsmooth ReLU neural networks. The optimal control problem is studied in detail. In particular, the existence and uniqueness of the state equation are shown, and continuity as well as directional differentiability properties of the corresponding control-to-state map are established. Based on approximation capabilities of the pertinent networks, we address fundamental questions regarding approximating properties of the learning-informed control-to-state map and the solution of the corresponding optimal control problem. Finally, several stationarity conditions are derived based on different notions of generalized differentiability.


title: Exploration of Knitted Spacer Fabrics using Grasshopper

abstract: We describe a novel approach for exploring, visualizing and modelling of complex textile structures. We show this approach in action for the exploration of weft-knitted spacer fabrics. The modelling tools are readily available and represent a fast-growing approach in communities of generative design. The approach helps solving the problem that spacer fabrics are complex structures which are hard to imagine and to visualize. The explorations turn out insight-full and flexible and are complementary to what can be done with existing tools.


title: Restoring and tailoring very high dimensional spatial entanglement of a biphoton state transmitted through a scattering medium

abstract: We report experimental results where a momentum entangled biphoton state with a giant dimensionality of 8000 is retrieved and manipulated when only one photon of the pair is transmitted through a thin scattering medium. For this purpose, the transmission matrix of the complex medium is first measured with a phase-shifting interferometry measurement method using a spatial light modulator (SLM) illuminated with a laser source. From this matrix, different phase masks are calculated and addressed on the SLM to spatially control the focusing of the laser through the complex medium. These same masks are used to manipulate the phase of the biphoton wave function transmitted by the thin diffuser in order to restore and control in the same way the momentum correlations between the far-field images of twin beams issued from strongly spatial-multi-mode spontaneous parametric down conversion.


title: Numerical simulation of universal morphogenesis of fluid interface deformations driven by radiation pressure

abstract: We report on ab initio simulation of fluid interface deformations induced either by acoustic or optical radiation pressure. This is done by solving simultaneously the scalar wave propagation equation and the two-phase flow equations using the boundary element method. Using dimensional analysis, we show that interface deformation morphogenesis is universal, i.e. depends on the same dimensionless parameters in acoustics and electromagnetics. We numerically investigate a few selected phenomena -- in particular the shape of large deformations, the slenderness transition and its hysteresis -- and compare with existing and novel experimental observations. Qualitative agreement between the numerical simulations and experiments is found when the mutual interaction between wave propagation and wave-induced deformations is taken into account. Our results demonstrate the leading role of the radiation pressure in morphogenesis of fluid interface deformations and the importance of the propagation-deformation interplay .


title: Coherent noise suppression via a self-supervised blind-trace deep learning scheme

abstract: Coherent noise regularly plagues seismic recordings, causing artefacts and uncertainties in products derived from down-the-line processing and imaging tasks. The outstanding capabilities of deep learning in denoising of natural and medical images have recently spur a number of applications of neural networks in the context of seismic data denoising. A limitation of the majority of such methods is that the deep learning procedure is supervised and requires clean (noise-free) data as a target for training the network. Blindspot networks were recently proposed to overcome this requirement, allowing training to be performed directly on the noisy field data as a powerful suppressor of random noise. A careful adaptation of the blind-spot methodology allows for an extension to coherent noise suppression. In this work, we expand the methodology of blind-spot networks to create a blind-trace network that successfully removes trace-wise coherent noise. Through an extensive synthetic analysis, we illustrate the denoising procedure's robustness to varying noise levels, as well as varying numbers of noisy traces within shot gathers. It is shown that the network can accurately learn to suppress the noise when up to 60% of the original traces are noisy. Furthermore, the proposed procedure is implemented on the Stratton 3D field dataset and is shown to restore the previously corrupted direct arrivals. Our adaptation of the blind-spot network for self-supervised, trace-wise noise suppression could lead to other use-cases such as the suppression of coherent noise arising from wellsite activity, passing vessels or nearby industrial activity.


title: Multi-Complexity-Loss DNAS for Energy-Efficient and Memory-Constrained Deep Neural Networks

abstract: Neural Architecture Search (NAS) is increasingly popular to automatically explore the accuracy versus computational complexity trade-off of Deep Learning (DL) architectures. When targeting tiny edge devices, the main challenge for DL deployment is matching the tight memory constraints, hence most NAS algorithms consider model size as the complexity metric. Other methods reduce the energy or latency of DL models by trading off accuracy and number of inference operations. Energy and memory are rarely considered simultaneously, in particular by low-search-cost Differentiable NAS (DNAS) solutions. We overcome this limitation proposing the first DNAS that directly addresses the most realistic scenario from a designer's perspective: the co-optimization of accuracy and energy (or latency) under a memory constraint, determined by the target HW. We do so by combining two complexity-dependent loss functions during training, with independent strength. Testing on three edge-relevant tasks from the MLPerf Tiny benchmark suite, we obtain rich Pareto sets of architectures in the energy vs. accuracy space, with memory footprints constraints spanning from 75% to 6.25% of the baseline networks. When deployed on a commercial edge device, the STM NUCLEO-H743ZI2, our networks span a range of 2.18x in energy consumption and 4.04% in accuracy for the same memory constraint, and reduce energy by up to 2.2x with negligible accuracy drop with respect to the baseline.


title: Predecessor Features

abstract: Any reinforcement learning system must be able to identify which past events contributed to observed outcomes, a problem known as credit assignment. A common solution to this problem is to use an eligibility trace to assign credit to recency-weighted set of experienced events. However, in many realistic tasks, the set of recently experienced events are only one of the many possible action events that could have preceded the current outcome. This suggests that reinforcement learning can be made more efficient by allowing credit assignment to any viable preceding state, rather than only those most recently experienced. Accordingly, we examine ``Predecessor Features'', the fully bootstrapped version of van Hasselt's ``Expected Trace'', an algorithm that achieves this richer form of credit assignment. By maintaining a representation that approximates the expected sum of past occupancies, this algorithm allows temporal difference (TD) errors to be propagated accurately to a larger number of predecessor states than conventional methods, greatly improving learning speed. The algorithm can also be naturally extended from tabular state representation to feature representations allowing for increased performance on a wide range of environments. We demonstrate several use cases for Predecessor Features and compare its performance with other approaches.


title: Perception-Intention-Action Cycle in Human-Robot Collaborative Tasks

abstract: In this work we argue that in Human-Robot Collaboration (HRC) tasks, the Perception-Action cycle in HRC tasks can not fully explain the collaborative behaviour of the human and robot and it has to be extended to Perception-Intention-Action cycle, where Intention is a key topic. In some cases, agent Intention can be perceived or inferred by the other agent, but in others, it has to be explicitly informed to the other agent to succeed the goal of the HRC task. The Perception-Intention-Action cycle includes three basic functional procedures: Perception-Intention, Situation Awareness and Action. The Perception and the Intention are the input of the Situation Awareness, which evaluates the current situation and projects it, into the future situation. The agents receive this information, plans and agree with the actions to be executed and modify their action roles while perform the HRC task. In this work, we validate the Perception-Intention-Action cycle in a joint object transportation task, modeling the Perception-Intention-Action cycle through a force model which uses real life and social forces. The perceived world is projected into a force world and the human intention (perceived or informed) is also modelled as a force that acts in the HRC task. Finally, we show that the action roles (master-slave, collaborative, neutral or adversary) are intrinsic to any HRC task and they appear in the different steps of a collaborative sequence of actions performed during the task.


title: Supervised Denoising of Diffusion-Weighted Magnetic Resonance Images Using a Convolutional Neural Network and Transfer Learning

abstract: In this paper, we propose a method for denoising diffusion-weighted images (DWI) of the brain using a convolutional neural network trained on realistic, synthetic MR data. We compare our results to averaging of repeated scans, a widespread method used in clinics to improve signal-to-noise ratio of MR images. To obtain training data for transfer learning, we model, in a data-driven fashion, the effects of echo-planar imaging (EPI): Nyquist ghosting and ramp sampling. We introduce these effects to the digital phantom of brain anatomy (BrainWeb). Instead of simulating pseudo-random noise with a defined probability distribution, we perform noise scans with a brain-DWI-designed protocol to obtain realistic noise maps. We combine them with the simulated, noise-free EPI images. We also measure the Point Spread Function in a DW image of an AJR-approved geometrical phantom and inter-scan movement in a brain scan of a healthy volunteer. Their influence on image denoising and averaging of repeated images is investigated at different signal-to-noise ratio levels. Denoising performance is evaluated quantitatively using the simulated EPI images and qualitatively in real EPI DWI of the brain. We show that the application of our method allows for a significant reduction in scan time by lowering the number of repeated scans. Visual comparisons made in the acquired brain images indicate that the denoised single-repetition images are less noisy than multi-repetition averaged images. We also analyse the convolutional neural network denoiser and point out the challenges accompanying this denoising method.


title: Scattering anisotropy in HgTe (013) quantum well

abstract: We report on a detailed experimental study of the electron transport anisotropy in HgTe (013) quantum well of 22 nm width in the directions $[100]$ and $[03\bar{1}]$ as the function of the electron density $n$. The anisotropy is absent at minimal electron density near the charge neutrality point. The anisotropy increases with the increase of n and reaches about 10% when the Fermi level is within the first subband H1. There is a sharp increase of the anisotropy (up to 60%) when the Fermi level reaches the second subband E2. We conclude that the first effect is due to the small intra-subband anisotropic interface roughness scattering, and the second one is due to the strongly anisotropic inter-subband roughness scattering, but the microscopical reason of such a strong change in the anisotropy remains unknown.