title: Unsupervised Representation Learning for Gaze Estimation

abstract: Although automatic gaze estimation is very important to a large variety of application areas, it is difficult to train accurate and robust gaze models, in great part due to the difficulty in collecting large and diverse data (annotating 3D gaze is expensive and existing datasets use different setups). To address this issue, our main contribution in this paper is to propose an effective approach to learn a low dimensional gaze representation without gaze annotations, which to the best of our best knowledge, is the first work to do so. The main idea is to rely on a gaze redirection network and use the gaze representation difference of the input and target images (of the redirection network) as the redirection variable. A redirection loss in image domain allows the joint training of both the redirection network and the gaze representation network. In addition, we propose a warping field regularization which not only provides an explicit physical meaning to the gaze representations but also avoids redirection distortions. Promising results on few-shot gaze estimation (competitive results can be achieved with as few as <= 100 calibration samples), cross-dataset gaze estimation, gaze network pretraining, and another task (head pose estimation) demonstrate the validity of our framework.


title: Utterance-to-Utterance Interactive Matching Network for Multi-Turn Response Selection in Retrieval-Based Chatbots

abstract: This paper proposes an utterance-to-utterance interactive matching network (U2U-IMN) for multi-turn response selection in retrieval-based chatbots. Different from previous methods following context-to-response matching or utterance-to-response matching frameworks, this model treats both contexts and responses as sequences of utterances when calculating the matching degrees between them. For a context-response pair, the U2U-IMN model first encodes each utterance separately using recurrent and self-attention layers. Then, a global and bidirectional interaction between the context and the response is conducted using the attention mechanism to collect the matching information between them. The distances between context and response utterances are employed as a prior component when calculating the attention weights. Finally, sentence-level aggregation and context-response-level aggregation are executed in turn to obtain the feature vector for matching degree prediction. Experiments on four public datasets showed that our proposed method outperformed baseline methods on all metrics, achieving a new state-of-the-art performance and demonstrating compatibility across domains for multi-turn response selection.


title: Exploring the convective core of the hybrid $\delta$ Scuti-$\gamma$ Doradus star CoRoT 100866999 with asteroseismology

abstract: We computed a grid of theoretical models to fit the $\delta$ Scuti frequencies of CoRoT 100866999 detected earlier from the CoRoT timeserials. The pulsating primary star is determined to be a main sequence star with a rotation period of $4.1^{+0.6}_{-0.5}$ days, rotating slower than the orbital motion. The fundamental parameters of the primary star are determined to be $M$ = $1.71^{+0.13}_{-0.04}$ $M_{\odot}$, $Z=0.012^{+0.004}_{-0.000}$, $f_{\rm ov}$ = $0.02^{+0.00}_{-0.02}$, $T_{\rm eff}$ = $8024^{+249}_{-297}$ K, $L$ = $11.898^{+2.156}_{-1.847}$ $L_{\odot}$, $\log g$ = $4.166^{+0.013}_{-0.002}$, $R$ = $1.787^{+0.040}_{-0.016}$ $R_{\odot}$, and $X_{\rm c}$ = 0.488$^{+0.011}_{-0.020}$, matching well those obtained from the eclipsing light curve analysis. Based on the model fittings, $p_1$ and $p_5$ are suggested to be two dipole modes, and $p_3$, $p_4$, $p_6$, and $p_7$ to be four quadrupole modes. In particular, $p_4$ and $p_7$ are identified as two components of one quintuplet. Based on the best-fitting model, we find that $p_1$ is a g mode and the other nonradial modes have pronounced mixed characters, which give strong constraints on the convective core. Finally, the relative size of the convective core of CoRoT 100866999 is determined to $R_{\rm conv}/R$ = $0.0931^{+0.0003}_{-0.0013}$.


title: Upward Overshooting in Turbulent Compressible Convection. I.Effects of the relative stability parameter, the Prandtl number, and the P\'eclet number

abstract: In this paper, we investigate the upward overshooting by three-dimensional numerical simulations. We find that the above convectively stable zone can be partitioned into three layers: the thermal adjustment layer (mixing both entropy and material), the turbulent dissipation layer (mixing material but not entropy), and the thermal dissipation layer (mixing neither entropy nor material). The turbulent dissipation layer is separated from the thermal adjustment layer and the thermal dissipation layer by the first and second zero points of the vertical velocity correlation. The simulation results are in good agreement with the prediction of the one-dimensional turbulent Reynolds stress model. First, the layer structure is similar. Second, the upper boundary of the thermal adjustment layer is close to the peak of the magnitude of the temperature perturbation. Third, the P\'eclet number at the upper boundary of the turbulent dissipation layer is close to 1. In addition, we have studied the scalings of the overshooting distance on the relative stability parameter $S$, the Prandtl number $\rm Pr$, and the P\'eclet number $\rm Pe$. The scaling on $S$ is not unique. The trend is that the overshooting distance decreases with $S$. Fitting on $\rm Pr$ shows that the overshooting distance increases with $\rm Pr$. Fitting on $\rm Pe$ shows that the overshooting distance decreases with $\rm Pe$. Finally, we calculate the ratio of the thickness of the turbulent dissipation layer to that of the thermal adjustment layer. The ratio remains almost constant, with an approximate value of 2.4.


title: The Overlap Gap Property and Approximate Message Passing Algorithms for $p$-spin models

abstract: We consider the algorithmic problem of finding a near ground state (near optimal solution) of a $p$-spin model. We show that for a class of algorithms broadly defined as Approximate Message Passing (AMP), the presence of the Overlap Gap Property (OGP), appropriately defined, is a barrier. We conjecture that when $p\ge 4$ the model does indeed exhibits OGP (and prove it for the space of binary solutions). Assuming the validity of this conjecture, as an implication, the AMP fails to find near ground states in these models, per our result. We extend our result to the problem of finding pure states by means of Thouless, Anderson and Palmer (TAP) based iterations, which is yet another example of AMP type algorithms. We show that such iterations fail to find pure states approximately, subject to the conjecture that the space of pure states exhibits the OGP, appropriately stated, when $p\ge 4$.

categories: math.PR cond-mat.stat-mech math-ph math.MP


title: $DC^2$: A Divide-and-conquer Algorithm for Large-scale Kernel Learning with Application to Clustering

abstract: Divide-and-conquer is a general strategy to deal with large scale problems. It is typically applied to generate ensemble instances, which potentially limits the problem size it can handle. Additionally, the data are often divided by random sampling which may be suboptimal. To address these concerns, we propose the $DC^2$ algorithm. Instead of ensemble instances, we produce structure-preserving signature pieces to be assembled and conquered. $DC^2$ achieves the efficiency of sampling-based large scale kernel methods while enabling parallel multicore or clustered computation. The data partition and subsequent compression are unified by recursive random projections. Empirically dividing the data by random projections induces smaller mean squared approximation errors than conventional random sampling. The power of $DC^2$ is demonstrated by our clustering algorithm $rpfCluster^+$, which is as accurate as some fastest approximate spectral clustering algorithms while maintaining a running time close to that of K-means clustering. Analysis on $DC^2$ when applied to spectral clustering shows that the loss in clustering accuracy due to data division and reduction is upper bounded by the data approximation error which would vanish with recursive random projections. Due to its easy implementation and flexibility, we expect $DC^2$ to be applicable to general large scale learning problems.


title: On the rapid orbital expansion in the compact low-mass X-ray binary 2A 1822$-$371

abstract: The neutron star low-mass X-ray binary 2A 1822$-$371 has an orbital period of 5.57 hr. Mass transfer in such short-period binaries is thought to be driven by magnetic braking with orbital shrinking. However, 2A 1822$-$371 shows a very rapid orbital expansion, implying that mass transfer occurs rapidly in this system. The accretion rate of the neutron star is observationally estimated to be higher than the Eddington limit, which is also hard to be explained by the standard magnetic braking mechanism. In this work, we construct a model to account for the peculiar properties of 2A 1822$-$371. We assume that the donor star possesses a relatively strong magnetic field, which is coupled with the stellar winds excited by the X-ray radiation from the neutron star. This would generate efficient angular momentum loss, leading to a high mass transfer rate and hence orbital expansion. We provide possible evolutionary tracks of 2A 1822$-$371 and study how the input parameters affect the results. The observational implications of the irradiation-driven mass loss are also briefly discussed in the context of evolution of low-mass X-ray binaries and millisecond pulsars.


title: Indoor microbiome, environmental characteristics and asthma among junior high school students in Johor Bahru, Malaysia

abstract: Indoor microbial diversity and composition are suggested to affect the prevalence and severity of asthma. In this study, we collected floor dust and environmental characteristics from 21 classrooms, and health data related to asthma symptoms from 309 students, in junior high schools in Johor Bahru, Malaysia. Bacterial and fungal composition was characterized by sequencing 16s rRNA gene and internal transcribed spacer (ITS) region, and the absolute microbial concentration was quantified by qPCR. In total, 326 bacterial and 255 fungal genera were characterized. Five bacterial (Sphingobium, Rhodomicrobium, Shimwellia, Solirubrobacter, Pleurocapsa) and two fungal (Torulaspora and Leptosphaeriaceae) taxa were protective for asthma severity. Two bacterial taxa, Izhakiella and Robinsoniella, were positively associated with asthma severity. Several protective bacterial taxa including Rhodomicrobium, Shimwellia and Sphingobium has been reported as protective microbes in previous studies, whereas other taxa were first time reported. Environmental characteristics, such as age of building, size of textile curtain per room volume, occurrence of cockroaches, concentration of house dust mite allergens transferred from homes by the occupants, were involved in shaping the overall microbial community but not asthma-associated taxa; whereas visible dampness and mold, which did not change the overall microbial community for floor dust, decreased the concentration of protective bacteria Rhodomicrobium (\b{eta}=-2.86, p=0.021) of asthma, indicating complex interactions between microbes, environmental characteristics and asthma symptoms. Overall, this is the first indoor microbiome study to characterize the asthma-associated microbes and their environmental determinant in tropical area, promoting the understanding of microbial exposure and respiratory health in this region.


title: Design of the First Insect-scale Spinning-wing Robot

abstract: Here we present the design of an insect-scale microrobot that generates lift by spinning its wings. This is in contrast to most other microrobot designs at this size scale which rely on flapping wings to produce lift. The robot has a wing span of 4 centimeters and weighs 133 milligrams. It spins its wings at 47 revolutions/second generating $>$ 138 milligrams of lift while consuming approximately 60 milliwatts of total power and operating at a low voltage ($<$ 3 V). Of the total power consumed 8.8 milliwatts is mechanical power generated, part of which goes towards spinning the wings, and 51 milliwatts is wasted in resistive Joule heating. With a lift-to-power ratio of 2.3 grams/W, its performance is at par with the best reported flapping wing devices at the insect-scale.


title: Robust Reading Comprehension with Linguistic Constraints via Posterior Regularization

abstract: In spite of great advancements of machine reading comprehension (RC), existing RC models are still vulnerable and not robust to different types of adversarial examples. Neural models over-confidently predict wrong answers to semantic different adversarial examples, while over-sensitively predict wrong answers to semantic equivalent adversarial examples. Existing methods which improve the robustness of such neural models merely mitigate one of the two issues but ignore the other. In this paper, we address the over-confidence issue and the over-sensitivity issue existing in current RC models simultaneously with the help of external linguistic knowledge. We first incorporate external knowledge to impose different linguistic constraints (entity constraint, lexical constraint, and predicate constraint), and then regularize RC models through posterior regularization. Linguistic constraints induce more reasonable predictions for both semantic different and semantic equivalent adversarial examples, and posterior regularization provides an effective mechanism to incorporate these constraints. Our method can be applied to any existing neural RC models including state-of-the-art BERT models. Extensive experiments show that our method remarkably improves the robustness of base RC models, and is better to cope with these two issues simultaneously.


title: Distributed Machine Learning through Heterogeneous Edge Systems

abstract: Many emerging AI applications request distributed machine learning (ML) among edge systems (e.g., IoT devices and PCs at the edge of the Internet), where data cannot be uploaded to a central venue for model training, due to their large volumes and/or security/privacy concerns. Edge devices are intrinsically heterogeneous in computing capacity, posing significant challenges to parameter synchronization for parallel training with the parameter server (PS) architecture. This paper proposes ADSP, a parameter synchronization scheme for distributed machine learning (ML) with heterogeneous edge systems. Eliminating the significant waiting time occurring with existing parameter synchronization models, the core idea of ADSP is to let faster edge devices continue training, while committing their model updates at strategically decided intervals. We design algorithms that decide time points for each worker to commit its model update, and ensure not only global model convergence but also faster convergence. Our testbed implementation and experiments show that ADSP outperforms existing parameter synchronization models significantly in terms of ML model convergence time, scalability and adaptability to large heterogeneity.


title: Highly Sensitive and Label-free Digital Detection of Whole Cell E. coli with Interferometric Reflectance Imaging

abstract: Bacterial infectious diseases are a major threat to human health. Timely and sensitive pathogenic bacteria detection is crucial in identifying the bacterial contaminations and preventing the spread of infectious diseases. Due to limitations of conventional bacteria detection techniques there have been concerted research efforts towards development of new biosensors. Biosensors offering label free, whole bacteria detection are highly desirable over those relying on label based or pathogenic molecular components detection. The major advantage is eliminating the additional time and cost required for labeling or extracting the desired bacterial components. Here, we demonstrate rapid, sensitive and label free E. coli detection utilizing interferometric reflectance imaging enhancement allowing for visualizing individual pathogens captured on the surface. Enabled by our ability to count individual bacteria on a large sensor surface, we demonstrate a limit of detection of 2.2 CFU/ml from a buffer solution with no sample preparation. To the best of our knowledge, this high level of sensitivity for whole E. coli detection is unprecedented in label free biosensing. The specificity of our biosensor is validated by comparing the response to target bacteria E. coli and non target bacteria S. aureus, K. pneumonia and P. aeruginosa. The biosensor performance in tap water also proves that its detection capability is unaffected by the sample complexity. Furthermore, our sensor platform provides high optical magnification imaging and thus validation of recorded detection events as the target bacteria based on morphological characterization. Therefore, our sensitive and label free detection method offers new perspectives for direct bacterial detection in real matrices and clinical samples.


title: Memory-Efficient Performance Monitoring on Programmable Switches with Lean Algorithms

abstract: Network performance problems are notoriously difficult to diagnose. Prior profiling systems collect performance statistics by keeping information about each network flow, but maintaining per-flow state is not scalable on resource-constrained NIC and switch hardware. Instead, we propose sketch-based performance monitoring using memory that is sublinear in the number of flows. Existing sketches estimate flow monitoring metrics based on flow sizes. In contrast, performance monitoring typically requires combining information across pairs of packets, such as matching a data packet with its acknowledgment to compute a round-trip time. We define a new class of \emph{lean} algorithms that use memory sublinear in both the size of input data and the number of flows. We then introduce lean algorithms for a set of important statistics, such as identifying flows with high latency, loss, out-of-order, or retransmitted packets. We implement prototypes of our lean algorithms on a commodity programmable switch using the P4 language. Our experiments show that lean algorithms detect $\sim$82\% of top 100 problematic flows among real-world packet traces using just 40KB memory.


title: The landscape of Saturn's internal magnetic field from the Cassini Grand Finale

abstract: The Cassini mission entered the Grand Finale phase in April 2017 and executed 22.5 highly inclined, close-in orbits around Saturn before diving into the planet on September 15th 2017. Here we present our analysis of the Cassini Grand Finale magnetometer (MAG) dataset, focusing on Saturn's internal magnetic field. These measurements demonstrate that Saturn's internal magnetic field is exceptionally axisymmetric, with a dipole tilt less than 0.007 degrees (25.2 arcsecs). Saturn's magnetic equator was directly measured to be shifted northward by ~ 0.0468 +/- 0.00043 (1-sigma) $R_S$, 2820 +/- 26 km, at cylindrical radial distances between 1.034 and 1.069 $R_S$ from the spin-axis. Although almost perfectly axisymmetric, Saturn's internal magnetic field exhibits features on many characteristic length scales in the latitudinal direction. Examining Br at the a=0.75 $R_S$, c=0.6993 $R_S$ isobaric surface, the degrees 4 to 11 contributions correspond to latitudinally banded magnetic perturbations with characteristic width similar to that of the off-equatorial zonal jets observed in the atmosphere of Saturn. Saturn's internal magnetic field beyond 60 degrees latitude, in particular the small-scale features, are less well constrained by the available measurements, mainly due to incomplete spatial coverage in the polar region. A stably stratified layer thicker than 2500 km likely exists above Saturn's deep dynamo to filter out the non-axisymmetric internal magnetic field. A heat transport mechanism other than pure conduction, e.g. double diffusive convection, must be operating within this layer to be compatible with Saturn's observed luminosity. The latitudinally banded magnetic perturbations likely arise from a shallow secondary dynamo action with latitudinally banded differential rotation in the semi-conducting layer.


title: Dynamic Instance Normalization for Arbitrary Style Transfer

abstract: Prior normalization methods rely on affine transformations to produce arbitrary image style transfers, of which the parameters are computed in a pre-defined way. Such manually-defined nature eventually results in the high-cost and shared encoders for both style and content encoding, making style transfer systems cumbersome to be deployed in resource-constrained environments like on the mobile-terminal side. In this paper, we propose a new and generalized normalization module, termed as Dynamic Instance Normalization (DIN), that allows for flexible and more efficient arbitrary style transfers. Comprising an instance normalization and a dynamic convolution, DIN encodes a style image into learnable convolution parameters, upon which the content image is stylized. Unlike conventional methods that use shared complex encoders to encode content and style, the proposed DIN introduces a sophisticated style encoder, yet comes with a compact and lightweight content encoder for fast inference. Experimental results demonstrate that the proposed approach yields very encouraging results on challenging style patterns and, to our best knowledge, for the first time enables an arbitrary style transfer using MobileNet-based lightweight architecture, leading to a reduction factor of more than twenty in computational cost as compared to existing approaches. Furthermore, the proposed DIN provides flexible support for state-of-the-art convolutional operations, and thus triggers novel functionalities, such as uniform-stroke placement for non-natural images and automatic spatial-stroke control.


title: Longitudinal structure function from the parton parameterization

abstract: We present a set of formulas to extract the longitudinal structure function from the proton structure function and its derivatives with respect to lnQ2 in the next-to-next-to-leading order of the perturbative theory at low x based on a hard poemron exchange. The behavior of the DIS cross section ratio R(x;Q2) and the ratio FL(x;Q2)=F2(x;Q2) studied and compared with the experimental data, also these behaviors controlled by the color dipole model bound. These results show a good agreement with the DIS experimental data throughout the low values of x. These results within the next-to-next-to-leading order approximation at very low x can be applied in the LHeC region for analyses of ultra-high energy processes.


title: Marginal and Interactive Feature Screening of Ultra-high Dimensional Feature Spaces with Multivariate Response

abstract: When the number of features exponentially outnumbers the number of samples, feature screening plays a pivotal role in reducing the dimension of the feature space and developing models based on such data. While most extant feature screening approaches are only applicable to data having univariate response, we propose a new method (GenCorr) that admits a multivariate response. Such an approach allows us to more appropriately model multiple responses as a single unit, rather than as unrelated entities, which avails more robust analyses in relation to complex traits embedded in the covariance structure of multiple responses. The GenCorr framework allows for the screening of both marginal as well as interactive features. It is demonstrated that GenCorr possesses the desirable property of strong sure screening. In the marginal case, we examine the superior numerical performance of GenCorr in comparison to two current methods for multivariate marginal screening via an assortment of empirical simulations. We also present several simulations inspecting GenCorr's performance in multivariate interaction screening. A culminating real data analysis demonstrates the performance of our method on GWAS data.


title: On Space-spectrum Uncertainty Analysis for Coded Aperture Systems

abstract: We introduce and analyze the concept of space-spectrum uncertainty for certain commonly-used designs for spectrally programmable cameras. Our key finding states that, it is impossible to simultaneously capture high-resolution spatial images while programming the spectrum at high resolution. This phenomenon arises due to a Fourier relationship between the aperture used for obtaining spectrum and its corresponding diffraction blur in the (spatial) image. We show that the product of spatial and spectral standard deviations is lower bounded by {\lambda}/4{\pi}{\nu_0} femto square-meters, where {\nu_0} is the density of groves in the diffraction grating and {\lambda} is the wavelength of light. Experiments with a lab prototype for simultaneously measuring spectrum and image validate our findings and its implication for spectral filtering.


title: An Induced Multi-Relational Framework for Answer Selection in Community Question Answer Platforms

abstract: This paper addresses the question of identifying the best candidate answer to a question on Community Question Answer (CQA) forums. The problem is important because Individuals often visit CQA forums to seek answers to nuanced questions. We develop a novel induced relational graph convolutional network (IR-GCN) framework to address the question. We make three contributions. First, we introduce a modular framework that separates the construction of the graph with the label selection mechanism. We use equivalence relations to induce a graph comprising cliques and identify two label assignment mechanisms---label contrast, label sharing. Then, we show how to encode these assignment mechanisms in GCNs. Second, we show that encoding contrast creates discriminative magnification---enhancing the separation between nodes in the embedding space. Third, we show a surprising result---boosting techniques improve learning over familiar stacking, fusion, or aggregation approaches for neural architectures. We show strong results over the state-of-the-art neural baselines in extensive experiments on 50 StackExchange communities.


title: Regularized Weighted Low Rank Approximation

abstract: The classical low rank approximation problem is to find a rank $k$ matrix $UV$ (where $U$ has $k$ columns and $V$ has $k$ rows) that minimizes the Frobenius norm of $A - UV$. Although this problem can be solved efficiently, we study an NP-hard variant of this problem that involves weights and regularization. A previous paper of [Razenshteyn et al. '16] derived a polynomial time algorithm for weighted low rank approximation with constant rank. We derive provably sharper guarantees for the regularized version by obtaining parameterized complexity bounds in terms of the statistical dimension rather than the rank, allowing for a rank-independent runtime that can be significantly faster. Our improvement comes from applying sharper matrix concentration bounds, using a novel conditioning technique, and proving structural theorems for regularized low rank problems.


title: Learning Behavioral Representations from Wearable Sensors

abstract: Continuous collection of physiological data from wearable sensors enables temporal characterization of individual behaviors. Understanding the relation between an individual's behavioral patterns and psychological states can help identify strategies to improve quality of life. One challenge in analyzing physiological data is extracting the underlying behavioral states from the temporal sensor signals and interpreting them. Here, we use a non-parametric Bayesian approach to model sensor data from multiple people and discover the dynamic behaviors they share. We apply this method to data collected from sensors worn by a population of hospital workers and show that the learned states can cluster participants into meaningful groups and better predict their cognitive and psychological states. This method offers a way to learn interpretable compact behavioral representations from multivariate sensor signals.


title: A linearly implicit structure-preserving scheme for the fractional sine-Gordon equation based on the IEQ approach

abstract: This paper aims to develop a linearly implicit structure-preserving numerical scheme for the space fractional sine-Gordon equation, which is based on the newly developed invariant energy quadratization method. First, we reformulate the equation as a canonical Hamiltonian system by virtue of the variational derivative of the functional with fractional Laplacian. Then, we utilize the fractional centered difference formula to discrete the equivalent system derived by the invariant energy quadratization method in space direction, and obtain a conservative semi-discrete scheme. Subsequently, the linearly implicit structure-preserving method is applied for the resulting semi-discrete system to arrive at a fully-discrete conservative scheme. The stability, solvability and convergence in the maximum norm of the numerical scheme are given. Furthermore, a fast algorithm based on the fast Fourier transformation technique is used to reduce the computational complexity in practical computation. Finally, numerical examples are provided to confirm our theoretical analysis results.


title: Towards Automated Sexual Violence Report Tracking

abstract: Tracking sexual violence is a challenging task. In this paper, we present a supervised learning-based automated sexual violence report tracking model that is more scalable, and reliable than its crowdsource based counterparts. We define the sexual violence report tracking problem by considering victim, perpetrator contexts and the nature of the violence. We find that our model could identify sexual violence reports with a precision and recall of 80.4% and 83.4%, respectively. Moreover, we also applied the model during and after the \#MeToo movement. Several interesting findings are discovered which are not easily identifiable from a shallow analysis.


title: Inductive Relation Prediction by Subgraph Reasoning

abstract: The dominant paradigm for relation prediction in knowledge graphs involves learning and operating on latent representations (i.e., embeddings) of entities and relations. However, these embedding-based methods do not explicitly capture the compositional logical rules underlying the knowledge graph, and they are limited to the transductive setting, where the full set of entities must be known during training. Here, we propose a graph neural network based relation prediction framework, GraIL, that reasons over local subgraph structures and has a strong inductive bias to learn entity-independent relational semantics. Unlike embedding-based models, GraIL is naturally inductive and can generalize to unseen entities and graphs after training. We provide theoretical proof and strong empirical evidence that GraIL can represent a useful subset of first-order logic and show that GraIL outperforms existing rule-induction baselines in the inductive setting. We also demonstrate significant gains obtained by ensembling GraIL with various knowledge graph embedding methods in the transductive setting, highlighting the complementary inductive bias of our method.


title: Optimal Storage Control for Dynamic Pricing

abstract: Renewable energy brings huge uncertainties to the power system, which challenges the traditional power system operation with limited flexible resources. One promising solution is to introduce dynamic pricing to more consumers, which, if designed properly, could enable an active demand side. To further exploit flexibility, in this work, we seek to advice the consumers an optimal online control policy to utilize their storage devices facing dynamic pricing. Towards designing a more adaptive control policy, we devise a data-driven approach to estimating the price distribution. Simulation studies verify the optimality of our proposed schemes.


title: Learning Autocomplete Systems as a Communication Game

abstract: We study textual autocomplete---the task of predicting a full sentence from a partial sentence---as a human-machine communication game. Specifically, we consider three competing goals for effective communication: use as few tokens as possible (efficiency), transmit sentences faithfully (accuracy), and be learnable to humans (interpretability). We propose an unsupervised approach which tackles all three desiderata by constraining the communication scheme to keywords extracted from a source sentence for interpretability and optimizing the efficiency-accuracy tradeoff. Our experiments show that this approach results in an autocomplete system that is 52% more accurate at a given efficiency level compared to baselines, is robust to user variations, and saves time by nearly 50% compared to typing full sentences.


title: An "outside the box" solution for imbalanced data classification

abstract: A common problem of the real-world data sets is the class imbalance, which can significantly affect the classification abilities of classifiers. Numerous methods have been proposed to cope with this problem; however, even state-of-the-art methods offer a limited improvement (if any) for data sets with critically under-represented minority classes. For such problematic cases, an "outside the box" solution is required. Therefore, we propose a novel technique, called enrichment, which uses the information (observations) from the external data set(s). We present three approaches to implement enrichment technique: (1) selecting observations randomly, (2) iteratively choosing observations that improve the classification result, (3) adding observations that help the classifier to determine the border between classes better. We then thoroughly analyze developed solutions on ten real-world data sets to experimentally validate their usefulness. On average, our best approach improves the classification quality by 27\%, and in the best case, by outstanding 66\%. We also compare our technique with the universally applicable state-of-the-art methods. We find that our technique surpasses the existing methods performing, on average, 21\% better. The advantage is especially noticeable for the smallest data sets, for which existing methods failed, while our solutions achieved the best results. Additionally, our technique applies to both the multi-class and binary classification tasks. It can also be combined with other techniques dealing with the class imbalance problem.


title: Curious Link of Exclusive and Inclusive CPV in Charmless 3-body B+ Decays

abstract: The LHCb experiment has measured CP violation (CPV) across the Dalitz plot of charmless decays of B+ mesons to 3 charged tracks, namely in K{\pi}{\pi}, KKK, {\pi}{\pi}{\pi} and {\pi}KK final states, with strikingly large CPV that vary strongly with Dalitz variables. Identifying these processes with b -> sqq(bar), sss(bar) and b -> dqq(bar), dss(bar), where q = u, d, then the "sum rule" that requires two-loop absorptive parts by unitarity works well for inclusive b -> s CPV, but less well for inclusive b -> d case. We elucidate the situation, and argue that the 30 year old unitarity/CPT argument is valid to this day, while affirming quark-hadron duality.


title: Evaluation of the $\theta_K$ and the Mixing angle $\theta _{h_1}$

abstract: The $\theta_K$ has been re-evaluated via mass relations and latest experimental results, meanwhile, the $M_{K_{1B}}$ also be obtained. Based on the singlet-octet mixing model and quark-flavor mixing model, the $\theta_{h_1}$ has been recalculated with a modified formula, by inputting $M_{K_{1B}}$ instead of $\theta_K$. The values are calculated to be $|{\theta _K}| = {(42.6 \pm 2.2)^ \circ }$, $M_{K_{1B}} = 1333.9 \pm 4.6\ {\rm{MeV}}/c^{2}$ and $\theta _{h_1} = 29.5\pm 2.0^\circ$. Using these calculations as input, we predict that the branching fraction of $J/\psi \to \eta'(\eta)h_1(1170)$ is about one order higher than that of $J/\psi \to \eta'(\eta)h_1(1415)$, which can be measured in future experiments to test the validity of these two models.


title: Defensive Few-shot Learning

abstract: This paper investigates a new challenging problem called defensive few-shot learning in order to learn a robust few-shot model against adversarial attacks. Simply applying the existing adversarial defense methods to few-shot learning cannot effectively solve this problem. This is because the commonly assumed sample-level distribution consistency between the training and test sets can no longer be met in the few-shot setting. To address this situation, we develop a general defensive few-shot learning (DFSL) framework to answer the following two key questions: (1) how to transfer adversarial defense knowledge from one sample distribution to another? (2) how to narrow the distribution gap between clean and adversarial examples under the few-shot setting? To answer the first question, we propose an episode-based adversarial training mechanism by assuming a task-level distribution consistency to better transfer the adversarial defense knowledge. As for the second question, within each few-shot task, we design two kinds of distribution consistency criteria to narrow the distribution gap between clean and adversarial examples from the feature-wise and prediction-wise perspectives, respectively. Extensive experiments demonstrate that the proposed framework can effectively make the existing few-shot models robust against adversarial attacks. Code is available at https://github.com/WenbinLee/DefensiveFSL.git.


title: Pangolin: An Efficient and Flexible Graph Pattern Mining System on CPU and GPU

abstract: There is growing interest in graph pattern mining (GPM) problems such as motif counting. GPM systems have been developed to provide unified interfaces for programming algorithms for these problems and for running them on parallel systems. However, existing systems may take hours to mine even simple patterns in moderate-sized graphs, which significantly limits their real-world usability. We present Pangolin, a high-performance and flexible in-memory GPM framework targeting shared-memory CPUs and GPUs. Pangolin is the first GPM system that provides high-level abstractions for GPU processing. It provides a simple programming interface based on the extend-reduce-filter model, which enables users to specify application-specific knowledge for search space pruning and isomorphism test elimination. We describe novel optimizations that exploit locality, reduce memory consumption, and mitigate the overheads of dynamic memory allocation and synchronization. Evaluation on a 28-core CPU demonstrates that Pangolin outperforms existing GPM frameworks Arabesque, RStream, and Fractal by 49x, 88x, and 80x on average, respectively. Acceleration on a V100 GPU further improves performance of Pangolin by 15x on average. Compared to state-of-the-art hand-optimized GPM applications, Pangolin provides competitive performance with less programming effort.


title: Off-Policy Policy Gradient Algorithms by Constraining the State Distribution Shift

abstract: Off-policy deep reinforcement learning (RL) algorithms are incapable of learning solely from batch offline data without online interactions with the environment, due to the phenomenon known as \textit{extrapolation error}. This is often due to past data available in the replay buffer that may be quite different from the data distribution under the current policy. We argue that most off-policy learning methods fundamentally suffer from a \textit{state distribution shift} due to the mismatch between the state visitation distribution of the data collected by the behavior and target policies. This data distribution shift between current and past samples can significantly impact the performance of most modern off-policy based policy optimization algorithms. In this work, we first do a systematic analysis of state distribution mismatch in off-policy learning, and then develop a novel off-policy policy optimization method to constraint the state distribution shift. To do this, we first estimate the state distribution based on features of the state, using a density estimator and then develop a novel constrained off-policy gradient objective that minimizes the state distribution shift. Our experimental results on continuous control tasks show that minimizing this distribution mismatch can significantly improve performance in most popular practical off-policy policy gradient algorithms.


title: BSP-Net: Generating Compact Meshes via Binary Space Partitioning

abstract: Polygonal meshes are ubiquitous in the digital 3D domain, yet they have only played a minor role in the deep learning revolution. Leading methods for learning generative models of shapes rely on implicit functions, and generate meshes only after expensive iso-surfacing routines. To overcome these challenges, we are inspired by a classical spatial data structure from computer graphics, Binary Space Partitioning (BSP), to facilitate 3D learning. The core ingredient of BSP is an operation for recursive subdivision of space to obtain convex sets. By exploiting this property, we devise BSP-Net, a network that learns to represent a 3D shape via convex decomposition. Importantly, BSP-Net is unsupervised since no convex shape decompositions are needed for training. The network is trained to reconstruct a shape using a set of convexes obtained from a BSP-tree built on a set of planes. The convexes inferred by BSP-Net can be easily extracted to form a polygon mesh, without any need for iso-surfacing. The generated meshes are compact (i.e., low-poly) and well suited to represent sharp geometry; they are guaranteed to be watertight and can be easily parameterized. We also show that the reconstruction quality by BSP-Net is competitive with state-of-the-art methods while using much fewer primitives. Code is available at https://github.com/czq142857/BSP-NET-original.


title: Review and new concepts for neutron-capture measurements of astrophysical interest

abstract: The idea of slow-neutron capture nucleosynthesis formulated in 1957 triggered a tremendous experimental effort in different laboratories worldwide to measure the relevant nuclear physics input quantities, namely ($n,\gamma$) cross sections over the stellar temperature range (from few eV up to several hundred keV) for most of the isotopes involved from Fe up to Bi. A brief historical review focused on total energy detectors will be presented to illustrate how, advances in instrumentation have led, over the years, to the assessment and discovery of many new aspects of $s$-process nucleosynthesis and to the progressive refinement of theoretical models of stellar evolution. A summary will be presented on current efforts to develop new detection concepts, such as the Total-Energy Detector with $\gamma$-ray imaging capability (i-TED). The latter is based on the simultaneous combination of Compton imaging with neutron time-of-flight (TOF) techniques, in order to achieve a superior level of sensitivity and selectivity in the measurement of stellar neutron capture rates.


title: On q-ary Bent and Plateaued Functions

abstract: We obtain the following results. For any prime $q$ the minimal Hamming distance between distinct regular $q$-ary bent functions of $2n$ variables is equal to $q^n$. The number of $q$-ary regular bent functions at the distance $q^n$ from the quadratic bent function $Q_n=x_1x_2+\dots+x_{2n-1}x_{2n}$ is equal to $q^n(q^{n-1}+1)\cdots(q+1)(q-1)$ for $q>2$. The Hamming distance between distinct binary $s$-plateaued functions of $n$ variables is not less than $2^{\frac{s+n-2}{2}}$ and the Hamming distance between distinctternary $s$-plateaued functions of $n$ variables is not less than $3^{\frac{s+n-1}{2}}$. These bounds are tight. For $q=3$ we prove an upper bound on nonlinearity of ternary functions in terms of their correlation immunity. Moreover, functions reaching this bound are plateaued. For $q=2$ analogous result are well known but for large $q$ it seems impossible. Constructions and some properties of $q$-ary plateaued functions are discussed.


title: The Directed Dominating Set problem studied by cavity method: Warning propagation and population dynamics

abstract: The minimal dominating set for a digraph(directed graph)is a prototypical hard combinatorial optimization problem. In a previous paper, we studied this problem using the cavity method. Although we found a solution for a given graph that gives very good estimate of the minimal dominating size, we further developed the one step replica symmetry breaking theory to determine the ground state energy of the undirected minimal dominating set problem. The solution space for the undirected minimal dominating set problem exhibits both condensation transition and cluster transition on regular random graphs. We also developed the zero temperature survey propagation algorithm on undirected Erd\H{o}s-R\'enyi graphs to find the ground state energy. In this paper we continue to develop the one step replica symmetry breaking theory to find the ground state energy for the directed minimal dominating set problem. We find the following. (1)The warning propagation equation can not converge when the connectivity is greater than the core percolation threshold value of 3.704. Positive edges have two types warning, but the negative edges have one. (2)We determine the ground state energy and the transition point of the Erd\H{o}s-R\'enyi random graph. (3)The survey propagation decimation algorithm has good results comparable with the belief propagation decimation algorithm. Keywords: directed minimal dominating set , replica symmetry breaking, Erd\H{o}s-R\'enyi graph, warning propagation, survey propagation decimation.


title: Long Range 3D with Quadocular Thermal (LWIR) Camera

abstract: Long Wave Infrared (LWIR) cameras provide images regardles of the ambient illumination, they tolerate fog and are not blinded by the incoming car headlights. These features make LWIR cameras attractive for autonomous navigation, security and military applications. Thermal images can be used similarly to the visible range ones, including 3D scene reconstruction with two or more such cameras mounted on a rigid frame. There are two additional challenges for this spectral range: lower image resolution and lower contrast of the textures. In this work, we demonstrate quadocular LWIR camera setup, calibration, image capturing and processing that result in long range 3D perception with 0.077 pix disparity error over 90% of the depth map. With low resolution (160 x 120) LWIR sensors we achieved 10% range accuracy at 28 m with 56 degrees horizontal field of view (HFoV) and 150 mm baseline. Scaled to the now-standard 640 x 512 resolution and 200 mm baseline suitable for head-mounted application the result would be 10% accuracy at 130 m.


title: Bonding in light-induced vortices: benzene in a high-frequency circular polarized laser

abstract: The electronic structure of benzene in the presence of a high-intensity high-frequency circularly polarized laser supports a middle-of-the-ring electron localization. Here, the laser polarization coincides with the ring plane of benzene. The high-frequency oscillating electric field creates circular currents centered at each atom with a circle radius equal to the maximum field amplitude of the laser. All six carbons have six such rings. For a maximum field amplitude of 1.42 {\AA}, which is the carbon-carbon bond distance, all six dynamic current circles intersect to create a deep vortex in the middle, which supports a bound state of a pair of electrons. Such states for benzene can be realized in experiments using a circularly polarized XUV-laser in a range of intensities 10^16-10^17 W/cm^2 and frequencies 16 eV to 22 eV. Electronic dynamics calculations predict a minimal ionization of benzene when the rise-time of the laser pulse is sudden, indicating a possible experimental realization of these states characterized by a large cut-off in the harmonic generation spectra. This stable electronic structure of the light-dressed benzene is doubly-aromatic due to an extra aromaticity from a D6h symmetric circular distortion of the{\sigma}-framework while the {\pi}-electrons, with low density in the ring-plane,are least affected.


title: Isospin Dependence in Fission Fragment Yields

abstract: In the present paper, we explore the idea of isospin conservation in new situations and contexts based on the directions provided by our earlier works. We present the results of our calculations for the relative yields of neutron-rich fission fragments emitted in fast neutron-induced fission, 238U (n, fission) reaction by using the concept of the conservation of isospin and compare with the experimental data. Our results successfully reproduced the gross features of partition wise fission fragments distribution of 238U (n, fission). This confirms that in all kinds of fission, isospin remains pure in neutron-rich systems even at high excitations. Thus, isospin can be proven as an important quantum number for the prediction of fission fragment distribution.


title: Grounding Human-to-Vehicle Advice for Self-driving Vehicles

abstract: Recent success suggests that deep neural control networks are likely to be a key component of self-driving vehicles. These networks are trained on large datasets to imitate human actions, but they lack semantic understanding of image contents. This makes them brittle and potentially unsafe in situations that do not match training data. Here, we propose to address this issue by augmenting training data with natural language advice from a human. Advice includes guidance about what to do and where to attend. We present the first step toward advice giving, where we train an end-to-end vehicle controller that accepts advice. The controller adapts the way it attends to the scene (visual attention) and the control (steering and speed). Attention mechanisms tie controller behavior to salient objects in the advice. We evaluate our model on a novel advisable driving dataset with manually annotated human-to-vehicle advice called Honda Research Institute-Advice Dataset (HAD). We show that taking advice improves the performance of the end-to-end network, while the network cues on a variety of visual features that are provided by advice. The dataset is available at https://usa.honda-ri.com/HAD.


title: Nonlinear dynamics in the flexible shaft rotating-lifting system of silicon crystal puller using Czochralski method

abstract: Silicon crystal puller (SCP) is a key equipment in silicon wafer manufacture, which is, in turn, the base material for the most currently used integrated circuit (IC) chips. With the development of the techniques, the demand for longer mono-silicon crystal rod with larger diameter is continuously increasing in order to reduce the manufacture time and the price of the wafer. This demand calls for larger SCP with increasing height, however, it causes serious swing phenomenon of the crystal seed. The strong swing of the seed causes difficulty in the solidification and increases the risk of mono-silicon growth failure.The main aim of this paper is to analyze the nonlinear dynamics in the FSRL system of the SCP. A mathematical model for the swing motion of the FSRL system is derived. The influence of relevant parameters, such as system damping, excitation amplitude and rotation speed, on the stability and the responses of the system are analyzed. The stability of the equilibrium, bifurcation and chaotic motion are demonstrated, which are often observed in practical situations. Melnikov method is used to derive the possible parameter region that leads to chaotic motion. Three routes to chaos are identified in the FSRL system, including period doubling, symmetry-breaking bifurcation and interior crisis. The work in this paper explains the complex dynamics in the FSRL system of the SCP, which will be helpful for the SCP designers in order to avoid the swing phenomenon in the SCP.


title: IDEALEM: Statistical Similarity Based Data Reduction

abstract: Many applications such as scientific simulation, sensing, and power grid monitoring tend to generate massive amounts of data, which should be compressed first prior to storage and transmission. These data, mostly comprised of floating-point values, are known to be difficult to compress using lossless compression. A few compression methods based on lossy compression have been proposed to compress this seemingly incompressible data. Unfortunately, they are all designed to minimize the Euclidean distance between the original data and the decompressed data, which fundamentally limits compression performance. We recently proposed a new class of lossy compression based on statistical similarity, called IDEALEM, which was also provided as a software package. IDEALEM has demonstrated its performance by reducing data volume much more than state-of-the-art compression methods while preserving unique patterns of data. IDEALEM can operate in two different modes depending on the stationarity of input data. This paper presents compression performance analyses of these two modes, and investigates the difference between two transform techniques targeted for non-stationary data. This paper also discusses the data reconstruction quality of IDEALEM using spectral analysis and shows that important frequency components in application domain are well preserved. We expand the capability of IDEALEM by adding a new min/max check that facilitates preserving significant patterns lasting only for a brief duration which were previously hard to capture. This min/max check also accelerates the encoding process significantly. Experiments show IDEALEM preserves significant patterns in the original data with faster encoding time.


title: Parametric Graph-based Separable Transforms for Video Coding

abstract: In many video coding systems, separable transforms (such as two-dimensional DCT-2) have been used to code block residual signals obtained after prediction. This paper proposes a parametric approach to build graph-based separable transforms (GBSTs) for video coding. Specifically, a GBST is derived from a pair of line graphs, whose weights are determined based on two non-negative parameters. As certain choices of those parameters correspond to the discrete sine and cosine transform types used in recent video coding standards (including DCT-2, DST-7 and DCT-8), this paper further optimizes these graph parameters to better capture residual block statistics and improve video coding efficiency. The proposed GBSTs are tested on the Versatile Video Coding (VVC) reference software, and the experimental results show that about 0.4% average coding gain is achieved over the existing set of separable transforms constructed based on DCT-2, DST-7 and DCT-8 in VVC.


title: VLUC: An Empirical Benchmark for Video-Like Urban Computing on Citywide Crowd and Traffic Prediction

abstract: Nowadays, massive urban human mobility data are being generated from mobile phones, car navigation systems, and traffic sensors. Predicting the density and flow of the crowd or traffic at a citywide level becomes possible by using the big data and cutting-edge AI technologies. It has been a very significant research topic with high social impact, which can be widely applied to emergency management, traffic regulation, and urban planning. In particular, by meshing a large urban area to a number of fine-grained mesh-grids, citywide crowd and traffic information in a continuous time period can be represented like a video, where each timestamp can be seen as one video frame. Based on this idea, a series of methods have been proposed to address video-like prediction for citywide crowd and traffic. In this study, we publish a new aggregated human mobility dataset generated from a real-world smartphone application and build a standard benchmark for such kind of video-like urban computing with this new dataset and the existing open datasets. We first comprehensively review the state-of-the-art works of literature and formulate the density and in-out flow prediction problem, then conduct a thorough performance assessment for those methods. With this benchmark, we hope researchers can easily follow up and quickly launch a new solution on this topic.


title: Capacitorless Model of a VO2 Oscillator

abstract: We implement a capacitorless model of a VO2 oscillator by introducing into the circuit of a field-effect transistor and a VO2 thermal sensor, which provide negative current feedback with a time delay. We compare the dynamics of current and voltage oscillations on a switch in a circuit with a capacitor and without a capacitor. The oscillation period in the capacitorless model is controlled in a narrow range by changing the distance between the switch and the sensor. The capacitorless model provides the possibility of significant miniaturization of the oscillator circuit, and it is important for the implementation of large arrays of oscillators in oscillatory neural networks to solve the problem of classification and pattern recognition.


title: Post- versus pre-resonance characteristics of axially excited chiral sculptured thin films

abstract: Axially excited chiral sculptured thin films (STFs) are shown to exhibit the circular Bragg phenomenon in the pre-resonant (long-wavelength) regime but not in some parts of the post-resonant (short-wavelength) regime. Chiral STFs act as very good polarization-independent reflectors in the vicinity of material resonances in the latter regime.


title: Constructing the Bijective and the Extended Burrows-Wheeler Transform in Linear Time

abstract: The Burrows-Wheeler transform (BWT) is a permutation whose applications are prevalent in data compression and text indexing. The bijective BWT (BBWT) is a bijective variant of it. Although it is known that the BWT can be constructed in linear time for integer alphabets by using a linear time suffix array construction algorithm, it was up to now only conjectured that the BBWT can also be constructed in linear time. We confirm this conjecture by proposing a construction algorithm that is based on SAIS, improving the best known result of $O(n \lg n /\lg \lg n)$ time to linear.


title: On Hilfer fractional difference operator

abstract: In this article, a new definition of fractional Hilfer difference operator is introduced. Definition based properties are developed and utilized to construct fixed point operator for fractional order Hilfer difference equations with initial condition. We acquire some conditions for existence, uniqueness, Ulam-Hyers and Ulam-Hyers-Rassias stability. Modified Gronwall's inequality is presented for discrete calculus with the delta difference operator.


title: Faster AutoAugment: Learning Augmentation Strategies using Backpropagation

abstract: Data augmentation methods are indispensable heuristics to boost the performance of deep neural networks, especially in image recognition tasks. Recently, several studies have shown that augmentation strategies found by search algorithms outperform hand-made strategies. Such methods employ black-box search algorithms over image transformations with continuous or discrete parameters and require a long time to obtain better strategies. In this paper, we propose a differentiable policy search pipeline for data augmentation, which is much faster than previous methods. We introduce approximate gradients for several transformation operations with discrete parameters as well as the differentiable mechanism for selecting operations. As the objective of training, we minimize the distance between the distributions of augmented data and the original data, which can be differentiated. We show that our method, Faster AutoAugment, achieves significantly faster searching than prior work without a performance drop.


title: Exact charged black hole solutions in D-dimensions in f(R) gravity

abstract: We consider Maxwell-f(R) gravity and obtain an exact charged black hole solution with dynamic curvature in D-dimensions. Considering a spherically symmetric metric ansatz and without specifying the form of f(R) we fnd a general black hole solution in D-dimensions. This general black hole solution can be reduced to the Reissner-Nordstr\"om (RN) black hole in D-dimensions in Einstein gravity and to the known charged black hole solutions with constant curvature in f(R) gravity. Restricting the parameters of the general solution we get polynomial solutions which reveal novel properties when compared to RN black holes. Specifcally we study the solution in (3 + 1)-dimensions in which the form of f(R) can be solved explicitly giving a dynamic curvature and compare it with the RN black hole. We also carry out a detailed study of its thermodynamics.


title: Anomalous lattice thermal conductivity in layered materials MNCl (M=Zr, Hf) driven by the lanthanide contraction

abstract: High performance thermoelectric devices requires materials with low lattice thermal conductivities. Many strategies, such as phonon engineering, have been made to reduce lattice thermal conductivity without simultaneously decrease of the charge transport performance. It is a simple and effective approach to use materials with heavy element to reduce the lattice thermal conductivity. Here, based on the first-principles calculations and phonon Boltzmann transport equations, we find the replacement of Zr with heavy element Hf in ZrNCl doesn't reduce the lattice thermal conductivity, instead, it surprisingly increases by about 4 times at 300K. This unusual lattice thermal conductivity is mainly attributed to the dramatic enhancement in phonon lifetimes in Hf compound, originating from the strong interatomic bonding due to lanthanide contraction. Our findings unveil the microscopic mechanisms of high thermal transport properties in materials with heavy element, providing an alternative strategy in materials design with low lattice thermal conductivity for thermoelectric applications such as power restoration and generation.


title: Cosmology of the non-local Proca theory

abstract: In this paper, we will consider cosmological implications of the Maxwell theory coupled to a non-local $U(1)$-symmetric term. It is well-known that the theory in flat space time, reduces to the Proca theory. However, it will be shown that in curved space time the resulting theory will differ from the coupled Einstein-Proca system. The cosmological perturbations on top of the de Sitter space-time is also considered and the dynamics of separate modes will be investigated in detail. Anisotropic cosmology of the model is also investigated and we will show that the behavior of the universe at late time satisfies the observational data and the model predicts an isotropic universe.


title: Noise and disorder effects in a series of birhythmic Josephson junctions coupled to a resonator

abstract: This paper deal the effects of uncorrelated white noise, in a serie of Josephson Junctions coupled to a linear $RLC$ resonator. The junction are hysteretic, and hence can be considered birhythmic, that is capable to oscillate at different frequencies for the same set of parameters. Both Josephson Junctions with identical and disordered parameters are considered. With the uniform parameters, the array behaves similarly to single Josephson junctions, also in the presence of noise. The magnitude of the effective energy that characterizes the response to noise becomes smaller as the number of elements of the array increases, making the resonator less stable. Disorder in the parameters drastically changes the physics of the array. The disordered array of Josephson junctions misses the birhythmicity properties for large values of the variance of the disorder parameter. Nevertheless, the system remains birhythmic for low values of the disorder parameter. Finally, disorder makes it difficult to locate the separatrix, hinting to a more complex structure of the effective energy landscape.


title: Learning Efficient Multi-agent Communication: An Information Bottleneck Approach

abstract: We consider the problem of the limited-bandwidth communication for multi-agent reinforcement learning, where agents cooperate with the assistance of a communication protocol and a scheduler. The protocol and scheduler jointly determine which agent is communicating what message and to whom. Under the limited bandwidth constraint, a communication protocol is required to generate informative messages. Meanwhile, an unnecessary communication connection should not be established because it occupies limited resources in vain. In this paper, we develop an Informative Multi-Agent Communication (IMAC) method to learn efficient communication protocols as well as scheduling. First, from the perspective of communication theory, we prove that the limited bandwidth constraint requires low-entropy messages throughout the transmission. Then inspired by the information bottleneck principle, we learn a valuable and compact communication protocol and a weight-based scheduler. To demonstrate the efficiency of our method, we conduct extensive experiments in various cooperative and competitive multi-agent tasks with different numbers of agents and different bandwidths. We show that IMAC converges faster and leads to efficient communication among agents under the limited bandwidth as compared to many baseline methods.


title: Automatic Design of CNNs via Differentiable Neural Architecture Search for PolSAR Image Classification

abstract: Convolutional neural networks (CNNs) have shown good performance in polarimetric synthetic aperture radar (PolSAR) image classification due to the automation of feature engineering. Excellent hand-crafted architectures of CNNs incorporated the wisdom of human experts, which is an important reason for CNN's success. However, the design of the architectures is a difficult problem, which needs a lot of professional knowledge as well as computational resources. Moreover, the architecture designed by hand might be suboptimal, because it is only one of thousands of unobserved but objective existed paths. Considering that the success of deep learning is largely due to its automation of the feature engineering process, how to design automatic architecture searching methods to replace the hand-crafted ones is an interesting topic. In this paper, we explore the application of neural architecture search (NAS) in PolSAR area for the first time. Different from the utilization of existing NAS methods, we propose a differentiable architecture search (DAS) method which is customized for PolSAR classification. The proposed DAS is equipped with a PolSAR tailored search space and an improved one-shot search strategy. By DAS, the weights parameters and architecture parameters (corresponds to the hyperparameters but not the topologies) can be optimized by stochastic gradient descent method during the training. The optimized architecture parameters should be transformed into corresponding CNN architecture and re-train to achieve high-precision PolSAR classification. In addition, complex-valued DAS is developed to take into account the characteristics of PolSAR images so as to further improve the performance. Experiments on three PolSAR benchmark datasets show that the CNNs obtained by searching have better classification performance than the hand-crafted ones.


title: Regions of Interest Segmentation from LiDAR Point Cloud for Multirotor Aerial Vehicles

abstract: We propose a novel filter for segmenting the regions of interest from LiDAR 3D point cloud for multirotor aerial vehicles. It is specially targeted for real-time applications and works on sparse LiDAR point clouds without preliminary mapping. We use this filter as a crucial component of fast obstacle avoidance system for agriculture drone operating at low altitude. As the first step, each point cloud is transformed into a depth image and then identify places near to the vehicle (local maxima) by locating areas with high pixel densities. Afterwards, we merge the original depth image with identified locations after maximizing intensities of pixels in which local maxima were obtained. Next step is to calculate the range angle image that represents angles between two consecutive laser beams based on the improved depth image. Once the corresponding range angle image is constructed, smoothing is applied to reduce the noise. Finally, we find out connected components within the improved depth image while incorporating smoothed range angle image. This allows separating the regions of interest. The filter has been tested on various simulated environments as well as an actual drone and provides real-time performance. We make our source code, dataset available at https://github.com/GPrathap/hagen.git and real world experiment result can be found on the following link: https://www.youtube.com/watch?v=iHd_ZkhKPjc available online.


title: Demand-Private Coded Caching and the Exact Trade-off for N=K=2

abstract: The distributed coded caching problem has been studied extensively in the recent past. While the known coded caching schemes achieve an improved transmission rate, they violate the privacy of the users since in these schemes the demand of one user is revealed to others in the delivery phase. In this paper, we consider the coded caching problem under the constraint that the demands of the other users remain information theoretically secret from each user. We first show that the memory-rate pair $(M,\min \{N,K\}(1-M/N))$ is achievable under information theoretic demand privacy, while using broadcast transmissions. We then show that a demand-private scheme for $N$ files and $K$ users can be obtained from a non-private scheme that satisfies only a restricted subset of demands of $NK$ users for $N$ files. We then focus on the demand-private coded caching problem for $K=2$ users, $N=2$ files. We characterize the exact memory-rate trade-off for this case. To show the achievability, we use our first result to construct a demand-private scheme from a non-private scheme satisfying a restricted demand subset that is known from an earlier work by Tian. Further, by giving a converse based on the extra requirement of privacy, we show that the obtained achievable region is the exact memory-rate trade-off.


title: Selective sampling for accelerating training of deep neural networks

abstract: We present a selective sampling method designed to accelerate the training of deep neural networks. To this end, we introduce a novel measurement, the minimal margin score (MMS), which measures the minimal amount of displacement an input should take until its predicted classification is switched. For multi-class linear classification, the MMS measure is a natural generalization of the margin-based selection criterion, which was thoroughly studied in the binary classification setting. In addition, the MMS measure provides an interesting insight into the progress of the training process and can be useful for designing and monitoring new training regimes. Empirically we demonstrate a substantial acceleration when training commonly used deep neural network architectures for popular image classification tasks. The efficiency of our method is compared against the standard training procedures, and against commonly used selective sampling alternatives: Hard negative mining selection, and Entropy-based selection. Finally, we demonstrate an additional speedup when we adopt a more aggressive learning drop regime while using the MMS selective sampling method.


title: Self-supervised GAN: Analysis and Improvement with Multi-class Minimax Game

abstract: Self-supervised (SS) learning is a powerful approach for representation learning using unlabeled data. Recently, it has been applied to Generative Adversarial Networks (GAN) training. Specifically, SS tasks were proposed to address the catastrophic forgetting issue in the GAN discriminator. In this work, we perform an in-depth analysis to understand how SS tasks interact with learning of generator. From the analysis, we identify issues of SS tasks which allow a severely mode-collapsed generator to excel the SS tasks. To address the issues, we propose new SS tasks based on a multi-class minimax game. The competition between our proposed SS tasks in the game encourages the generator to learn the data distribution and generate diverse samples. We provide both theoretical and empirical analysis to support that our proposed SS tasks have better convergence property. We conduct experiments to incorporate our proposed SS tasks into two different GAN baseline models. Our approach establishes state-of-the-art FID scores on CIFAR-10, CIFAR-100, STL-10, CelebA, Imagenet $32\times32$ and Stacked-MNIST datasets, outperforming existing works by considerable margins in some cases. Our unconditional GAN model approaches performance of conditional GAN without using labeled data. Our code: https://github.com/tntrung/msgan


title: Revisiting Shadow Detection: A New Benchmark Dataset for Complex World

abstract: Shadow detection in general photos is a nontrivial problem, due to the complexity of the real world. Though recent shadow detectors have already achieved remarkable performance on various benchmark data, their performance is still limited for general real-world situations. In this work, we collected shadow images for multiple scenarios and compiled a new dataset of 10,500 shadow images, each with labeled ground-truth mask, for supporting shadow detection in the complex world. Our dataset covers a rich variety of scene categories, with diverse shadow sizes, locations, contrasts, and types. Further, we comprehensively analyze the complexity of the dataset, present a fast shadow detection network with a detail enhancement module to harvest shadow details, and demonstrate the effectiveness of our method to detect shadows in general situations.


title: A spatio-temporal multi-scale model for Geyer saturation point process: application to forest fire occurrences

abstract: Because most natural phenomena exhibit dependence at multiple scales like locations of earthquakes or forest fire occurrences, spatio-temporal single-scale point process models are unrealistic in many applications. This motivates us to construct generalizations of classical Gibbs models. In this paper, we extend the Geyer saturation point process model to the spatio-temporal multi-scale framework. The simulation process is carried out through a birth-death Metropolis-Hastings algorithm. In a simulation study, we compare two common methods for statistical inference in Gibbs models: the pseudo-likelihood and logistic likelihood approaches that we tailor to this model. Finally, we illustrate this new model on forest fire occurrences modeling in Southern France.


title: Authenticated teleportation and verification in a noisy network

abstract: Authenticated teleportation aims to certify the transmission of a quantum state through teleportation, even in the presence of an adversary. This scenario can be pictured in terms of an untrusted source distributing a Bell state between two parties who wish to verify it using some simple tests. We propose a protocol that achieves this goal in a practical way, and analyse its performance and security when the parties have noisy measurement devices. Further, we model a realistic experimental scenario where the state is subject to noise and dephasing. We finally apply our analysis to the verification of graph states with noisy measurement devices.


title: \'Etude des op\'erateurs d'\'evolution en caract\'eristique 2

abstract: We are interested in the evolution operators defined on commutative and nonassociative algebras when the scalar field is of characteristic 2. We distinguish four types: nilpotent, quasi-constant, ultimately periodic and plenary train operators. They are studied and classified for non baric and for baric algebras.


title: A New Channel of Bulge Formation via The Destruction of Short Bars

abstract: Short (inner) bars of sub-kiloparsec radius have been hypothesized to be an important mechanism for driving gas inflows to small scales, thus feeding central black holes. Recent numerical simulations have shown that the growth of central black holes in galaxies can destroy short bars, when the black hole reaches a mass of $\sim 0.1\%$ of the total stellar mass of the galaxy. We study $N$-body simulations of galaxies with single and double bars to track the long-term evolution of the central stellar mass distribution. We find that the destruction of the short bar contributes significantly to the growth of the bulge. The final bulge mass is roughly equal to the sum of the masses of the initial pseudo bulge and short bar. The initially boxy/peanut-shaped bulge of S\'ersic index $n\lesssim1$ is transformed into a more massive, compact structure that bears many similarities to a classical bulge, in terms of its morphology ($n \approx 2$), kinematics (dispersion-dominated, isotropic), and location on standard scaling relations (Kormendy relation, mass-size relation, and correlations between black hole mass and bulge stellar mass and velocity dispersion). Our proposed channel for forming classical bulges relies solely on the destruction of short bars without any reliance on mergers. We suggest that some of the less massive, less compact classical bulges were formed in this manner.


title: Attaining Carnot Efficiency with Quantum and Nanoscale Heat Engines

abstract: A heat engine operating in the one-shot finite-size regime, where systems composed of a small number of quantum particles interact with hot and cold baths and are restricted to one-shot measurements, delivers fluctuating work. Further, engines with lesser fluctuation produce a lesser amount of deterministic work. Hence, the heat-to-work conversion efficiency stays well below the Carnot efficiency. Here we overcome this limitation and attain Carnot efficiency in the one-shot finite-size regime, where the engines allow the working systems to simultaneously interact with two baths via the semi-local thermal operations and reversibly operate in a one-step cycle. These engines are superior to the ones considered earlier in work extraction efficiency, and, even, are capable of converting heat into work by exclusively utilizing inter-system correlations. We formulate a resource theory for quantum heat engines to prove the results.

categories: quant-ph cond-mat.mes-hall cond-mat.stat-mech math-ph math.MP physics.atom-ph


title: AETv2: AutoEncoding Transformations for Self-Supervised Representation Learning by Minimizing Geodesic Distances in Lie Groups

abstract: Self-supervised learning by predicting transformations has demonstrated outstanding performances in both unsupervised and (semi-)supervised tasks. Among the state-of-the-art methods is the AutoEncoding Transformations (AET) by decoding transformations from the learned representations of original and transformed images. Both deterministic and probabilistic AETs rely on the Euclidean distance to measure the deviation of estimated transformations from their groundtruth counterparts. However, this assumption is questionable as a group of transformations often reside on a curved manifold rather staying in a flat Euclidean space. For this reason, we should use the geodesic to characterize how an image transform along the manifold of a transformation group, and adopt its length to measure the deviation between transformations. Particularly, we present to autoencode a Lie group of homography transformations PG(2) to learn image representations. For this, we make an estimate of the intractable Riemannian logarithm by projecting PG(2) to a subgroup of rotation transformations SO(3) that allows the closed-form expression of geodesic distances. Experiments demonstrate the proposed AETv2 model outperforms the previous version as well as the other state-of-the-art self-supervised models in multiple tasks.


title: The direct and inverse scattering problem for the semilinear Schr\"odinger equation

abstract: We study the direct and inverse scattering problem for the semilinear Schr\"{o}dinger equation $\Delta u+a(x,u)+k^2u=0$ in $\mathbb{R}^d$. We show well-posedness in the direct problem for small solutions based on the Banach fixed point theorem, and the solution has the certain asymptotic behavior at infinity. We also show the inverse problem that the semilinear function $a(x,z)$ is uniquely determined from the scattering data. The idea is certain linearization that by using sources with several parameters we differentiate the nonlinear equation with respect to these parameter in order to get the linear one.


title: Hydrogen-induced magnetism in graphene: a simple effective model description

abstract: Hydrogen adatoms induced magnetic moment on graphene has been observed in atomic scale in a recent experiment [Gonzalez-Herrero et al., Science 352, 437 (2016)]. Here, we demonstrate that all the experimental phenomena can be simply and well described by an equivalent Anderson impurity model, where the electronic correlations on both carbon and hydrogen atoms are represented by an effective on-site Coulomb interaction on hydrogen adatom $U_H$. This simple equivalent model works so well is because that the main effect of Coulomb interaction on both carbon and hydrogen atoms is just to split the impurity resonance states with different spin. This effective Anderson impurity model can also well reproduce all the behaviours of hydrogen dimer on graphene observed in experiment. We thus argue that it should be a general model to describe the hydrogen adatoms on graphene with various adsorption configurations, especially for their magnetic properties.


title: Spatiotemporal large-scale networks shaped by air mass movements

abstract: The movement of atmospheric air masses can be seen as a continuous and complex flow of particles hovering over our planet. It can however be locally simplified by considering three-dimensional trajectories of air masses connecting distant areas of the globe during a given period of time. In this paper, we present a mathematical framework to construct spatial and spatiotemporal networks where the nodes are the subsets of a partition of a geographical area and the links between these nodes are inferred from sampled trajectories of air masses passing over and across the nodes. We propose different estimators of link intensities relying on different bio-physical hypotheses and covering adjustable time periods. This approach leads to a new class of spatiotemporal networks characterized by adjacency matrices. We applied the approach in two real geographical contexts: the watersheds of the French region Provence-Alpes-C\^ote d'Azur and the coastline of the Mediterranean Sea. The analysis of the constructed networks allowed identifying a marked seasonal pattern in air mass movements in the study areas. These constructed networks can be used to investigate issues, e.g., in aerobiology and epidemiology of airborne plant pathogens. Similar networks could be estimated from other types of trajectories, such as animal trajectories.


title: First homology of a real cubic is generated by lines

abstract: We suggest a short proof of O.Benoist and O.Wittenberg theorem (arXiv:1907.10859) which states that for each real non-singular cubic hypersurface $X$ of dimension $\ge 2$ the real lines on $X$ generate the whole group $H_1(X(\Bbb R);\Bbb Z/2)$.


title: Magnon magic angles and tunable Hall conductivity in 2D twisted ferromagnetic bilayers

abstract: Twistronics is currently one of the most active research fields in condensed matter physics, following the discovery of correlated insulating and superconducting phases in twisted bilayer graphene (tBLG). Here, we present a magnonic analogue of tBLG. We study magnons in twisted ferromagnetic bilayers (tFBL), including exchange and Dzyaloshinskii-Moriya interactions (DMI). For negligible DMI, tFBL presents discrete magnon magic angles and flat moir\'e minibands analogous to tBLG. The DMI, however, changes the picture and renders the system much more exotic. The DMI in tFBL induces a rich topological magnon band structure for any twist angle. The twist angle turns to a control knob for the magnon Hall and Nernst conductivities. Gapped flat bands appear in a continuum of magic angles in tFBL with DMI. In the lower limit of the continuum, the band structure reconstructs to form bundles of topological flat bands. The luxury of twist-angle control over band gaps, topological properties, number of flat bands, Hall and Nernst conductivities renders tFBL a novel device from fundamental and applied perspectives.


title: Large $N$ behaviour of the two-dimensional Yang-Mills partition function

abstract: We compute the large N limit of the partition function of the Euclidean Yang--Mills measure with structure group SU(N) or U(N) on all closed compact surfaces, orientable or not, excepted for the sphere and the projective plane. This limit is finite as opposed to the case of the sphere and presumably the projective plane. We expect that the results we present might give an insight towards the master field on these surfaces.


title: Bollob\'as type theorems for hemi-bundled two families

abstract: Let $\{(A_i,B_i)\}_{i=1}^{m}$ be a collection of pairs of sets with $|A_i|=a$ and $|B_i|=b$ for $1\leq i\leq m$. Suppose that $A_i\cap B_j=\emptyset$ if and only if $i=j$, then by the famous Bollob\'{a}s theorem, we have the size of this collection $m\leq {a+b\choose a}$. In this paper, we consider a variant of this problem by setting $\{A_i\}_{i=1}^{m}$ to be intersecting additionally. Using exterior algebra method, we prove a weighted Bollob\'{a}s type theorem for finite dimensional real vector spaces under these constraints. As a consequence, we have a similar theorem for finite sets, which settles a recent conjecture of Gerbner et. al \cite{GKMNPTX2019}. Moreover, we also determine the unique extremal structure of $\{(A_i,B_i)\}_{i=1}^{m}$ for the primary case of the theorem for finite sets.


title: Three cooperative mechanisms required for recovery after brain damage

abstract: Stroke is one of the main causes of human disabilities. Experimental observations indicate that several mechanisms are activated during the recovery of functional activity after a stroke. Here we unveil how the brain recovers by explaining the role played by three mechanisms: Plastic adaptation, hyperexcitability and synaptogenesis. We consider two different damages in a neural network: A diffuse damage that simply causes the reduction of the effective system size and a localized damage, a stroke, that strongly alters the spontaneous activity of the system. Recovery mechanisms observed experimentally are implemented both separately and in a combined way. Interestingly, each mechanism contributes to the recovery to a limited extent. Only the combined application of all three together is able to recover the spontaneous activity of the undamaged system. This explains why the brain triggers independent mechanisms, whose cooperation is the fundamental ingredient for the system recovery.


title: Understanding and Improving Layer Normalization

abstract: Layer normalization (LayerNorm) is a technique to normalize the distributions of intermediate layers. It enables smoother gradients, faster training, and better generalization accuracy. However, it is still unclear where the effectiveness stems from. In this paper, our main contribution is to take a step further in understanding LayerNorm. Many of previous studies believe that the success of LayerNorm comes from forward normalization. Unlike them, we find that the derivatives of the mean and variance are more important than forward normalization by re-centering and re-scaling backward gradients. Furthermore, we find that the parameters of LayerNorm, including the bias and gain, increase the risk of over-fitting and do not work in most cases. Experiments show that a simple version of LayerNorm (LayerNorm-simple) without the bias and gain outperforms LayerNorm on four datasets. It obtains the state-of-the-art performance on En-Vi machine translation. To address the over-fitting problem, we propose a new normalization method, Adaptive Normalization (AdaNorm), by replacing the bias and gain with a new transformation function. Experiments show that AdaNorm demonstrates better results than LayerNorm on seven out of eight datasets.


title: What Will Your Child Look Like? DNA-Net: Age and Gender Aware Kin Face Synthesizer

abstract: Visual kinship recognition aims to identify blood relatives from facial images. Its practical application-- like in law-enforcement, video surveillance, automatic family album management, and more-- has motivated many researchers to put forth effort on the topic as of recent. In this paper, we focus on a new view of visual kinship technology: kin-based face generation. Specifically, we propose a two-stage kin-face generation model to predict the appearance of a child given a pair of parents. The first stage includes a deep generative adversarial autoencoder conditioned on ages and genders to map between facial appearance and high-level features. The second stage is our proposed DNA-Net, which serves as a transformation between the deep and genetic features based on a random selection process to fuse genes of a parent pair to form the genes of a child. We demonstrate the effectiveness of the proposed method quantitatively and qualitatively: quantitatively, pre-trained models and human subjects perform kinship verification on the generated images of children; qualitatively, we show photo-realistic face images of children that closely resemble the given pair of parents. In the end, experiments validate that the proposed model synthesizes convincing kin-faces using both subjective and objective standards.


title: Suspicion-Free Adversarial Attacks on Clustering Algorithms

abstract: Clustering algorithms are used in a large number of applications and play an important role in modern machine learning-- yet, adversarial attacks on clustering algorithms seem to be broadly overlooked unlike supervised learning. In this paper, we seek to bridge this gap by proposing a black-box adversarial attack for clustering models for linearly separable clusters. Our attack works by perturbing a single sample close to the decision boundary, which leads to the misclustering of multiple unperturbed samples, named spill-over adversarial samples. We theoretically show the existence of such adversarial samples for the K-Means clustering. Our attack is especially strong as (1) we ensure the perturbed sample is not an outlier, hence not detectable, and (2) the exact metric used for clustering is not known to the attacker. We theoretically justify that the attack can indeed be successful without the knowledge of the true metric. We conclude by providing empirical results on a number of datasets, and clustering algorithms. To the best of our knowledge, this is the first work that generates spill-over adversarial samples without the knowledge of the true metric ensuring that the perturbed sample is not an outlier, and theoretically proves the above.


title: Backward Stochastic Differential Equations with Non-Markovian Singular Terminal Conditions with General Driver and Filtration

abstract: We consider a class of Backward Stochastic Differential Equations with superlinear driver process $f$ adapted to a filtration supporting at least a $d$ dimensional Brownian motion and a Poisson random measure on ${\mathbb R}^m- \{0\}.$ We consider the following class of terminal conditions $\xi_1 = \infty \cdot 1_{\{\tau_1 \le T\}}$ where $\tau_1$ is any stopping time with a bounded density in a neighborhood of $T$ and $\xi_2 = \infty \cdot 1_{A_T}$ where $A_t$, $t \in [0,T]$ is a decreasing sequence of events adapted to the filtration ${\mathcal F}_t$ that is continuous in probability at $T$. A special case for $\xi_2$ is $A_T = \{\tau_2 > T\}$ where $\tau_2$ is any stopping time such that $P(\tau_2 =T) =0.$ In this setting we prove that the minimal supersolutions of the BSDE are in fact solutions, i.e., they attain almost surely their terminal values. We further show that the first exit time from a time varying domain of a $d$-dimensional diffusion process driven by the Brownian motion with strongly elliptic covariance matrix does have a continuous density; therefore such exit times can be used as $\tau_1$ and $\tau_2$ to define the terminal conditions $\xi_1$ and $\xi_2.$ The proof of existence of the density is based on the classical Green's functions for the associated PDE.


title: Secure Communication for Spatially Sparse Millimeter-Wave Massive MIMO Channels via Hybrid Precoding

abstract: In this paper, we investigate secure communication over sparse millimeter-wave (mm-Wave) massive multiple-input multiple-output (MIMO) channels by exploiting the spatial sparsity of legitimate user's channel. We propose a secure communication scheme in which information data is precoded onto dominant angle components of the sparse channel through a limited number of radio-frequency (RF) chains, while artificial noise (AN) is broadcast over the remaining nondominant angles interfering only with the eavesdropper with a high probability. It is shown that the channel sparsity plays a fundamental role analogous to secret keys in achieving secure communication. Hence, by defining two statistical measures of the channel sparsity, we analytically characterize its impact on secrecy rate. In particular, a substantial improvement on secrecy rate can be obtained by the proposed scheme due to the uncertainty, i.e., "entropy", introduced by the channel sparsity which is unknown to the eavesdropper. It is revealed that sparsity in the power domain can always contribute to the secrecy rate. In contrast, in the angle domain, there exists an optimal level of sparsity that maximizes the secrecy rate. The effectiveness of the proposed scheme and derived results are verified by numerical simulations.


title: Review of Quantitative Systems Pharmacological Modeling in Thrombosis

abstract: Hemostasis and thrombosis are often thought as two sides of the same clotting mechanism whereas hemostasis is a natural protective mechanism to prevent bleeding and thrombosis is a blood clot abnormally formulated inside a blood vessel, blocking the normal blood flow. The evidence to date suggests that at least arterial thrombosis results from the same critical pathways of hemostasis. Analysis of these complex processes and pathways using quantitative systems pharmacological model-based approach can facilitate the delineation of the causal pathways that lead to the emergence of thrombosis. In this paper, we provide an overview of the main molecular and physiological mechanisms associated with hemostasis and thrombosis, and review the models and quantitative system pharmacological modeling approaches that are relevant in characterizing the interplay among the multiple factors and pathways of thrombosis. An emphasis is given to computational models for drug development. Future trends are discussed.


title: Optimal perturbations and transition energy thresholds in boundary layer shear flows

abstract: Subcritical transition to turbulence in spatially developing boundary layer flows can be triggered efficiently by finite amplitude perturbations. In this work, we employ adjoint-based optimization to identify optimal initial perturbations in the Blasius boundary layer, culminating in the computation of the subcritical transition critical energy threshold and the associated fully localized critical optimum in a spatially extended configuration, the so called minimal seed. By dynamically rescaling the variables with the local boundary layer thickness, we show that the identified edge trajectory approaches the same attracting phase space region as previously reported edge trajectories, and reaches the region more efficiently.


title: Counting solutions to random CNF formulas

abstract: We give the first efficient algorithm to approximately count the number of solutions in the random $k$-SAT model when the density of the formula scales exponentially with $k$. The best previous counting algorithm for the permissive version of the model was due to Montanari and Shah and was based on the correlation decay method, which works up to densities $(1+o_k(1))\frac{2\log k}{k}$, the Gibbs uniqueness threshold for the model. Instead, our algorithm harnesses a recent technique by Moitra to work for random formulas. The main challenge in our setting is to account for the presence of high-degree variables whose marginal distributions are hard to control and which cause significant correlations within the formula.


title: Synchronization stability and circuit experiment of hyperchaos with time delay using impulse control

abstract: Secure communication using hyperchaos has a better potential performance, but hyperchaotic impulse circuits synchronization is a challenging task. In this paper, an impulse control method is proposed for the synchronization of two hyperchaotic Chen circuits. The sufficient conditions for the synchronization of hyperchaotic systems using the impulse control are given. The upper bound of the impulse interval is derived to assure the synchronization error system to be asymptotically stable. Simulation and circuit experiment show the correctness of the analysis and feasibility of the proposed method.


title: Biophysical characterization of DNA origami nanostructures reveals inaccessibility to intercalation binding sites

abstract: Intercalation of drug molecules into synthetic DNA nanostructures formed through self-assembled origami has been postulated as a valuable future method for targeted drug delivery. This is due to the excellent biocompatibility of synthetic DNA nanostructures, and high potential for flexible programmability including facile drug release into or near to target cells. Such favourable properties may enable high initial loading and efficient release for a predictable number of drug molecules per nanostructure carrier, important for efficient delivery of safe and effective drug doses to minimise non-specific release away from target cells. However, basic questions remain as to how intercalation-mediated loading depends on the DNA carrier structure. Here we use the interaction of dyes YOYO-1 and acridine orange with a tightly-packed 2D DNA origami tile as a simple model system to investigate intercalation-mediated loading. We employed multiple biophysical techniques including single-molecule fluorescence microscopy, atomic force microscopy, gel electrophoresis and controllable damage using low temperature plasma on synthetic DNA origami samples. Our results indicate that not all potential DNA binding sites are accessible for dye intercalation, which has implications for future DNA nanostructures designed for targeted drug delivery.